00000100:00100000:3.0:1786562515.560425:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11183 00002000:00100000:3.0:1786562515.560435:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x72e:0x0] (1953792->1957887) req@ffff90e88433a680 x1873345652596992/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:741/0 lens 488/4536 e 0 to 0 dl 1786562526 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562515.560445:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433a680 with x1873345652596992 ext(1953792->1957887) 00002000:00010000:3.0:1786562515.560449:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88433a680 00000100:00100000:3.0:1786562515.574958:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.577783:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652597504 00000100:00100000:3.0:1786562515.577791:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652597504 00000100:00100000:3.0:1786562515.577832:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6190 00000100:00100000:3.0:1786562515.577839:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+28:63853:x1873345652597504:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562515.578084:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+29:63853:x1873345652597504:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 244us (475us total) trans 8589950472 rc 0/0 00000100:00100000:3.0:1786562515.578089:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6190 00000100:00100000:3.0:1786562515.581165:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.600793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.603596:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.614176:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17114 00000100:00100000:3.0:1786562515.614190:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345652598400:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562515.614430:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562515.614459:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083451427/0x5c655bf66689d64c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbe4d expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562515.614562:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654776960:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562515.614643:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00002000:00010000:3.0:1786562515.629300:0:29965:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562513 -> 1786562514 00002000:00010000:3.0:1786562515.629315:0:29965:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562513 -> 1786562514 00002000:00010000:3.0:1786562515.629320:0:29965:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562513 -> 1786562514 00000100:00100000:3.0:1786562515.629356:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654776960:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562515.629409:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083451427/0x5c655bf66689d64c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe4d expref: 20 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.629449:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083451427/0x5c655bf66689d64c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe4d expref: 20 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.629464:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7c00, rc 0) 00000100:00100000:3.0:1786562515.629556:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652598400:12345-192.168.204.29@tcp:101:cat.0 Request processed in 15370us (16076us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562515.629567:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17114 00000100:00100000:3.0:1786562515.641661:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652599040 00000100:00100000:3.0:1786562515.641774:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652599040 00000100:00100000:3.0:1786562515.687366:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.687406:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.693303:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.693945:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.694921:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652600192 00000100:00100000:3.0:1786562515.694928:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652600192 00000100:00100000:3.0:1786562515.694980:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17121 00000100:00100000:3.0:1786562515.694994:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2349:x1873345652600064:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562515.695035:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562515.695050:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689d692 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbe85 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.695098:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689d692 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe85 expref: 20 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.695124:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689d692 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe85 expref: 20 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.695142:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7c00, rc 0) 00000100:00100000:3.0:1786562515.695176:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2349:x1873345652600064:12345-192.168.204.29@tcp:101:cat.0 Request processed in 186us (1231us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562515.695196:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17121 00000100:00100000:3.0:1786562515.695289:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652600448 00000100:00100000:3.0:1786562515.695294:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652600448 00000100:00100000:3.0:1786562515.695336:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 944 00000100:00100000:3.0:1786562515.695346:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+31:2350:x1873345652600448:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562515.695355:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562515.695370:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689d67d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe77 expref: 31 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.695383:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:3.0:1786562515.695387:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562515.695404:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+30:2350:x1873345652600448:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562515.695409:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 944 00000100:00100000:3.0:1786562515.710373:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652600704 00000100:00100000:3.0:1786562515.710388:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652600704 00010000:00010000:3.0:1786562515.710431:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbdd6 expref: 21 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562515.710558:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8342 00000100:00100000:3.0:1786562515.710580:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2351:x1873345652600704:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562515.710596:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562515.710629:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbdd6 expref: 21 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.710645:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1339391) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbdd6 expref: 21 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.710670:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1339391) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbdd6 expref: 21 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.710687:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562515.710706:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562515.710714:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.710736:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.710778:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562515.710793:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654777600:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562515.710880:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562515.715293:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654777600:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562515.715321:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562515.795685:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5860 00000100:00100000:3.0:1786562515.795708:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+35:2349:x1873345652601472:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562515.800095:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+37:2349:x1873345652601472:12345-192.168.204.29@tcp:4:cat.0 Request processed in 4379us (5329us total) trans 17179875905 rc 0/0 00000100:00100000:3.0:1786562515.800112:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5860 00002000:00100000:3.0:1786562515.800126:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x713:0x0] (1740800->1798143) req@ffff90e889e87b80 x1873345652601472/t17179875905(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:741/0 lens 488/448 e 0 to 0 dl 1786562526 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562515.800138:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889e87b80 with x1873345652601472 ext(1740800->1798143) 00010000:00010000:3.0:1786562515.800150:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aa2457f6/0x5c655bf66689d565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1740800->1798143] (req 1740800->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbdc8 expref: 37 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.800170:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aa2457f6/0x5c655bf66689d565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1740800->1798143] (req 1740800->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbdc8 expref: 37 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562515.800179:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e889e87b80 00000100:00100000:3.0:1786562515.805090:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.850845:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.899943:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652601856 00000100:00100000:3.0:1786562515.899950:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652601856 00000100:00100000:3.0:1786562515.899988:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17126 00000100:00100000:3.0:1786562515.899995:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:63863:x1873345652601856:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562515.900026:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562515.900051:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbea8 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.900083:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562515.900089:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562515.900100:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea8 expref: 18 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.900118:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea8 expref: 18 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.900131:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881000, rc 0) 00000100:00100000:3.0:1786562515.900200:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:63863:x1873345652601856:12345-192.168.204.29@tcp:101:cat.0 Request processed in 204us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562515.900207:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17126 00000100:00100000:3.0:1786562515.900276:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11192 00000100:00100000:3.0:1786562515.900285:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652602112:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562515.901344:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11193 00000100:00100000:3.0:1786562515.901357:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652602240:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562515.920750:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.925977:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.935361:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.938245:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562515.951311:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652603392 00000100:00100000:3.0:1786562515.951328:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652603392 00000100:00100000:3.0:1786562515.951522:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17127 00000100:00100000:3.0:1786562515.951540:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+36:2350:x1873345652603392:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562515.951565:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562515.951590:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d702 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbebd expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.951677:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d702 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbebd expref: 37 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.951714:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d702 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbebd expref: 37 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.951731:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf64800, rc 0) 00000100:00100000:3.0:1786562515.951793:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+36:2350:x1873345652603392:12345-192.168.204.29@tcp:101:cat.0 Request processed in 261us (3547us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562515.951801:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17127 00000100:00100000:3.0:1786562515.977506:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652603648 00000100:00100000:3.0:1786562515.977528:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652603648 00000100:00100000:3.0:1786562515.990160:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654777984:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562515.990208:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689d709 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbec4 expref: 22 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562515.990236:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22e00, rc 0) 00000100:00100000:3.0:1786562515.990300:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:63863:x1873345652603648:12345-192.168.204.29@tcp:101:cat.0 Request processed in 9051us (17412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562515.990329:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17128 00000100:00100000:3.0:1786562516.007284:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652604160 00000100:00100000:3.0:1786562516.007293:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652604160 00000100:00100000:3.0:1786562516.007362:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6192 00000100:00100000:3.0:1786562516.007374:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+522:63858:x1873345652604160:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562516.007622:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+523:63858:x1873345652604160:12345-192.168.204.29@tcp:35:cat.0 Request processed in 250us (2052us total) trans 8589950478 rc 0/0 00000100:00100000:3.0:1786562516.007632:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6192 00000100:00100000:3.0:1786562516.035483:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562516.043146:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689d717 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed2 expref: 37 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.043178:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176fe00, rc 0) 00000100:00100000:0.0:1786562516.043324:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+37:63866:x1873345652604416:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 18721us (18990us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.043335:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17130 00000100:00100000:3.0:1786562516.050924:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652604672 00000100:00100000:3.0:1786562516.050943:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652604672 00000100:00100000:0.0:1786562516.051021:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652604800 00000100:00100000:0.0:1786562516.051032:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652604800 00010000:00010000:0.0:1786562516.051086:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea8 expref: 19 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.051125:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652604928 00000100:00100000:0.0:1786562516.051128:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652604928 00010000:00010000:0.0:1786562516.051141:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe9a expref: 37 pid: 6659 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.051161:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8345 00000100:00100000:0.0:1786562516.051171:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:2351:x1873345652604800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.051187:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.051214:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea8 expref: 19 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.051228:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea8 expref: 19 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.051255:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095a72c07/0x5c655bf66689d6b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea8 expref: 19 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.051292:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.051313:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2351:x1873345652604800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 144us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.051320:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8345 00000100:00100000:0.0:1786562516.058979:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605056 00000100:00100000:0.0:1786562516.058995:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605056 00002000:00100000:0.0:1786562516.059091:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x713:0x0] (1994752->1998847) req@ffff90e9887ee300 x1873345652605056/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:742/0 lens 488/0 e 0 to 0 dl 1786562527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562516.059104:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ee300 with x1873345652605056 ext(1994752->1998847) 00002000:00010000:0.0:1786562516.059112:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887ee300 00000100:00100000:0.0:1786562516.059158:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11196 00000100:00100000:0.0:1786562516.059169:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652605056:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562516.059398:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652605056:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 228us (525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562516.059407:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11196 00002000:00100000:0.0:1786562516.059415:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x713:0x0] (1994752->1998847) req@ffff90e9887ee300 x1873345652605056/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:742/0 lens 488/4536 e 0 to 0 dl 1786562527 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562516.059425:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ee300 with x1873345652605056 ext(1994752->1998847) 00002000:00010000:0.0:1786562516.059429:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887ee300 00000100:00100000:0.0:1786562516.068618:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605184 00000100:00100000:0.0:1786562516.068631:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605184 00000100:00100000:0.0:1786562516.068707:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605312 00000100:00100000:0.0:1786562516.068711:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605312 00000100:00100000:0.0:1786562516.068744:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17131 00000100:00100000:0.0:1786562516.068754:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+36:63866:x1873345652605184:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562516.068773:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562516.068794:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbed9 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.068834:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 37 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.068853:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 16 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.068864:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 5) 00010000:00010000:0.0:1786562516.068946:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 5) 00010000:00010000:0.0:1786562516.068955:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->2564095] (req 2097152->2564095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 37 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.071271:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 17 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.071292:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 17 pid: 28861 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.071321:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654778880:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.071432:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 37 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.071448:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 37 pid: 28862 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.071458:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654779008:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.071480:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562516.076832:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654778880:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.076861:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654779008:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.077243:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->2564095] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 37 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.077280:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176f200, rc 0) 00000100:00100000:0.0:1786562516.077345:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+37:63866:x1873345652605184:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 8588us (9229us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.077357:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17131 00000100:00100000:3.0:1786562516.079757:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.088124:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605568 00000100:00100000:0.0:1786562516.088141:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605568 00010000:00010000:0.0:1786562516.088203:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 17 pid: 28861 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.088251:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605696 00000100:00100000:0.0:1786562516.088257:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605696 00010000:00010000:0.0:1786562516.088277:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 39 pid: 28862 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.088315:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8348 00000100:00100000:0.0:1786562516.088330:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652605568:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.088353:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.088384:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 17 pid: 28861 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088402:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 17 pid: 28861 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088435:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d788ddc/0x5c655bf66689d57a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbddd expref: 17 pid: 28861 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088462:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.088562:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652605568:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 235us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.088574:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8348 00000100:00100000:0.0:1786562516.088601:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8349 00000100:00100000:0.0:1786562516.088612:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+39:2349:x1873345652605696:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.088623:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.088637:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 39 pid: 28862 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088650:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 39 pid: 28862 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088669:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689d4e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd9e expref: 39 pid: 28862 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088692:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 5) 00010000:00010000:0.0:1786562516.088698:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 5) 00010000:00010000:0.0:1786562516.088708:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 38 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088720:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 38 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.088766:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 38 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.088783:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654779136:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562516.088851:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562516.094188:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654779136:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562516.094223:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.097854:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+39:2349:x1873345652605696:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 9225us (10074us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.097873:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8349 00000100:00100000:3.0:1786562516.106138:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605824 00000100:00100000:3.0:1786562516.106157:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605824 00002000:00100000:3.0:1786562516.106242:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (2560000->2564095) req@ffff90e889f59880 x1873345652605824/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:742/0 lens 488/0 e 0 to 0 dl 1786562527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562516.106256:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f59880 with x1873345652605824 ext(2560000->2564095) 00002000:00010000:3.0:1786562516.106265:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f59880 00000100:00100000:3.0:1786562516.106309:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11197 00000100:00100000:3.0:1786562516.106325:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+38:2348:x1873345652605824:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562516.106640:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+38:2348:x1873345652605824:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 316us (1335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562516.106651:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11197 00002000:00100000:3.0:1786562516.106661:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (2560000->2564095) req@ffff90e889f59880 x1873345652605824/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:742/0 lens 488/4536 e 0 to 0 dl 1786562527 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562516.106744:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f59880 with x1873345652605824 ext(2560000->2564095) 00002000:00010000:3.0:1786562516.106747:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f59880 00000100:00100000:0.0:1786562516.107835:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652605952 00000100:00100000:0.0:1786562516.107848:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652605952 00010000:00010000:0.0:1786562516.107901:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058946f33/0x5c655bf66689d614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe3f expref: 38 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.108079:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8350 00000100:00100000:0.0:1786562516.108091:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+38:2351:x1873345652605952:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.108111:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562516.108141:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562514 -> 1786562515 00002000:00010000:0.0:1786562516.108145:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562513 -> 1786562515 00010000:00010000:0.0:1786562516.108155:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058946f33/0x5c655bf66689d614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe3f expref: 38 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.108173:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058946f33/0x5c655bf66689d614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3440639) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe3f expref: 38 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.108208:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058946f33/0x5c655bf66689d614 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3440639) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe3f expref: 38 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.108232:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 5) 00010000:00010000:0.0:1786562516.108238:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 5) 00010000:00010000:0.0:1786562516.108251:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.108265:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.108323:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.108350:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654779264:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562516.108458:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.142051:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652606336 00000100:00100000:3.0:1786562516.142065:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652606336 00000100:00100000:3.0:1786562516.142418:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17133 00000100:00100000:3.0:1786562516.142432:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:63867:x1873345652606336:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562516.142458:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.142483:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbee7 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.142528:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 36 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.142540:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 5) 00010000:00010000:3.0:1786562516.142546:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 5) 00010000:00010000:3.0:1786562516.142553:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.142598:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 36 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.142622:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 36 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.142647:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654779392:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562516.142733:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.146587:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654779392:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562516.146647:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.146676:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562516.146693:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65e00, rc 0) 00000100:00100000:3.0:1786562516.146782:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:63867:x1873345652606336:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 4353us (5268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.146794:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17133 00000100:00100000:0.0:1786562516.150978:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.151100:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.151195:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17134 00000100:00100000:0.0:1786562516.151215:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2351:x1873345652606592:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562516.151239:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562516.151269:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689d733 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbeee expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.151768:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654779520:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562516.153252:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+39:2348:x1873345652606464:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 6066us (6570us total) trans 17179875907 rc 0/0 00000100:00100000:3.0:1786562516.153267:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5863 00002000:00100000:3.0:1786562516.153282:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2564095) req@ffff90e88c79a680 x1873345652606464/t17179875907(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:742/0 lens 488/448 e 0 to 0 dl 1786562527 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562516.153293:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79a680 with x1873345652606464 ext(2097152->2564095) 00010000:00010000:3.0:1786562516.153304:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 39 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.153532:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 39 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562516.153543:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79a680 00000100:00100000:0.0:1786562516.158316:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652606848 00000100:00100000:0.0:1786562516.158333:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652606848 00010000:00010000:0.0:1786562516.158393:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 39 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.158444:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8351 00000100:00100000:0.0:1786562516.158457:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+39:2350:x1873345652606848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.158477:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562516.158503:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562514 -> 1786562515 00010000:00010000:0.0:1786562516.158512:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 39 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.158533:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 39 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.158563:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689d71e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2564095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed9 expref: 39 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.158586:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 5) 00010000:00010000:0.0:1786562516.158591:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 5) 00010000:00010000:0.0:1786562516.158604:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.158617:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.158776:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.158803:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c798700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654779648:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562516.158981:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3300 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.160026:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652606976 00000100:00100000:3.0:1786562516.160037:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652606976 00000100:00100000:3.0:1786562516.160095:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17136 00000100:00100000:3.0:1786562516.160107:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652606976:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562516.160128:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.160148:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d741 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbefc expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.160214:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654779776:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562516.160314:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562516.160930:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.163908:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654779776:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562516.163957:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d741 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbefc expref: 18 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.163986:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d741 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbefc expref: 18 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.164002:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf64800, rc 0) 00000100:00100000:3.0:1786562516.164119:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652606976:12345-192.168.204.29@tcp:101:cat.0 Request processed in 4013us (4282us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562516.164130:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17136 00000100:00100000:0.0:1786562516.164415:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c798700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654779648:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562516.164431:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.164457:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+38:2350:x1873345652606848:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6003us (6214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.164470:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8351 00000100:00100000:3.0:1786562516.171117:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652607616 00000100:00100000:3.0:1786562516.171125:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652607616 00000100:00100000:3.0:1786562516.171310:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17138 00000100:00100000:3.0:1786562516.171322:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:63867:x1873345652607616:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562516.171336:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.171362:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf0a expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.171407:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689d709 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbec4 expref: 23 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.171418:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 4) 00010000:00010000:3.0:1786562516.171423:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 4) 00010000:00010000:3.0:1786562516.171428:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->2859007] (req 2097152->2859007) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 23 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.171476:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689d709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbec4 expref: 23 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.171493:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689d709 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbec4 expref: 23 pid: 29967 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.171512:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654779904:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562516.171636:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.173908:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654779904:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562516.174077:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->2859007] (req 2097152->2859007) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 23 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.174106:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf64800, rc 0) 00000100:00100000:3.0:1786562516.174170:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+23:63867:x1873345652607616:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 2851us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.174185:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17138 00000100:00100000:0.0:1786562516.176168:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.189154:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.192808:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.193255:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652608128 00000100:00100000:3.0:1786562516.193269:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652608128 00000100:00100000:3.0:1786562516.193380:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6194 00000100:00100000:3.0:1786562516.193393:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+32:63867:x1873345652608128:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562516.193802:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+33:63867:x1873345652608128:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 410us (1006us total) trans 8589950480 rc 0/0 00000100:00100000:3.0:1786562516.193812:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6194 00000100:00100000:0.0:1786562516.213364:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652608256 00000100:00100000:0.0:1786562516.213377:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652608256 00000100:00100000:0.0:1786562516.213478:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16955 00000100:00100000:0.0:1786562516.213491:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:63872:x1873345652608256:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562516.213518:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562516.213546:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf11 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.213638:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.213656:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.213694:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.213715:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.213724:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.213731:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.215145:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.215174:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689ceff lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbacd expref: 522 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.215184:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.215237:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689ceff lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbacd expref: 522 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.215255:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689ceff lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbacd expref: 522 pid: 33115 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.215274:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654780160:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.215403:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562516.222423:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654780160:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.222459:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.234133:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562516.236309:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236326:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562516.236465:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:0.0:1786562516.236472:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562516.236503:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236521:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236534:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236541:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236555:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236562:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562516.236568:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236576:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236591:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562516.236595:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562516.236599:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236605:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266200/0x5c655bf66689d75d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236622:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236633:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236640:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236645:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988267e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562516.236648:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236654:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236660:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562516.236663:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562516.236666:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236671:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689d764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236729:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf11 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236743:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf11 expref: 7 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.236752:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.236754:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562516.236758:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176f200, rc 0) 00000100:00100000:0.0:1786562516.239380:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63872:x1873345652608256:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 25875us (26152us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.239404:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16955 00000100:00100000:3.0:1786562516.243075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.243116:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.243139:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.243174:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.243208:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652608768 00000100:00100000:3.0:1786562516.243220:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652608768 00000100:00100000:3.0:1786562516.243293:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652609024 00000100:00100000:3.0:1786562516.243297:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652609024 00000100:00100000:3.0:1786562516.243319:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652609280 00000100:00100000:3.0:1786562516.243322:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652609280 00000100:00100000:3.0:1786562516.243337:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652608896 00000100:00100000:3.0:1786562516.243339:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652608896 00000100:00100000:3.0:1786562516.243362:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17139 00000100:00100000:3.0:1786562516.243375:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652608768:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562516.243398:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.243421:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689d772 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf18 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.243458:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=2s v=(2 0) 00010000:00010000:3.0:1786562516.243463:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1786562516.243477:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689d772 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf18 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.243497:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689d772 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf18 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.243512:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:3.0:1786562516.243581:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652608768:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 209us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.243588:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17139 00000100:00100000:3.0:1786562516.243608:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17140 00000100:00100000:3.0:1786562516.243614:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652609024:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562516.243622:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.244668:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf26 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.244716:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562516.244721:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562516.244732:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.244748:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.244760:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261c400, rc 0) 00000100:00100000:3.0:1786562516.244802:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652609024:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 1187us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.244810:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17140 00000100:00100000:3.0:1786562516.244835:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17141 00000100:00100000:3.0:1786562516.244845:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652609280:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562516.244856:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.244870:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689d780 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf34 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.244896:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689d780 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf34 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.244912:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689d780 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf34 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.244929:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261de00, rc 0) 00000100:00100000:3.0:1786562516.244951:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652609280:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 110us (1812us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562516.244958:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17141 00000100:00100000:3.0:1786562516.244971:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17142 00000100:00100000:3.0:1786562516.244978:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652608896:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562516.244986:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.244997:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689d787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf1f expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.245029:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562516.245032:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562516.245040:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689d787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf1f expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.245052:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689d787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf1f expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.245061:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af415600, rc 0) 00000100:00100000:3.0:1786562516.245086:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652608896:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 108us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.245093:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17142 00000100:00100000:3.0:1786562516.245175:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.245265:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.245287:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652609152 00000100:00100000:0.0:1786562516.245299:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652609152 00000100:00100000:0.0:1786562516.245340:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652609408 00000100:00100000:0.0:1786562516.245344:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652609408 00000100:00100000:0.0:1786562516.245377:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17143 00000100:00100000:0.0:1786562516.245387:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652609152:12345-192.168.204.29@tcp:101:mirror_io.0 00000100:00100000:3.0:1786562516.245391:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17144 00010000:00010000:0.0:1786562516.245399:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1786562516.245404:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652609408:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562516.245414:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562516.245416:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1420dd7/0x5c655bf66689d78e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf2d expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.245426:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689d795 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf3b expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.245483:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654780288:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562516.245484:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654780416:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562516.245566:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.246525:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00002000:00010000:3.0:1786562516.254810:0:28861:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562514 -> 1786562515 00002000:00010000:3.0:1786562516.254824:0:28861:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562514 -> 1786562515 00000100:00100000:3.0:1786562516.254860:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654780288:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562516.254922:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689d795 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf3b expref: 13 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.254960:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689d795 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf3b expref: 13 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.254976:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:3.0:1786562516.255095:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652609408:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 9693us (9828us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562516.255106:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17144 00000100:00100000:3.0:1786562516.265204:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652609664 00000100:00100000:3.0:1786562516.265217:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652609664 00000100:00100000:3.0:1786562516.265288:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16956 00000100:00100000:3.0:1786562516.265300:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63872:x1873345652609664:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562516.265329:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562516.265357:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d79c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf42 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.265503:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d7a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.265523:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf11 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.265533:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d7a3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.265827:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf11 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.265844:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f200/0x5c655bf66689d76b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf11 expref: 8 pid: 33114 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.265860:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654780544:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562516.266292:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.269562:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562516.272035:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.272053:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562516.272083:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:0.0:1786562516.272310:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d79c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf42 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.272336:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf42 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.272352:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.272355:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562516.272358:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a6600, rc 0) 00000100:00100000:0.0:1786562516.272499:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63872:x1873345652609664:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 7200us (7528us total) trans 8589950482 rc 0/0 00000100:00100000:0.0:1786562516.272509:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16956 00000100:00100000:3.0:1786562516.277921:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.278137:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652610048 00000100:00100000:0.0:1786562516.278152:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652610048 00000100:00100000:0.0:1786562516.278221:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16957 00000100:00100000:0.0:1786562516.278233:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63872:x1873345652610048:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562516.278267:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562516.278271:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786562516.278307:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d7a3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf42 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.278334:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.278339:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562516.278356:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689d7b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf49 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.278486:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d7b8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.278503:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.278514:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562516.278529:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:0.0:1786562516.278726:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689d7b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf49 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.278742:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf49 expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.278750:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.278754:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562516.278756:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988267000, rc 0) 00000100:00100000:0.0:1786562516.278837:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63872:x1873345652610048:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 605us (930us total) trans 8589950483 rc 0/0 00000100:00100000:0.0:1786562516.278845:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16957 00000100:00100000:3.0:1786562516.282371:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.286482:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.286526:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.286551:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.286571:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.287116:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17147 00000100:00100000:3.0:1786562516.287130:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652610688:12345-192.168.204.29@tcp:1:mirror_io.0 00010000:00010000:3.0:1786562516.287154:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689d7db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.287168:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689d717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed2 expref: 37 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.287177:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562516.287180:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(3 2) 00010000:00010000:3.0:1786562516.287183:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689d7db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.287206:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689d717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed2 expref: 37 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.287215:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689d717 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed2 expref: 37 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.287224:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654780928:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.287503:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17148 00000100:00100000:0.0:1786562516.287516:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652610560:12345-192.168.204.29@tcp:1:mirror_io.0 00010000:00010000:0.0:1786562516.287545:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689d7e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287558:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 21 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.287577:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26240 going to sleep for 11 seconds 00010000:00010000:0.0:1786562516.287580:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287587:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 21 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287594:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562516.287597:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562516.287600:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689d7e2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287631:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 21 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287641:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 21 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.287652:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654781184:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.287711:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287721:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 13 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.287730:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654781312:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.287762:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 21 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.287772:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 21 pid: 6660 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.287783:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654781440:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.287803:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.288230:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.288292:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652610816 00000100:00100000:0.0:1786562516.288299:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652610816 00000100:00100000:0.0:1786562516.288341:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17149 00000100:00100000:0.0:1786562516.288350:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652610816:12345-192.168.204.29@tcp:1:mirror_io.0 00010000:00010000:0.0:1786562516.288382:0:8368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689d7e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288397:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288407:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288415:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689cd1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb9bc expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288424:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 37 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288437:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 4 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 5) 00010000:00010000:0.0:1786562516.288441:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 5) 00010000:00010000:0.0:1786562516.288445:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689d7e9 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288469:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 37 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.288479:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 37 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.288490:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654781568:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562516.289123:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.291260:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652610944 00000100:00100000:3.0:1786562516.291270:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652610944 00010000:00010000:0.0:1786562516.296231:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689cd1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb9bc expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.296258:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689cd1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb9bc expref: 16 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.296281:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654782208:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.296343:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.296353:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.296364:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654782336:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.296396:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.296407:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.296416:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654782464:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.296439:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562516.309435:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.310562:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654781312:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.310578:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654781440:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562516.317437:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.317534:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652611072 00000100:00100000:0.0:1786562516.317544:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652611072 00010000:00010000:0.0:1786562516.317600:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.317651:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8356 00000100:00100000:0.0:1786562516.317662:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652611072:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.317696:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.317728:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.317743:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.317782:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689d779 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf26 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.317812:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.322732:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.324112:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654780928:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562516.324156:0:29662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689d7db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.324261:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c798a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654781184:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562516.324283:0:29965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689d7e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.324899:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652611328 00000100:00100000:3.0:1786562516.324910:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652611328 00010000:00010000:3.0:1786562516.325566:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 22 pid: 6660 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.325614:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8357 00000100:00100000:3.0:1786562516.325628:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652611328:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.325648:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.325694:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 22 pid: 6660 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.325707:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 22 pid: 6660 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.325739:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b1efbc/0x5c655bf66689d661 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe70 expref: 22 pid: 6660 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.325828:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.326507:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652611328:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 881us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.326519:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8357 00000100:00100000:0.0:1786562516.333287:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652611072:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 15608us (15847us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.333306:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8356 00000100:00100000:0.0:1786562516.338724:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654782080:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.338780:0:28862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689d7f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.341187:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8359 00000100:00100000:0.0:1786562516.341199:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652611712:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.341211:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.341230:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689d772 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf18 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.341243:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689d772 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf18 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.341258:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689d772 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf18 expref: 14 pid: 29662 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.341270:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.341294:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652611712:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 98us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.341305:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8359 00000100:00100000:3.0:1786562516.341711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.341739:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652611584 00000100:00100000:3.0:1786562516.341747:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652611584 00010000:00010000:3.0:1786562516.341773:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbbafc8d/0x5c655bf66689d40e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd19 expref: 17 pid: 29967 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.341794:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8362 00000100:00100000:3.0:1786562516.341801:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652611584:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.341808:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.341819:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbbafc8d/0x5c655bf66689d40e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd19 expref: 17 pid: 29967 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.341828:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbbafc8d/0x5c655bf66689d40e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd19 expref: 17 pid: 29967 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.341841:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbbafc8d/0x5c655bf66689d40e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbd19 expref: 17 pid: 29967 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.341855:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1786562516.341861:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1786562516.341868:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.341880:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.341911:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.341932:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652611584:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 132us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.341942:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8362 00000100:00100000:3.0:1786562516.342048:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.342063:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652611968 00000100:00100000:3.0:1786562516.342067:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652611968 00010000:00010000:3.0:1786562516.342083:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689d68b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe7e expref: 22 pid: 12119 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.342097:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8363 00000100:00100000:3.0:1786562516.342104:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:2348:x1873345652611968:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.342111:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.342124:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689d68b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe7e expref: 22 pid: 12119 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342137:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689d68b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe7e expref: 22 pid: 12119 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342153:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689d68b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbe7e expref: 22 pid: 12119 timeout: 1048 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342162:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562516.342166:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562516.342171:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342178:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342198:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.342214:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2348:x1873345652611968:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 111us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.342220:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8363 00000100:00100000:3.0:1786562516.342256:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.342271:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652612352 00000100:00100000:3.0:1786562516.342274:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652612352 00010000:00010000:3.0:1786562516.342285:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 38 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.342298:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8364 00000100:00100000:3.0:1786562516.342303:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+38:2348:x1873345652612352:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.342309:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.342318:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 38 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342327:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 38 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342338:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689d2d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbc4e expref: 38 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342347:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.342361:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+37:2348:x1873345652612352:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.342367:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8364 00000100:00100000:3.0:1786562516.342411:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562516.342535:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342546:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342566:0:29963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342579:0:29963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342591:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342601:0:29963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342604:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342619:0:29963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342623:0:29964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342636:0:29963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342638:0:29964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562516.342647:0:29964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342649:0:29963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f22000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562516.342656:0:29963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342662:0:29964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.342668:0:29963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342689:0:29964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.342705:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689d7cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.342764:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652610304:12345-192.168.204.29@tcp:1:mirror_io.0 Request processed in 55919us (56298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.342774:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17145 00010000:00010000:0.0:1786562516.343616:0:29963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.343636:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689d7d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.343849:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652610432:12345-192.168.204.29@tcp:1:mirror_io.0 Request processed in 56980us (57317us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.343858:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17146 00000100:00100000:0.0:1786562516.344177:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652612224 00000100:00100000:0.0:1786562516.344188:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652612224 00002000:00100000:0.0:1786562516.344241:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->2859007) req@ffff90e98553c700 x1873345652612224/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:742/0 lens 488/0 e 0 to 0 dl 1786562527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562516.344253:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553c700 with x1873345652612224 ext(2097152->2859007) 00010000:00010000:0.0:1786562516.344263:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2859007) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 21 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.344277:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2859007) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 21 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562516.344287:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e98553c700 00000100:00100000:0.0:1786562516.344398:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5864 00000100:00100000:0.0:1786562516.344409:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2348:x1873345652612224:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562516.346858:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.346916:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652612864 00000100:00100000:3.0:1786562516.346929:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652612864 00010000:00010000:3.0:1786562516.346980:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.347049:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8365 00000100:00100000:3.0:1786562516.347062:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652612864:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.347081:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.347113:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.347128:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.347159:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689d725 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee0 expref: 16 pid: 6659 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.347187:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.348497:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652612864:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1427us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.348519:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8365 00000100:00100000:0.0:1786562516.354415:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652612608 00000100:00100000:0.0:1786562516.354422:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652612608 00010000:00010000:0.0:1786562516.354453:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 23 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.354497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8366 00000100:00100000:0.0:1786562516.354506:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+23:2351:x1873345652612608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.354518:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.354544:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 23 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.354558:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 23 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.354829:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689d6ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbea1 expref: 23 pid: 29963 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.354850:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562516.354856:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562516.354863:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689d7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.354876:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689d7e2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.354916:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.360160:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:2351:x1873345652612608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3861us (5124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.360175:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8366 00000100:00100000:0.0:1786562516.371431:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.371588:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652612992 00000100:00100000:3.0:1786562516.371599:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652612992 00010000:00010000:3.0:1786562516.371638:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2859007) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 22 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.371700:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8367 00000100:00100000:3.0:1786562516.371710:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:2349:x1873345652612992:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.371727:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.371762:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2859007) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 22 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.371776:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2859007) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 22 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.371805:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff6e389/0x5c655bf66689d74f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2859007) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf0a expref: 22 pid: 29965 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.371826:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562516.371831:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562516.371838:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689d7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.371850:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689d7f0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.371898:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.371952:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2349:x1873345652612992:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 236us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.371960:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8367 00000100:00100000:0.0:1786562516.380674:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652613120 00000100:00100000:0.0:1786562516.380765:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652613120 00010000:00010000:0.0:1786562516.380821:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.380882:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652613248 00000100:00100000:0.0:1786562516.380886:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652613248 00010000:00010000:0.0:1786562516.380901:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689d717 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbed2 expref: 38 pid: 6658 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.381404:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8368 00000100:00100000:0.0:1786562516.381428:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652613120:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.381453:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.381482:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.381516:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.381703:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689d72c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbee7 expref: 16 pid: 29662 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.381727:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 5) 00010000:00010000:0.0:1786562516.381733:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 5) 00010000:00010000:0.0:1786562516.381750:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689d7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.381791:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689d7e9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.381828:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.381894:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652613120:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 475us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.381922:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8368 00000100:00100000:0.0:1786562516.383299:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+37:2348:x1873345652613248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1846us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.383314:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8369 00000100:00100000:0.0:1786562516.390541:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652613504 00000100:00100000:0.0:1786562516.390551:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652613504 00000100:00100000:0.0:1786562516.390651:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16959 00000100:00100000:0.0:1786562516.390663:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63872:x1873345652613504:12345-192.168.204.29@tcp:36:mirror_io.0 00010000:00010000:0.0:1786562516.390748:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.390791:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23e00/0x5c655bf66689d7c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf50 expref: 10 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.390818:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.390823:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562516.390873:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.390890:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 32 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.390905:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 522 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.390914:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 32 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.390922:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689cbda lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb906 expref: 522 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.390930:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.391128:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689cbda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb906 expref: 522 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.391145:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689cbda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb906 expref: 522 pid: 36756 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.391162:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654782592:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.391313:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 32 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.391323:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 32 pid: 35929 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.391333:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654782720:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.391365:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 522 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.391385:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 522 pid: 33115 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.391396:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654782848:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.391433:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 32 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.391442:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 32 pid: 33114 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.391450:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654782976:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562516.391472:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562516.396391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.396481:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.397547:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652613760 00000100:00100000:3.0:1786562516.397559:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652613760 00010000:00010000:3.0:1786562516.397648:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 523 pid: 33115 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.397707:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652613632 00000100:00100000:3.0:1786562516.397711:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652613632 00010000:00010000:3.0:1786562516.397727:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 33 pid: 35929 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.397753:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8370 00000100:00100000:3.0:1786562516.397764:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+523:2349:x1873345652613760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.397782:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.397791:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 523 pid: 33115 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.397805:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 523 pid: 33115 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.397839:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689cb5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8ce expref: 523 pid: 33115 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.397859:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:3.0:1786562516.397865:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562516.397971:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8371 00000100:00100000:0.0:1786562516.397982:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+33:2349:x1873345652613632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562516.397991:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562516.397996:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 33 pid: 35929 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.398082:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562516.398151:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+522:2349:x1873345652613760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 388us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562516.398159:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8370 00000100:00100000:3.0:1786562516.399261:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652613888 00000100:00100000:3.0:1786562516.399275:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652613888 00010000:00010000:3.0:1786562516.399314:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 34 pid: 33114 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.399350:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8372 00000100:00100000:3.0:1786562516.399360:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+34:2349:x1873345652613888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562516.399374:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562516.399381:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 34 pid: 33114 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.399486:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 34 pid: 35929 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.399520:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689cb86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8e3 expref: 34 pid: 35929 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.399537:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.399542:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.399551:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562516.401844:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 32 pid: 33114 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.407433:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689cb4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb8c0 expref: 32 pid: 33114 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.407474:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:3.0:1786562516.407481:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562516.407493:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562516.413811:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654782592:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562516.413867:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562516.413936:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652614016 00000100:00100000:3.0:1786562516.413946:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652614016 00010000:00010000:3.0:1786562516.413997:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689cbda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb906 expref: 522 pid: 36756 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.416059:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.416074:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562516.459406:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950483 is committed 00000001:00080000:3.0:1786562516.459430:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950475 is committed 00000001:00080000:3.0:1786562516.459435:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950474 is committed 00000001:00080000:3.0:1786562516.459461:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950481 is committed 00000001:00080000:3.0:1786562516.459466:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950479 is committed 00000001:00080000:3.0:1786562516.459494:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950484 is committed 00000004:00080000:3.0:1786562516.459499:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2807 committed 00000004:00080000:3.0:1786562516.459514:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2825 committed 00000004:00080000:3.0:1786562516.459526:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2824 committed 00000004:00080000:3.0:1786562516.459528:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2823 committed 00000004:00080000:3.0:1786562516.459530:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2822 committed 00000004:00080000:3.0:1786562516.459532:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2806 committed 00000004:00080000:3.0:1786562516.459534:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2821 committed 00000004:00080000:3.0:1786562516.459535:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2805 committed 00000004:00080000:3.0:1786562516.459537:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2820 committed 00000004:00080000:3.0:1786562516.459538:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2804 committed 00000004:00080000:3.0:1786562516.459540:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2803 committed 00000004:00080000:3.0:1786562516.459541:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2802 committed 00000004:00080000:3.0:1786562516.459544:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2819 committed 00000004:00080000:3.0:1786562516.459546:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2818 committed 00000004:00080000:3.0:1786562516.459547:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2801 committed 00000004:00080000:3.0:1786562516.459549:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2800 committed 00000004:00080000:3.0:1786562516.459551:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2817 committed 00000001:00080000:3.0:1786562516.459598:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950480 is committed 00000100:00100000:0.0:1786562516.459910:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562516.460090:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562516.460126:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562516.460143:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562516.460163:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786562516.460168:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562516.460182:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562516.460195:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562516.460211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562516.460242:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783232 00000100:00100000:0.0:1786562516.460249:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783232 00000100:00100000:0.0:1786562516.460305:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783744 00000100:00100000:0.0:1786562516.460307:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783744 00000100:00100000:0.0:1786562516.460321:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783360 00000100:00100000:0.0:1786562516.460323:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783360 00000100:00100000:0.0:1786562516.460336:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783872 00000100:00100000:0.0:1786562516.460338:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783872 00000100:00100000:0.0:1786562516.460355:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17151 00000100:00100000:0.0:1786562516.460362:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3291:x1873345654783232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.461047:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654783104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.461082:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562516.461101:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654783616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.461120:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562516.461138:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786562516.461142:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654783488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.461159:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562516.461180:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654784000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.461197:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562516.461220:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783104 00000100:00100000:3.0:1786562516.461225:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783104 00000100:00100000:3.0:1786562516.461256:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783616 00000100:00100000:3.0:1786562516.461258:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783616 00000100:00100000:3.0:1786562516.461268:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654783488 00000100:00100000:3.0:1786562516.461269:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654783488 00000100:00100000:3.0:1786562516.461277:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654784000 00000100:00100000:3.0:1786562516.461279:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654784000 00000100:00100000:3.0:1786562516.461288:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17152 00000100:00100000:3.0:1786562516.461294:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654783744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562516.461470:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562516.461475:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562506 -> 1786562506 00002000:00010000:3.0:1786562516.461478:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562516.461481:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562506 -> 1786562506 00002000:00010000:3.0:1786562516.461484:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1786562516.461510:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654783744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (1366us total) trans 17179875911 rc 0/0 00000100:00100000:3.0:1786562516.461517:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17152 00000100:00100000:3.0:1786562516.461530:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17153 00000100:00100000:3.0:1786562516.461535:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654783360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.461634:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654783360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (1450us total) trans 17179875912 rc 0/0 00000100:00100000:3.0:1786562516.461641:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17153 00000100:00100000:3.0:1786562516.461658:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17154 00000100:00100000:3.0:1786562516.461664:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654783872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562516.461794:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562516.461798:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562506 -> 1786562506 00002000:00010000:3.0:1786562516.461800:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562516.461802:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562506 -> 1786562506 00002000:00010000:3.0:1786562516.461804:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562516.461831:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654783872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (1618us total) trans 17179875913 rc 0/0 00000100:00100000:3.0:1786562516.461838:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17154 00000100:00100000:3.0:1786562516.461850:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17155 00000100:00100000:3.0:1786562516.461856:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654783104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562516.463055:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3291:x1873345654783232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2690us (2962us total) trans 17179875910 rc 0/0 00000100:00100000:0.0:1786562516.463063:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17151 00000004:00080000:0.0:1786562516.463125:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f55c00/2, rc 0, transno 17179875912 00000100:00100000:0.0:1786562516.463129:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562516.463138:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f57480/2, rc 0, transno 17179875913 00000100:00100000:0.0:1786562516.463142:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562516.463151:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f54700/2, rc 0, transno 17179875910 00000100:00100000:0.0:1786562516.463154:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562516.463161:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f55f80/2, rc 0, transno 17179875911 00000100:00100000:0.0:1786562516.463164:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654783744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562516.464212:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654783104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2354us (3126us total) trans 17179875914 rc 0/0 00000100:00100000:3.0:1786562516.464219:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17155 00000100:00100000:3.0:1786562516.464365:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17162 00000100:00100000:3.0:1786562516.464371:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3292:x1873345654784256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562516.464489:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3292:x1873345654784256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (922us total) trans 21474843453 rc 0/0 00000100:00100000:3.0:1786562516.464495:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17162 00000100:00100000:3.0:1786562516.464506:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17163 00000100:00100000:3.0:1786562516.464511:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3292:x1873345654784768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562516.464633:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1786562516.464638:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562505 -> 1786562505 00002000:00010000:3.0:1786562516.464640:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562516.464642:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562505 -> 1786562505 00002000:00010000:3.0:1786562516.464645:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562516.464669:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3292:x1873345654784768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (1069us total) trans 21474843454 rc 0/0 00000100:00100000:3.0:1786562516.464688:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17163 00000100:00100000:0.0:1786562516.469852:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652614144 00000100:00100000:0.0:1786562516.469866:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652614144 00000100:00100000:0.0:1786562516.469962:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16960 00000100:00100000:0.0:1786562516.469974:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63872:x1873345652614144:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562516.470199:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562516.470232:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf57 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.470316:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf57 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.470334:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf57 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562516.470360:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562516.470364:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562516.470369:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92d600, rc 0) 00000100:00100000:0.0:1786562516.470454:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63872:x1873345652614144:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 482us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562516.470462:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16960 00000100:00100000:0.0:1786562516.474267:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.479073:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.479112:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.479130:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.479149:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562516.479216:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562516.481731:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562516.709190:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562517.520777:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.520825:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.520867:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.520897:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.520915:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.520937:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562517.521168:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652615296 00000100:00100000:0.0:1786562517.521194:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652615296 00000100:00100000:0.0:1786562517.521266:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652615552 00000100:00100000:0.0:1786562517.521271:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652615552 00000100:00100000:0.0:1786562517.521289:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652615680 00000100:00100000:0.0:1786562517.521291:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652615680 00000100:00100000:0.0:1786562517.521304:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652615808 00000100:00100000:0.0:1786562517.521306:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652615808 00000100:00100000:0.0:1786562517.521326:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17174 00000100:00100000:0.0:1786562517.521342:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652615296:12345-192.168.204.29@tcp:23:mirror_io.0 00000100:00100000:0.0:1786562517.521504:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652615296:12345-192.168.204.29@tcp:23:mirror_io.0 Request processed in 168us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562517.523843:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17174 00000100:00100000:0.0:1786562517.529681:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.529911:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652616064 00000100:00100000:3.0:1786562517.529924:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652616064 00000100:00100000:3.0:1786562517.529993:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17180 00000100:00100000:3.0:1786562517.530043:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652616064:12345-192.168.204.29@tcp:23:mirror_io.0 00000100:00100000:3.0:1786562517.530225:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652616064:12345-192.168.204.29@tcp:23:mirror_io.0 Request processed in 184us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562517.530234:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17180 00000100:00100000:3.0:1786562517.545360:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652616192 00000100:00100000:3.0:1786562517.545373:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652616192 00000100:00100000:3.0:1786562517.545443:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652616448 00000100:00100000:3.0:1786562517.545446:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652616448 00000100:00100000:3.0:1786562517.545467:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652616704 00000100:00100000:3.0:1786562517.545470:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652616704 00000100:00100000:3.0:1786562517.545495:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17181 00000100:00100000:3.0:1786562517.545507:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652616192:12345-192.168.204.29@tcp:23:mirror_io.0 00000100:00100000:3.0:1786562517.545686:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652616192:12345-192.168.204.29@tcp:23:mirror_io.0 Request processed in 181us (7290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562517.545695:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17181 00000100:00100000:3.0:1786562517.545718:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17182 00000100:00100000:3.0:1786562517.545724:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652616448:12345-192.168.204.29@tcp:23:mirror_io.0 00000100:00100000:3.0:1786562517.545978:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652616448:12345-192.168.204.29@tcp:23:mirror_io.0 Request processed in 253us (7511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562517.545986:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17182 00000100:00100000:3.0:1786562517.565672:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652616832 00000100:00100000:3.0:1786562517.565683:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652616832 00000100:00100000:3.0:1786562517.565757:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652616960 00000100:00100000:3.0:1786562517.565762:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652616960 00000100:00100000:3.0:1786562517.565882:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11202 00000100:00100000:3.0:1786562517.565894:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652616832:12345-192.168.204.29@tcp:3:mirror_io.0 00010000:00010000:3.0:1786562517.565931:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.565946:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562517.565952:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562517.565960:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.565975:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.566787:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11205 00000100:00100000:0.0:1786562517.566801:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652617216:12345-192.168.204.29@tcp:3:mirror_io.0 00010000:00010000:0.0:1786562517.566824:0:29458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.566836:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562517.566841:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562517.566845:0:29458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.566858:0:29458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.566956:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11206 00000100:00100000:3.0:1786562517.566970:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652617344:12345-192.168.204.29@tcp:3:mirror_io.0 00010000:00010000:3.0:1786562517.566991:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.567002:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562517.567025:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562517.567029:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.567037:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.582681:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652617600 00000100:00100000:0.0:1786562517.582682:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652617728 00000100:00100000:3.0:1786562517.582696:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652617600 00000100:00100000:0.0:1786562517.582696:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652617728 00000100:00100000:3.0:1786562517.582789:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11209 00000100:00100000:0.0:1786562517.582797:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11210 00000100:00100000:3.0:1786562517.582803:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:2349:x1873345652617600:12345-192.168.204.29@tcp:3:mirror_io.0 00000100:00100000:0.0:1786562517.582812:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652617728:12345-192.168.204.29@tcp:3:mirror_io.0 00010000:00010000:3.0:1786562517.582833:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.582866:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562517.582875:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562517.582887:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.582890:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689d875 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.582915:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562517.582917:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.582922:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562517.583166:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689d875 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.583179:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689d875 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592069:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592092:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592103:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592112:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a0548c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562517.592117:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592127:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592147:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.592156:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689d83d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.592236:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:2349:x1873345652616832:12345-192.168.204.29@tcp:3:mirror_io.0 Request processed in 26338us (26705us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562517.592249:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11202 00010000:00010000:3.0:1786562517.622513:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.622541:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.622552:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.622561:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a0548e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562517.622567:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.622577:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.622597:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.622605:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689d859 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.622723:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652617344:12345-192.168.204.29@tcp:3:mirror_io.0 Request processed in 55744us (57035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562517.622734:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11206 00010000:00010000:3.0:1786562517.629081:0:29458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.629103:0:29458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.629112:0:29458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.629120:0:29458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bf92c600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562517.629126:0:29458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.629139:0:29458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.629159:0:29458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.629167:0:29458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689d852 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.629252:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652617216:12345-192.168.204.29@tcp:3:mirror_io.0 Request processed in 62451us (63617us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562517.629263:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11205 00010000:00010000:3.0:1786562517.638928:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.638997:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.639045:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.639053:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562517.639059:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.639073:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.639094:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.639103:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689d867 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.639201:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652617472:12345-192.168.204.29@tcp:3:mirror_io.0 Request processed in 56410us (58056us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562517.639211:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11208 00010000:00010000:3.0:1786562517.648232:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.648253:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.648263:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.648269:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf64800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562517.648274:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.648288:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.648309:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.648317:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689d86e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.648668:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652617600:12345-192.168.204.29@tcp:3:mirror_io.0 Request processed in 65854us (67566us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562517.648679:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11209 00000100:00100000:3.0:1786562517.672732:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652617984 00000100:00100000:3.0:1786562517.672744:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652617984 00000100:00100000:3.0:1786562517.672836:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11211 00000100:00100000:3.0:1786562517.672849:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652617984:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562517.672903:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.672929:0:29460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.672940:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72d:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562517.672945:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562517.672950:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.673091:0:29460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.673109:0:29460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 13 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.673129:0:29460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:29460:1873345654785280:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562517.673772:0:29460:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562517.677523:0:29460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:29460:1873345654785280:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562517.677560:0:29460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.677678:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652618240 00000100:00100000:0.0:1786562517.677686:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652618240 00010000:00010000:0.0:1786562517.677735:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 15 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.677779:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8374 00000100:00100000:0.0:1786562517.677793:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652618240:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562517.677812:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562517.677843:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 15 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.677859:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 15 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.677889:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689c95d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb793 expref: 15 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.677911:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.677916:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.677923:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.677940:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.677952:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.677955:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.677959:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.677967:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.678081:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562517.678162:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652618240:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 370us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562517.678173:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8374 00010000:00010000:3.0:1786562517.678498:0:29460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.678509:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689d87c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562517.732080:0:29463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562505 -> 1786562516 00010000:00010000:0.0:1786562517.732112:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.732131:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.732143:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.732153:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88c646e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562517.732162:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.732174:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.732204:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.732213:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e46192e/0x5c655bf66689d883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.732352:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652618112:12345-192.168.204.29@tcp:4:mirror_io.0 Request processed in 57002us (57237us total) trans 21474843460 rc 0/0 00000100:00100000:0.0:1786562517.732367:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11212 00000001:00080000:3.0:1786562517.732697:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843461 is committed 00000100:00100000:3.0:1786562517.750223:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652618368 00000100:00100000:3.0:1786562517.750234:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652618368 00000100:00100000:3.0:1786562517.750312:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652618496 00000100:00100000:3.0:1786562517.750315:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652618496 00000100:00100000:3.0:1786562517.750346:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11213 00000100:00100000:3.0:1786562517.750356:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652618368:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562517.750394:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d88a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.750415:0:29459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689c964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb79a expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.750425:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x731:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562517.750429:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562517.750434:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d88a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.750475:0:29459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689c964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb79a expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.750493:0:29459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689c964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb79a expref: 12 pid: 6659 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.750516:0:29459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:29459:1873345654785408:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562517.750603:0:29459:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562517.755455:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.756236:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652618624 00000100:00100000:3.0:1786562517.756244:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652618624 00000100:00100000:3.0:1786562517.756421:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11215 00000100:00100000:3.0:1786562517.756431:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652618624:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562517.756464:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.756484:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x731:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562517.756489:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562517.756494:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.756503:0:29461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.759732:0:29461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.759743:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.760521:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652618752 00000100:00100000:0.0:1786562517.760528:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652618752 00000100:00100000:0.0:1786562517.760640:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11216 00000100:00100000:0.0:1786562517.760662:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652618752:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:0.0:1786562517.760693:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689d89f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.760710:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562517.760715:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.760720:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689d89f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.760735:0:6665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689d89f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.762685:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652619008 00000100:00100000:0.0:1786562517.762695:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652619008 00010000:00010000:0.0:1786562517.762730:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689c96b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a1 expref: 15 pid: 8368 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.762804:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8376 00000100:00100000:0.0:1786562517.762814:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652619008:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562517.762828:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562517.762862:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689c96b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a1 expref: 15 pid: 8368 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.762878:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689c96b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a1 expref: 15 pid: 8368 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.762901:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689c96b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a1 expref: 15 pid: 8368 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.762918:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.762922:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.762929:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008abc1449/0x5c655bf66689d891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.762944:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008abc1449/0x5c655bf66689d891 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.762952:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.762956:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562517.762959:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689d89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.762967:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689d89f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562517.763232:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562517.763353:0:6663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008abc1449/0x5c655bf66689d891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.763364:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008abc1449/0x5c655bf66689d891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562517.763447:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652619008:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 634us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562517.763456:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8376 00000001:00080000:0.0:1786562517.841579:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843462 is committed 00002000:00010000:3.0:1786562517.842572:0:29461:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562505 -> 1786562517 00002000:00010000:3.0:1786562517.842578:0:29461:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562505 -> 1786562517 00010000:00010000:3.0:1786562517.842594:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.842608:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.842618:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.842626:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562517.842630:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.842638:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.842669:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.842678:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689d898 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.842784:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652618624:12345-192.168.204.29@tcp:4:mirror_io.0 Request processed in 86348us (87332us total) trans 21474843462 rc 0/0 00000100:00100000:3.0:1786562517.842795:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11215 00000001:00080000:3.0:1786562517.855295:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875919 is committed 00000001:00080000:3.0:1786562517.893126:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875920 is committed 00000001:00080000:3.0:1786562517.901867:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843463 is committed 00000100:00100000:0.0:1786562517.917867:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562517.918434:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652619136 00000100:00100000:3.0:1786562517.918444:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652619136 00000100:00100000:3.0:1786562517.918528:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11217 00000100:00100000:3.0:1786562517.918539:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652619136:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562517.918576:0:29458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689d8a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.918596:0:29458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000155e8363/0x5c655bf66689c972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a8 expref: 11 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.918605:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x732:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562517.918610:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562517.918614:0:29458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689d8a6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.918660:0:29458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000155e8363/0x5c655bf66689c972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a8 expref: 11 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.918675:0:29458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000155e8363/0x5c655bf66689c972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7a8 expref: 11 pid: 29967 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.919741:0:29458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:29458:1873345654785664:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562517.925736:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652619264 00000100:00100000:3.0:1786562517.925746:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652619264 00000100:00100000:3.0:1786562517.925816:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11218 00000100:00100000:3.0:1786562517.925827:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652619264:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562517.925869:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca79cb9/0x5c655bf66689d8ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.925889:0:16006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689c979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7af expref: 12 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.925898:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x716:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562517.925903:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562517.925908:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca79cb9/0x5c655bf66689d8ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.925945:0:16006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689c979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7af expref: 12 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.925958:0:16006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689c979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7af expref: 12 pid: 29662 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.925973:0:16006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:16006:1873345654785792:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562517.926066:0:16006:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce900 going to sleep for 11 seconds 00010000:00010000:3.0:1786562517.931033:0:29458:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689d8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562517.931046:0:29458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689d8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562517.932288:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000001:00080000:3.0:1786562517.989193:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843464 is committed 00000001:00080000:3.0:1786562517.998590:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875921 is committed 00000100:00100000:3.0:1786562518.014719:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:0.0:1786562518.016668:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562518.018071:0:16007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:16007:1873345654785920:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562518.018107:0:16007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.019132:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562518.022108:0:16007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.022126:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562518.111978:0:16007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5185536 00000001:00080000:3.0:1786562518.111980:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843465 is committed 00002000:00010000:0.0:1786562518.111988:0:16007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562506 -> 1786562517 00002000:00010000:0.0:1786562518.111992:0:16007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562506 -> 1786562517 00010000:00010000:0.0:1786562518.112102:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.112116:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.112126:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.112135:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562518.112141:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.112162:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.112184:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.112193:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689d8b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.127459:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652619904 00000100:00100000:3.0:1786562518.127469:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652619904 00000100:00100000:3.0:1786562518.127557:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652620032 00000100:00100000:3.0:1786562518.127560:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652620032 00000100:00100000:3.0:1786562518.127589:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11220 00000100:00100000:3.0:1786562518.127600:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652619904:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562518.127640:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689d8bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.127679:0:29462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001920fd48/0x5c655bf66689ca44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb81f expref: 22 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.127689:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=11s v=(1 0) 00010000:00010000:3.0:1786562518.127694:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562518.127699:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689d8bb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.127736:0:29462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001920fd48/0x5c655bf66689ca44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb81f expref: 22 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.127763:0:29462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001920fd48/0x5c655bf66689ca44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb81f expref: 22 pid: 28861 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.127779:0:29462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf07480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0001_UUID:29462:1873345654786048:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562518.127858:0:29462:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88202ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562518.127880:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11221 00000100:00100000:3.0:1786562518.127888:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652620032:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:3.0:1786562518.127904:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689d8c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.127913:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562518.127917:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562518.127920:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689d8c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.127929:0:13965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689d8c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.131659:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.131712:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.132184:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652620160 00000100:00100000:0.0:1786562518.132198:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652620160 00000100:00100000:0.0:1786562518.132281:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652620288 00000100:00100000:0.0:1786562518.132285:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652620288 00000100:00100000:0.0:1786562518.132336:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11222 00000100:00100000:0.0:1786562518.132348:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652620160:12345-192.168.204.29@tcp:4:mirror_io.0 00010000:00010000:0.0:1786562518.132401:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.132427:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562518.132433:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562518.132438:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.132450:0:16005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.136636:0:29462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf07480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0001_UUID:29462:1873345654786048:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562518.136690:0:29462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689d8bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562518.136938:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:0.0:1786562518.138097:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786562518.216050:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875922 is committed 00000100:00100000:3.0:1786562518.309369:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654786432:0@lo:400:kworker.0 00000001:00080000:0.0:1786562518.309901:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875923 is committed 00000001:00080000:0.0:1786562518.309933:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875925 is committed 00010000:00010000:0.0:1786562518.312586:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.312613:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.312626:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.312635:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26fe00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562518.312654:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.312665:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.312694:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.312703:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689d8c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.317492:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.317571:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654786944:0@lo:400:kworker.0 00000100:00100000:3.0:1786562518.317619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.318509:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786562518.318518:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654786432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562518.318557:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654786432:12345-0@lo:400:kworker.0 Request processed in 41us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.318568:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786562518.318585:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1786562518.318591:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654786944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562518.318620:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654786944:12345-0@lo:400:kworker.0 Request processed in 29us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.318626:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1786562518.318663:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654786432:0@lo:400:kworker.0 00000100:00100000:3.0:1786562518.318675:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654786944:0@lo:400:kworker.0 00000100:00100000:3.0:1786562518.322074:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654786816:0@lo:400:kworker.0 00000100:00100000:3.0:1786562518.322268:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654786176 00000100:00100000:3.0:1786562518.322272:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654786176 00000100:00100000:3.0:1786562518.322316:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1786562518.322321:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654786176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562518.322342:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 569180160 pending 0 free 3828350976 avail 3819962368 00000100:00100000:3.0:1786562518.322383:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654786176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.322389:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1786562518.322410:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1786562518.323461:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:0.0:1786562518.323933:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652620160:12345-192.168.204.29@tcp:4:mirror_io.0 Request processed in 191578us (192303us total) trans 17179875925 rc 0/0 00000100:00100000:0.0:1786562518.323946:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11222 00000100:00100000:0.0:1786562518.363175:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.373200:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.373375:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.376971:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652620928 00000100:00100000:3.0:1786562518.376992:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652620928 00010000:00010000:3.0:1786562518.377164:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689c9a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7cb expref: 13 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.377224:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8381 00000100:00100000:3.0:1786562518.377238:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652620928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562518.377763:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562518.377798:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689c9a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7cb expref: 13 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.377816:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689c9a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7cb expref: 13 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.377987:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689c9a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7cb expref: 13 pid: 37002 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.378035:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562518.378041:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562518.378049:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.378060:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.378071:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562518.378074:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562518.378078:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.378087:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.378332:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562518.378417:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652620928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1177us (5229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.378428:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8381 00000100:00100000:3.0:1786562518.384207:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.384332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000001:00080000:0.0:1786562518.472423:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875926 is committed 00002000:00010000:3.0:1786562518.472563:0:29459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562506 -> 1786562517 00002000:00010000:3.0:1786562518.472569:0:29459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 0 -> 1786562517 00010000:00010000:3.0:1786562518.472589:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.472605:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.472615:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.472624:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88c646a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562518.472630:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.472651:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.472678:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.472687:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090a003f6/0x5c655bf66689d8de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.472822:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+22:2348:x1873345652620672:12345-192.168.204.29@tcp:4:mirror_io.0 Request processed in 98958us (99439us total) trans 17179875926 rc 0/0 00000100:00100000:3.0:1786562518.472848:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11225 00010000:00010000:3.0:1786562518.519340:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519371:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519382:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519391:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562518.519397:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519407:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519433:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519447:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689d8d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.519581:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c7a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652620544:12345-192.168.204.29@tcp:4:mirror_io.0 Request processed in 156067us (156415us total) trans 17179875928 rc 0/0 00000100:00100000:3.0:1786562518.519595:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11224 00010000:00010000:3.0:1786562518.519670:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519680:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519688:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519695:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88c646c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562518.519698:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519704:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519716:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.519729:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0dcb356/0x5c655bf66689d8ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.519766:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652621056:12345-192.168.204.29@tcp:4:mirror_io.0 Request processed in 134844us (135434us total) trans 17179875929 rc 0/0 00000100:00100000:3.0:1786562518.519772:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11227 00000100:00100000:0.0:1786562518.533496:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.540887:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.541075:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652621312 00000100:00100000:3.0:1786562518.541090:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652621312 00010000:00010000:3.0:1786562518.541162:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689c9aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7d2 expref: 11 pid: 6659 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.541220:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8382 00000100:00100000:3.0:1786562518.541233:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652621312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562518.541255:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562518.541286:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689c9aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7d2 expref: 11 pid: 6659 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.541302:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689c9aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7d2 expref: 11 pid: 6659 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.541335:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689c9aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfb7d2 expref: 11 pid: 6659 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.541357:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562518.541363:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562518.541370:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5ad4024/0x5c655bf66689d8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.541381:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ad4024/0x5c655bf66689d8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.541424:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562518.541506:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652621312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 275us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.541515:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8382 00000001:00080000:3.0:1786562518.640499:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875930 is committed 00000100:00100000:0.0:1786562518.666082:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:3.0:1786562518.667684:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562518.670996:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.687906:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.688234:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652621824 00000100:00100000:3.0:1786562518.688311:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652621824 00000100:00100000:3.0:1786562518.688394:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17187 00000100:00100000:3.0:1786562518.688407:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63872:x1873345652621824:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562518.688433:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562518.688528:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf96 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562518.688568:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7d5, atime: 0x0, ctime: 0x6a7cc7d5, blocks: 0x1007 00010000:00010000:3.0:1786562518.688599:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=951s v=(0 0) 00010000:00010000:3.0:1786562518.688605:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562518.688616:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf96 expref: 11 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.688652:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf96 expref: 11 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.688668:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068de00, rc 0) 00000100:00100000:3.0:1786562518.688817:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63872:x1873345652621824:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 411us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.688826:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17187 00000100:00100000:0.0:1786562518.693812:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.700576:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17188 00000100:00100000:0.0:1786562518.700589:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63872:x1873345652621952:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562518.700612:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562518.700649:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbf9d expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562518.700685:0:28862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7d5, atime: 0x0, ctime: 0x6a7cc7d5, blocks: 0x1007 00010000:00010000:0.0:1786562518.700713:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=951s v=(0 0) 00010000:00010000:0.0:1786562518.700719:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562518.700729:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.700747:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.700763:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e000, rc 0) 00000100:00100000:0.0:1786562518.700852:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63872:x1873345652621952:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 265us (7056us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562518.700860:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17188 00000100:00100000:0.0:1786562518.706542:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.723672:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.728616:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652622208 00000100:00100000:0.0:1786562518.728647:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652622208 00000100:00100000:0.0:1786562518.728740:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17190 00000100:00100000:0.0:1786562518.728752:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63872:x1873345652622208:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562518.728778:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562518.728870:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689d91d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbfab expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562518.728914:0:8368:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x716:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7d5, atime: 0x0, ctime: 0x6a7cc7d5, blocks: 0x807 00010000:00010000:0.0:1786562518.728954:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=951s v=(0 0) 00010000:00010000:0.0:1786562518.728960:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562518.728971:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689d91d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfab expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.728990:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689d91d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfab expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562518.729025:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f000, rc 0) 00000100:00100000:0.0:1786562518.729114:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63872:x1873345652622208:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 364us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562518.729122:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17190 00000100:00100000:3.0:1786562518.739200:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.756770:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.756840:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.756881:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652622464 00000100:00100000:3.0:1786562518.756894:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652622464 00002000:00010000:3.0:1786562518.756966:0:6664:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1843 (5182624->18446744073709551615) 00002000:00100000:3.0:1786562518.756972:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887edf80 with x1873345652622464 ext(5182624->18446744073709551615) 00002000:00010000:3.0:1786562518.756987:0:6664:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887edf80. 00000100:00100000:3.0:1786562518.757054:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652622592 00000100:00100000:3.0:1786562518.757058:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652622592 00002000:00010000:3.0:1786562518.757073:0:6664:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1815 (4194304->18446744073709551615) 00002000:00100000:3.0:1786562518.757076:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ed500 with x1873345652622592 ext(4194304->18446744073709551615) 00002000:00010000:3.0:1786562518.757084:0:6664:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887ed500. 00000100:00100000:3.0:1786562518.757104:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11229 00000100:00100000:3.0:1786562518.757114:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652622464:12345-192.168.204.29@tcp:10:mirror_io.0 00000100:00100000:0.0:1786562518.757516:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11230 00000100:00100000:0.0:1786562518.757528:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652622592:12345-192.168.204.29@tcp:10:mirror_io.0 00002000:00010000:0.0:1786562518.757898:0:29460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562518.757902:0:29460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562506 -> 1786562517 00002000:00010000:0.0:1786562518.757905:0:29460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562518.757907:0:29460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562506 -> 1786562517 00002000:00010000:0.0:1786562518.757910:0:29460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562518.757993:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652622592:12345-192.168.204.29@tcp:10:mirror_io.0 Request processed in 468us (1161us total) trans 17179875931 rc 0/0 00000100:00100000:0.0:1786562518.758001:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11230 00002000:00010000:0.0:1786562518.758025:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1815 (4194304->18446744073709551615) 00002000:00100000:0.0:1786562518.758028:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ed500 with x1873345652622592 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1786562518.758034:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887ed500. 00002000:00010000:3.0:1786562518.762687:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5185536 -> 5182624 00002000:00010000:3.0:1786562518.762700:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562518.762703:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562518.762706:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562518.762708:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562518.762808:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652622464:12345-192.168.204.29@tcp:10:mirror_io.0 Request processed in 5687us (6045us total) trans 21474843466 rc 0/0 00000100:00100000:3.0:1786562518.762822:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11229 00002000:00010000:3.0:1786562518.762841:0:6664:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1843 (5182624->18446744073709551615) 00002000:00100000:3.0:1786562518.762846:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887edf80 with x1873345652622464 ext(5182624->18446744073709551615) 00002000:00010000:3.0:1786562518.762855:0:6664:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887edf80. 00000100:00100000:0.0:1786562518.784796:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.803402:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.803550:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652622976 00000100:00100000:3.0:1786562518.803563:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652622976 00000100:00100000:3.0:1786562518.803657:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16964 00000100:00100000:3.0:1786562518.803671:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63872:x1873345652622976:12345-192.168.204.29@tcp:36:mirror_io.0 00010000:00010000:3.0:1786562518.803748:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562518.803787:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689d932 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfb9 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.803815:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:3.0:1786562518.803822:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562518.804189:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689d939 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.804206:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689d939 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.804217:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689d939 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562518.804284:0:33114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950487 00000004:00010000:3.0:1786562518.804312:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051f9a1dd reply state 000000003cf70efa transno 8589950488 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689d939 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.804322:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562518.804427:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:63872:x1873345652622976:12345-192.168.204.29@tcp:36:mirror_io.0 Request processed in 758us (1041us total) trans 8589950488 rc 0/0 00000100:00100000:3.0:1786562518.804435:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16964 00000020:00080000:3.0:1786562518.804441:0:33114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786562518.808309:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.827953:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.828185:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652623232 00000100:00100000:3.0:1786562518.828659:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652623232 00000100:00100000:0.0:1786562518.832406:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.836145:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.836256:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.840289:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.848316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.848407:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652624000 00000100:00100000:3.0:1786562518.848417:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652624000 00010000:00010000:3.0:1786562518.848465:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf57 expref: 13 pid: 35929 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562518.848563:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8383 00000100:00100000:3.0:1786562518.848575:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652624000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562518.848595:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562518.848604:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf57 expref: 13 pid: 35929 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.848617:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf57 expref: 13 pid: 35929 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.848663:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689d7fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf57 expref: 13 pid: 35929 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.848689:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:3.0:1786562518.848695:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689d955 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.848706:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689d955 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.848714:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689d955 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.848745:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562518.848822:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652624000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.848839:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8383 00000040:00080000:0.0:1786562518.850892:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4315, 88 off349960 00000004:00080000:0.0:1786562518.850915:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951292908647ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851026:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4299, 88 off348376 00000004:00080000:0.0:1786562518.851034:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293028533ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851064:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4300, 88 off348464 00000004:00080000:0.0:1786562518.851069:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293063070ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851084:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4316, 88 off350048 00000004:00080000:0.0:1786562518.851088:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293082517ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851103:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4317, 88 off350136 00000004:00080000:0.0:1786562518.851107:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293101089ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851121:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4301, 88 off348552 00000004:00080000:0.0:1786562518.851126:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293120607ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851152:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4302, 88 off348640 00000004:00080000:0.0:1786562518.851158:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293152148ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851172:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4303, 88 off348728 00000004:00080000:0.0:1786562518.851176:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293170222ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851191:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4318, 88 off350224 00000004:00080000:0.0:1786562518.851196:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293189619ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851225:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4304, 88 off348816 00000004:00080000:0.0:1786562518.851230:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293223880ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851260:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4319, 88 off350312 00000004:00080000:0.0:1786562518.851265:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293258598ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851286:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4305, 88 off348904 00000004:00080000:0.0:1786562518.851291:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293285093ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562518.851307:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4320, 88 off350400 00000004:00080000:0.0:1786562518.851311:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293305620ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851333:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4321, 88 off350488 00000004:00080000:0.0:1786562518.851337:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293331314ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851358:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4322, 88 off350576 00000004:00080000:0.0:1786562518.851362:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293356439ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851382:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4323, 88 off350664 00000004:00080000:0.0:1786562518.851386:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951293380718ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562518.851407:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4306, 88 off348992 00000004:00080000:0.0:1786562518.851411:0:33117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951293405604ns, next at 911624464511ns, rc = 0 00000001:00080000:3.0:1786562518.923599:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950489 is committed 00000004:00080000:3.0:1786562518.923619:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2815 committed 00000004:00080000:3.0:1786562518.923652:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2834 committed 00000004:00080000:3.0:1786562518.923667:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2833 committed 00000004:00080000:3.0:1786562518.923670:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2832 committed 00000004:00080000:3.0:1786562518.923681:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2831 committed 00000004:00080000:3.0:1786562518.923684:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2814 committed 00000004:00080000:3.0:1786562518.923687:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2830 committed 00000004:00080000:3.0:1786562518.923689:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2813 committed 00000004:00080000:3.0:1786562518.923691:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2829 committed 00000004:00080000:3.0:1786562518.923693:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2812 committed 00000004:00080000:3.0:1786562518.923695:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2811 committed 00000004:00080000:3.0:1786562518.923697:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2810 committed 00000004:00080000:3.0:1786562518.923699:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2828 committed 00000004:00080000:3.0:1786562518.923702:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2827 committed 00000004:00080000:3.0:1786562518.923705:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2809 committed 00000004:00080000:3.0:1786562518.923708:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2808 committed 00000004:00080000:3.0:1786562518.923710:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2826 committed 00000100:00100000:3.0:1786562518.924000:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654787712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924328:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924379:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654788224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924405:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924438:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786562518.924445:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654787584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924469:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924489:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654788096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924511:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924546:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654787840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924568:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924584:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654788352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924604:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924623:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786562518.924642:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654787968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924664:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924695:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654788480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562518.924715:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.924753:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654787712 00000100:00100000:3.0:1786562518.924762:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654787712 00000100:00100000:3.0:1786562518.924811:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654788224 00000100:00100000:3.0:1786562518.924815:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654788224 00000100:00100000:3.0:1786562518.925076:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654787584 00000100:00100000:3.0:1786562518.925080:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654787584 00000100:00100000:3.0:1786562518.925147:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17195 00000100:00100000:3.0:1786562518.925163:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654787712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562518.925562:0:28862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562518.925568:0:28862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562515 -> 1786562515 00002000:00010000:3.0:1786562518.925570:0:28862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:3.0:1786562518.925573:0:28862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562515 -> 1786562515 00002000:00010000:3.0:1786562518.925575:0:28862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1786562518.925659:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3292:x1873345654787712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 499us (1332us total) trans 17179875933 rc 0/0 00000100:00100000:3.0:1786562518.925668:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17195 00000004:00010000:0.0:1786562518.925814:0:33117:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b41d7de reply state 0000000085c4cdcc transno 8589950489 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689d955 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562518.925840:0:33117:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562518.925853:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db300) 00010000:00010000:0.0:1786562518.925856:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562518.925867:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689d7b8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf49 expref: 7 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1786562518.925997:0:33117:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1786562518.926044:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63872:x1873345652623872:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 85487us (85770us total) trans 8589950489 rc 0/0 00000100:00100000:0.0:1786562518.926054:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6196 00000100:00100000:3.0:1786562518.926752:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654787840 00000100:00100000:3.0:1786562518.926757:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654787840 00000100:00100000:0.0:1786562518.930137:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654788352 00000100:00100000:0.0:1786562518.930160:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654788352 00000004:00080000:3.0:1786562518.935541:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9887eea00/2, rc 0, transno 17179875935 00000100:00100000:3.0:1786562518.935550:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654787584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562518.935562:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c799f80/2, rc 0, transno 17179875936 00000100:00100000:3.0:1786562518.935565:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654788096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562518.935572:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9887eca80/2, rc 0, transno 17179875933 00000100:00100000:3.0:1786562518.935575:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654787712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562518.935582:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c79aa00/2, rc 0, transno 17179875934 00000100:00100000:3.0:1786562518.935585:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654788224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562518.936040:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9887ec380/2, rc 0, transno 17179875940 00000100:00100000:3.0:1786562518.936047:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654787840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562518.936463:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17203 00000100:00100000:0.0:1786562518.936483:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654788352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562518.938175:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562518.938187:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562518.938190:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562518.938192:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562518.938195:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562518.938285:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3289:x1873345654788352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1806us (13675us total) trans 17179875941 rc 0/0 00000100:00100000:0.0:1786562518.938298:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17203 00000100:00100000:3.0:1786562518.938995:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654788992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562518.939085:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.939128:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654789504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562518.939148:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.939175:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786562518.939180:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654788864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562518.939200:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562518.939219:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654789376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562518.939241:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786562518.939300:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c79b480/2, rc 0, transno 17179875941 00000100:00100000:3.0:1786562518.939307:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654788352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562518.940924:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17205 00000100:00100000:0.0:1786562518.940951:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654789504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562518.941234:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562518.941238:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562518.941241:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562518.941243:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562518.941247:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:0.0:1786562518.941341:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3290:x1873345654789504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 401us (2189us total) trans 21474843468 rc 0/0 00000100:00100000:0.0:1786562518.941349:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17205 00000100:00100000:0.0:1786562518.941378:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17206 00000100:00100000:0.0:1786562518.941386:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654788864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562518.941558:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562518.941562:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562518.941564:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562518.941566:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562518.941568:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562518.941598:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3290:x1873345654788864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (2395us total) trans 21474843469 rc 0/0 00000100:00100000:0.0:1786562518.941604:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17206 00000100:00100000:0.0:1786562518.941618:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17207 00000100:00100000:0.0:1786562518.941639:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654789376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562518.942933:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652624128 00000100:00100000:3.0:1786562518.942940:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652624128 00000100:00100000:3.0:1786562518.942988:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16965 00000100:00100000:3.0:1786562518.942996:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:63872:x1873345652624128:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562518.943032:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562518.943062:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689d95c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbfd5 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.943129:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689d95c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfd5 expref: 7 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.943148:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689d95c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfd5 expref: 7 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.943170:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562518.943175:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562518.943179:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068da00, rc 0) 00000100:00100000:3.0:1786562518.943242:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63872:x1873345652624128:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 247us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562518.943251:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16965 00000100:00100000:3.0:1786562518.943294:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17211 00000100:00100000:3.0:1786562518.943302:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654789632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562518.943435:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562518.943439:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562518.943441:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562518.943443:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562518.943445:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1786562518.943489:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654789632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (1432us total) trans 21474843472 rc 0/0 00000100:00100000:3.0:1786562518.943496:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17211 00000004:00080000:3.0:1786562518.943550:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88313fb80/2, rc 0, transno 21474843469 00000100:00100000:3.0:1786562518.943558:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654788864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562518.943573:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88313ca80/2, rc 0, transno 21474843468 00000100:00100000:3.0:1786562518.943576:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654789504:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562518.946396:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562518.946401:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562518.946403:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562518.946406:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562518.946408:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562518.946459:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654789376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4834us (7216us total) trans 21474843475 rc 0/0 00000100:00100000:0.0:1786562518.946467:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17207 00000100:00100000:0.0:1786562518.952664:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562518.984372:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:3.0:1786562518.984732:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562518.996757:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562518.998120:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652624896 00000100:00100000:3.0:1786562518.998140:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652624896 00000100:00100000:3.0:1786562518.998333:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16967 00000100:00100000:3.0:1786562518.998347:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63884:x1873345652624896:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562518.998384:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562518.998416:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689d986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbfe3 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.998523:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.998543:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.998557:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.998576:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.998583:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.998590:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999156:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999167:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999175:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562518.999187:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:3.0:1786562518.999310:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999318:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999325:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999332:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a98a7000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562518.999338:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999347:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999362:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562518.999366:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562518.999372:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999378:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7000/0x5c655bf66689d98d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999393:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999399:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999405:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999409:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a98a6600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562518.999412:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999418:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999430:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46abd00) 00010000:00010000:3.0:1786562518.999432:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562518.999435:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999440:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6600/0x5c655bf66689d994 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999492:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689d986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfe3 expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999508:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfe3 expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562518.999515:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562518.999518:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562518.999521:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880400, rc 0) 00000100:00100000:3.0:1786562518.999617:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63884:x1873345652624896:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1273us (2883us total) trans 8589950492 rc 0/0 00000100:00100000:3.0:1786562518.999639:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16967 00000100:00100000:0.0:1786562519.001375:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.005419:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.008751:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652625280 00000100:00100000:3.0:1786562519.008775:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652625280 00000100:00100000:3.0:1786562519.008867:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17212 00000100:00100000:3.0:1786562519.008881:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:63885:x1873345652625280:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562519.008907:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1786562519.008921:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562519.008933:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbff1 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.008968:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562519.008984:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088750eeb/0x5c655bf66689d940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc0 expref: 15 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.008995:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562519.009001:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562519.009032:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562519.009040:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 23 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.009067:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562519.009089:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088750eeb/0x5c655bf66689d940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc0 expref: 15 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009104:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088750eeb/0x5c655bf66689d940 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc0 expref: 15 pid: 28861 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.009123:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654790016:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562519.009229:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562519.009251:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652625792 00000100:00100000:3.0:1786562519.009255:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652625792 00010000:00010000:3.0:1786562519.009284:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfe3 expref: 8 pid: 36756 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.009312:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652625920 00000100:00100000:3.0:1786562519.009315:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652625920 00010000:00010000:3.0:1786562519.009328:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647c00/0x5c655bf66689d978 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfdc expref: 505 pid: 33140 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.009351:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8384 00000100:00100000:3.0:1786562519.009359:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652625792:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562519.009372:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562519.009380:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfe3 expref: 8 pid: 36756 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009395:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689d99b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfe3 expref: 8 pid: 36756 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009420:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.009427:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009437:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009444:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562519.009474:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652625792:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 116us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.009482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8384 00000100:00100000:3.0:1786562519.009502:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8385 00000100:00100000:3.0:1786562519.009509:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+505:2350:x1873345652625920:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562519.009517:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562519.009522:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647c00/0x5c655bf66689d978 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfdc expref: 505 pid: 33140 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009537:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647c00/0x5c655bf66689d978 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfdc expref: 505 pid: 33140 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009551:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.009554:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009563:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009570:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009588:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562519.009607:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+505:2350:x1873345652625920:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 99us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.009614:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8385 00000100:00100000:3.0:1786562519.009648:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652625664 00000100:00100000:3.0:1786562519.009653:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652625664 00000100:00100000:3.0:1786562519.009677:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652625408 00000100:00100000:3.0:1786562519.009679:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652625408 00000100:00100000:3.0:1786562519.009695:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16969 00000100:00100000:3.0:1786562519.009702:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63882:x1873345652625664:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562519.009719:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.009733:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689d9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbfff expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009856:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009868:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.009877:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562519.009889:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:3.0:1786562519.010092:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689d9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfff expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010114:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfff expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010122:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.010125:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1786562519.010127:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880800, rc 0) 00000100:00100000:3.0:1786562519.010161:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63882:x1873345652625664:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 460us (1243us total) trans 8589950493 rc 0/0 00000100:00100000:3.0:1786562519.010168:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16969 00000100:00100000:3.0:1786562519.010183:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16970 00000100:00100000:3.0:1786562519.010189:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63884:x1873345652625408:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562519.010196:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.010205:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689d9d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfbff8 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010254:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010263:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010272:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfff expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010279:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 5/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010304:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfff expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.010315:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfff expref: 11 pid: 34450 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.010325:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654790144:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562519.010370:0:34450:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.010378:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562519.016431:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654790016:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562519.016484:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 23 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.016518:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881e00, rc 0) 00000100:00100000:3.0:1786562519.016590:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:63885:x1873345652625280:12345-192.168.204.29@tcp:101:cat.0 Request processed in 7712us (11185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.016606:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17212 00000100:00100000:0.0:1786562519.017209:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654790144:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562519.017230:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.028938:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.029065:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652626176 00000100:00100000:3.0:1786562519.029081:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652626176 00010000:00010000:3.0:1786562519.029139:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfea expref: 504 pid: 33115 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.029170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.029188:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652626304 00000100:00100000:3.0:1786562519.029193:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652626304 00010000:00010000:3.0:1786562519.029211:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689d9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfff expref: 11 pid: 34450 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.029251:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8387 00000100:00100000:3.0:1786562519.029264:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+504:2351:x1873345652626176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562519.029284:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562519.029292:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfea expref: 504 pid: 33115 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.029305:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfea expref: 504 pid: 33115 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.029337:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689d9b0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfea expref: 504 pid: 33115 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.029362:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.029368:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.029383:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.029389:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.029396:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562519.029427:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:2351:x1873345652626176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 164us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.029443:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8387 00000100:00100000:3.0:1786562519.029484:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8388 00000100:00100000:3.0:1786562519.030894:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652626304:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562519.032256:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.032268:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562519.032336:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:3.0:1786562519.032341:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562519.032369:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.032384:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.032422:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689d9d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff8 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.032448:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689d9da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff8 expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.032456:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.032460:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562519.032462:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881000, rc 0) 00000100:00100000:3.0:1786562519.032512:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63884:x1873345652625408:12345-192.168.204.29@tcp:101:cat.0 Request processed in 22321us (23444us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.032522:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16970 00000100:00100000:3.0:1786562519.038468:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652626432 00000100:00100000:3.0:1786562519.038480:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652626432 00000100:00100000:3.0:1786562519.038557:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16971 00000100:00100000:3.0:1786562519.038569:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+503:63885:x1873345652626432:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562519.038604:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.038645:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689d9e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc006 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.038742:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689d9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc006 expref: 504 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.038759:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689d9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc006 expref: 504 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.038786:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.038791:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562519.038797:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880a00, rc 0) 00000100:00100000:3.0:1786562519.038904:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+504:63885:x1873345652626432:12345-192.168.204.29@tcp:101:cat.0 Request processed in 337us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.038911:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16971 00000100:00100000:0.0:1786562519.045620:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.057432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:3.0:1786562519.058700:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562519.084553:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652626944 00000100:00100000:0.0:1786562519.084570:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652626944 00002000:00100000:0.0:1786562519.084681:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88bf06a00 x1873345652626944/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.084698:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf06a00 with x1873345652626944 ext(0->1048575) 00002000:00010000:0.0:1786562519.084707:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf06a00 00000100:00100000:0.0:1786562519.084753:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11233 00000100:00100000:0.0:1786562519.084768:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652626944:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562519.110683:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.200478:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.200549:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:3.0:1786562519.205035:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562519.214465:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:3.0:1786562519.228573:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1786562519.336485:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950491 is committed 00000001:00080000:3.0:1786562519.336505:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950490 is committed 00000001:00080000:3.0:1786562519.336511:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950495 is committed 00000004:00080000:3.0:1786562519.336516:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2823 committed 00000004:00080000:3.0:1786562519.336532:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2843 committed 00000004:00080000:3.0:1786562519.336541:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2842 committed 00000004:00080000:3.0:1786562519.336544:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2841 committed 00000004:00080000:3.0:1786562519.336546:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2840 committed 00000004:00080000:3.0:1786562519.336548:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2822 committed 00000004:00080000:3.0:1786562519.336550:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2839 committed 00000004:00080000:3.0:1786562519.336552:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2821 committed 00000004:00080000:3.0:1786562519.336554:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2838 committed 00000004:00080000:3.0:1786562519.336556:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2820 committed 00000004:00080000:3.0:1786562519.336558:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2819 committed 00000004:00080000:3.0:1786562519.336559:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2818 committed 00000004:00080000:3.0:1786562519.336561:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2837 committed 00000004:00080000:3.0:1786562519.336563:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2836 committed 00000004:00080000:3.0:1786562519.336566:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2817 committed 00000004:00080000:3.0:1786562519.336567:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2816 committed 00000004:00080000:3.0:1786562519.336569:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2835 committed 00000001:00080000:3.0:1786562519.336579:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950493 is committed 00000100:00100000:3.0:1786562519.336840:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654790784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.336947:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337001:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654791296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337053:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337080:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786562519.337087:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654791168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337108:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337124:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654791680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337146:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337176:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654790912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337199:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337219:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654791424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337239:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337259:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786562519.337264:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654791040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337284:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337301:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654791552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562519.337322:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562519.337356:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654790784 00000100:00100000:3.0:1786562519.337366:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654790784 00000100:00100000:3.0:1786562519.337420:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791296 00000100:00100000:0.0:1786562519.337708:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791168 00000100:00100000:0.0:1786562519.337715:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791168 00000100:00100000:0.0:1786562519.337742:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791680 00000100:00100000:0.0:1786562519.337744:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791680 00000100:00100000:0.0:1786562519.337761:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654790912 00000100:00100000:0.0:1786562519.337763:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654790912 00000100:00100000:0.0:1786562519.337776:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791424 00000100:00100000:0.0:1786562519.337778:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791424 00000100:00100000:0.0:1786562519.337790:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791040 00000100:00100000:0.0:1786562519.337791:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791040 00000100:00100000:0.0:1786562519.337803:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791552 00000100:00100000:0.0:1786562519.337805:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791552 00000100:00100000:0.0:1786562519.337829:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17217 00000100:00100000:0.0:1786562519.337839:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3292:x1873345654790784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562519.338141:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562519.338146:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562519.338149:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562519.338152:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562519.338155:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1786562519.338219:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3292:x1873345654790784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 380us (1272us total) trans 21474843476 rc 0/0 00000100:00100000:0.0:1786562519.338228:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17217 00000100:00100000:0.0:1786562519.338250:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17218 00000100:00100000:0.0:1786562519.338257:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3292:x1873345654791168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562519.338936:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562519.338940:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562516 -> 1786562516 00002000:00010000:0.0:1786562519.338943:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.338945:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.338947:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562519.339047:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791296 00000100:00100000:3.0:1786562519.339080:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654792192 00000100:00100000:3.0:1786562519.339082:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654792192 00000100:00100000:3.0:1786562519.339092:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654792704 00000100:00100000:3.0:1786562519.339094:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654792704 00000100:00100000:3.0:1786562519.339106:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17219 00000100:00100000:3.0:1786562519.339113:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1873345654791680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562519.339241:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562519.339244:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562519.339247:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562519.339249:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562519.339252:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562519.342505:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3292:x1873345654791168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4238us (5384us total) trans 21474843477 rc 0/0 00000100:00100000:0.0:1786562519.342525:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17218 00000100:00100000:0.0:1786562519.342571:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654791808 00000100:00100000:0.0:1786562519.342582:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654791808 00000100:00100000:0.0:1786562519.342638:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17220 00000100:00100000:0.0:1786562519.342650:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654790912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562519.342958:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562519.342963:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562519.342968:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562519.342975:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562519.342981:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562519.343069:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3289:x1873345654790912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 421us (5867us total) trans 21474843479 rc 0/0 00000100:00100000:0.0:1786562519.343077:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17220 00000100:00100000:0.0:1786562519.343092:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17221 00000100:00100000:0.0:1786562519.343100:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654791424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562519.343197:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562519.343200:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343203:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.343205:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343207:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562519.343239:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3289:x1873345654791424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 140us (5998us total) trans 21474843480 rc 0/0 00000100:00100000:0.0:1786562519.343246:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17221 00000100:00100000:0.0:1786562519.343261:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17222 00000100:00100000:0.0:1786562519.343270:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654791040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562519.343367:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562519.343372:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562519.343374:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562519.343376:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562519.343378:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562519.343412:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3289:x1873345654791040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (6126us total) trans 21474843481 rc 0/0 00000100:00100000:0.0:1786562519.343420:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17222 00000100:00100000:0.0:1786562519.343440:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17224 00000100:00100000:0.0:1786562519.343453:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3292:x1873345654791296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562519.343547:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562519.343551:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343553:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.343555:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343558:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562519.343586:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3292:x1873345654791296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (6533us total) trans 21474843482 rc 0/0 00000100:00100000:0.0:1786562519.343594:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17224 00000100:00100000:0.0:1786562519.343610:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17225 00000100:00100000:0.0:1786562519.343633:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3291:x1873345654792192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562519.343745:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562519.343749:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343752:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.343755:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343758:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562519.343794:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3291:x1873345654792192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (5059us total) trans 17179875942 rc 0/0 00000100:00100000:0.0:1786562519.343802:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17225 00000100:00100000:0.0:1786562519.343820:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17226 00000100:00100000:0.0:1786562519.343833:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3291:x1873345654792704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562519.343932:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1786562519.343937:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343939:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.343942:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.343945:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562519.343975:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3291:x1873345654792704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (5202us total) trans 17179875943 rc 0/0 00000100:00100000:0.0:1786562519.343983:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17226 00000100:00100000:3.0:1786562519.344290:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1873345654791680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5174us (7139us total) trans 21474843478 rc 0/0 00000100:00100000:3.0:1786562519.344302:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17219 00000004:00080000:3.0:1786562519.344373:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5e680/2, rc 0, transno 21474843477 00000100:00100000:3.0:1786562519.344517:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654791168:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562519.344536:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5fb80/2, rc 0, transno 21474843478 00000100:00100000:3.0:1786562519.344542:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654791680:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562519.344556:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bf8dc380/2, rc 0, transno 21474843476 00000100:00100000:3.0:1786562519.344563:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654790784:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562519.344574:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5ea00/2, rc 0, transno 21474843482 00000100:00100000:3.0:1786562519.344581:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654791296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562519.347704:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17230 00000100:00100000:0.0:1786562519.347715:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3291:x1873345654792320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562519.347963:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562519.347967:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.347970:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.347972:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.347975:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562519.348055:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3291:x1873345654792320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 343us (1320us total) trans 17179875946 rc 0/0 00000100:00100000:0.0:1786562519.348062:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17230 00000100:00100000:0.0:1786562519.348078:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17231 00000100:00100000:0.0:1786562519.348086:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3290:x1873345654791936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562519.348181:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562519.348185:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562519.348188:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562519.348190:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562519.348193:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1786562519.348222:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3290:x1873345654791936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (1437us total) trans 17179875947 rc 0/0 00000100:00100000:0.0:1786562519.348229:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17231 00000100:00100000:0.0:1786562519.348248:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17232 00000100:00100000:0.0:1786562519.348257:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3290:x1873345654792448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562519.348337:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562519.348341:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.348343:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562519.348345:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562519.348347:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562519.348375:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3290:x1873345654792448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (1543us total) trans 17179875948 rc 0/0 00000100:00100000:0.0:1786562519.348382:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17232 00000100:00100000:0.0:1786562519.348797:0:33113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654792832:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562519.348943:0:33113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654792960:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562519.348997:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689da0b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc029 expref: 504 pid: 33113 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.349058:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689da12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc029 expref: 503 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.349107:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:0.0:1786562519.349168:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+503:63881:x1873345652627456:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 143803us (148617us total) trans 8589950495 rc 0/0 00000100:00100000:0.0:1786562519.349176:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16973 00000100:00100000:3.0:1786562519.350998:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654793088 00000100:00100000:3.0:1786562519.351036:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654793088 00000100:00100000:3.0:1786562519.351140:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17233 00000100:00100000:3.0:1786562519.351153:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3291:x1873345654793088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562519.351427:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562519.351432:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562519.351435:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562519.351437:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562519.351441:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562519.351509:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3291:x1873345654793088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 358us (752us total) trans 17179875950 rc 0/0 00000100:00100000:3.0:1786562519.351517:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17233 00000100:00100000:0.0:1786562519.359797:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.359851:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.359890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.359940:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652628480 00000100:00100000:0.0:1786562519.359952:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652628480 00000100:00100000:0.0:1786562519.360050:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652628736 00000100:00100000:0.0:1786562519.360054:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652628736 00000100:00100000:0.0:1786562519.360080:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6198 00000100:00100000:0.0:1786562519.360092:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63884:x1873345652628480:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:0.0:1786562519.360274:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63884:x1873345652628480:12345-192.168.204.29@tcp:49:cat.0 Request processed in 184us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.360284:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6198 00000100:00100000:0.0:1786562519.360353:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6199 00000100:00100000:0.0:1786562519.360361:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:63885:x1873345652628736:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:0.0:1786562519.360407:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:63885:x1873345652628736:12345-192.168.204.29@tcp:49:cat.0 Request processed in 46us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.360414:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6199 00000100:00100000:3.0:1786562519.372176:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.377552:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.377748:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652629120 00000100:00100000:0.0:1786562519.377762:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652629120 00000100:00100000:0.0:1786562519.377844:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17234 00000100:00100000:0.0:1786562519.377858:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:63881:x1873345652629120:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562519.377884:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562519.377909:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc05a expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.377952:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689d836 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf88 expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.377963:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562519.377969:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562519.377976:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 14 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.378050:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689d836 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf88 expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.378064:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689d836 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf88 expref: 14 pid: 28861 timeout: 1051 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.378082:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654793344:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562519.378178:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562519.382089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.382251:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652629376 00000100:00100000:0.0:1786562519.382264:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652629376 00002000:00100000:0.0:1786562519.382325:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e883178000 x1873345652629376/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.382340:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883178000 with x1873345652629376 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.382347:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e883178000 00000100:00100000:0.0:1786562519.382384:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11235 00000100:00100000:0.0:1786562519.382393:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652629376:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562519.396126:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.396231:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.397312:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654793344:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562519.397355:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.397382:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:0.0:1786562519.397464:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:63881:x1873345652629120:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 19608us (19925us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.397475:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17234 00000100:00100000:0.0:1786562519.397518:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652629248 00000100:00100000:0.0:1786562519.397526:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652629248 00000100:00100000:3.0:1786562519.409539:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.409648:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652629760 00000100:00100000:0.0:1786562519.409663:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652629760 00002000:00100000:0.0:1786562519.409732:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88317b480 x1873345652629760/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786562519.409929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00100000:0.0:1786562519.411140:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317b480 with x1873345652629760 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.411148:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88317b480 00000100:00100000:0.0:1786562519.411179:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11236 00000100:00100000:0.0:1786562519.411198:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652629760:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562519.416693:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652630144 00000100:00100000:3.0:1786562519.416707:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652630144 00000100:00100000:3.0:1786562519.416784:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16979 00000100:00100000:3.0:1786562519.416796:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63886:x1873345652630144:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562519.416831:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.416835:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562519.416869:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689da58 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc053 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.416897:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.416902:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562519.416918:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647400/0x5c655bf66689da74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc068 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417216:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417238:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417249:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417267:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417275:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417282:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417289:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88c647e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562519.417294:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417303:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417312:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.417315:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562519.417319:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417325:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689da7b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417358:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647400/0x5c655bf66689da74 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc068 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417369:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562519.417371:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562519.417375:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647400/0x5c655bf66689da74 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc068 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.417384:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647400, rc 0) 00000100:00100000:3.0:1786562519.417504:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63886:x1873345652630144:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 710us (1459us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562519.417513:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16979 00000100:00100000:0.0:1786562519.430993:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654793600:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562519.431062:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562519.431099:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652629632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 27142us (27626us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.431110:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8393 00000100:00100000:0.0:1786562519.434926:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652629760:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 23718us (25385us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562519.434944:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11236 00002000:00100000:0.0:1786562519.434963:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88317b480 x1873345652629760/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.434975:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317b480 with x1873345652629760 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.434983:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88317b480 00000100:00100000:3.0:1786562519.444323:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.459439:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654793728:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562519.459476:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562519.459564:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652629888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 48369us (49633us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.459578:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8394 00000100:00100000:0.0:1786562519.461452:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.464256:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63886:x1873345652630912:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 401us (2810us total) trans 8589950497 rc 0/0 00000100:00100000:0.0:1786562519.464265:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6200 00000100:00100000:3.0:1786562519.465361:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652630656 00000100:00100000:3.0:1786562519.465376:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652630656 00000100:00100000:3.0:1786562519.467270:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652631040 00000100:00100000:3.0:1786562519.467280:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652631040 00002000:00100000:3.0:1786562519.467326:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e98553ca80 x1873345652631040/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.467337:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553ca80 with x1873345652631040 ext(1048576->2097151) 00002000:00010000:3.0:1786562519.467342:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553ca80 00000100:00100000:3.0:1786562519.467366:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11239 00000100:00100000:3.0:1786562519.467374:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652631040:12345-192.168.204.29@tcp:3:multiop.0 00010000:00010000:0.0:1786562519.470416:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc076 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.470490:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 6 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.470502:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562519.470508:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562519.470515:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->3350527] (req 3145728->3350527) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.470570:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 6 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.470588:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 6 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.470608:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654793856:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562519.470727:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562519.493470:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.497558:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652631040:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 30179us (31903us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562519.497573:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11239 00002000:00100000:3.0:1786562519.497592:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e98553ca80 x1873345652631040/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.497629:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553ca80 with x1873345652631040 ext(1048576->2097151) 00002000:00010000:3.0:1786562519.497641:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553ca80 00000100:00100000:3.0:1786562519.497709:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652631552 00000100:00100000:3.0:1786562519.497715:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652631552 00000100:00100000:3.0:1786562519.497755:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17239 00000100:00100000:3.0:1786562519.497764:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63882:x1873345652631552:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562519.497776:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.497796:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc084 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.497823:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 14 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.497833:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562519.497839:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562519.497844:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->3596287] (req 3145728->3596287) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 10 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.497891:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 14 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.497905:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 14 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.497923:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654793984:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562519.497994:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88118f540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562519.510532:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654793984:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562519.510581:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->3596287] (req 3145728->3596287) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 10 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.510601:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652631424:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 12886us (13164us total) trans 17179875951 rc 0/0 00010000:00010000:3.0:1786562519.510610:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647e00, rc 0) 00000100:00100000:0.0:1786562519.510627:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5867 00002000:00100000:0.0:1786562519.510643:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (3969024->4194303) req@ffff90e98553f480 x1873345652631424/t17179875951(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/448 e 0 to 0 dl 1786562530 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.510653:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553f480 with x1873345652631424 ext(3969024->4194303) 00000100:00100000:3.0:1786562519.510658:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63882:x1873345652631552:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 12893us (13155us total) trans 0 rc 0/0 00010000:00010000:0.0:1786562519.510668:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 9 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.510671:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17239 00010000:00010000:0.0:1786562519.510690:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 9 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.510765:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652631680 00000100:00100000:3.0:1786562519.510774:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652631680 00002000:00010000:0.0:1786562519.512352:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98553f480 00000100:00100000:3.0:1786562519.515992:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17240 00000100:00100000:3.0:1786562519.516049:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+25:63885:x1873345652631680:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562519.516079:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.516292:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc08b expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.516336:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786562519.516341:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562519.516352:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 26 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.516371:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 26 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.516388:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647400, rc 0) 00000100:00100000:3.0:1786562519.516478:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+26:63885:x1873345652631680:12345-192.168.204.29@tcp:101:cat.0 Request processed in 442us (7233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.516486:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17240 00000100:00100000:3.0:1786562519.520969:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652631936 00000100:00100000:3.0:1786562519.520988:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652631936 00010000:00010000:3.0:1786562519.521100:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 9 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.521159:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8395 00000100:00100000:3.0:1786562519.521171:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652631936:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562519.521191:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786562519.521218:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562515 -> 1786562518 00002000:00010000:3.0:1786562519.521222:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562515 -> 1786562518 00010000:00010000:3.0:1786562519.521229:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 9 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.521245:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 9 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.521274:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689da66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc061 expref: 9 pid: 29966 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.521297:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562519.521301:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562519.521310:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.521327:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.522657:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.522686:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654794112:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562519.522803:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562519.528730:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652631808:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 17611us (17833us total) trans 21474843484 rc 0/0 00000100:00100000:0.0:1786562519.530483:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5868 00002000:00100000:0.0:1786562519.530509:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (2842624->3145727) req@ffff90e88c798a80 x1873345652631808/t21474843484(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/448 e 0 to 0 dl 1786562530 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.530523:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c798a80 with x1873345652631808 ext(2842624->3145727) 00010000:00010000:0.0:1786562519.530538:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 17 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.530561:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 17 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562519.530570:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88c798a80 00000100:00100000:3.0:1786562519.537410:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652631296:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 43620us (43952us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562519.537427:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11240 00002000:00100000:3.0:1786562519.537448:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88bf5e300 x1873345652631296/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.537460:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5e300 with x1873345652631296 ext(1048576->2097151) 00002000:00010000:3.0:1786562519.537469:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5e300 00000100:00100000:0.0:1786562519.538315:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652632064 00000100:00100000:0.0:1786562519.538335:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652632064 00010000:00010000:0.0:1786562519.538400:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 17 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.538536:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8396 00000100:00100000:0.0:1786562519.538549:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652632064:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562519.538574:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562519.538610:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562515 -> 1786562518 00002000:00010000:0.0:1786562519.539772:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562515 -> 1786562518 00010000:00010000:0.0:1786562519.539792:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 17 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.539815:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 17 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.539855:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689da5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc05a expref: 17 pid: 6658 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.540915:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562519.540929:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562519.540951:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 7 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.540972:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 7 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.541106:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 7 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.541133:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654794240:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562519.541301:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf88d180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562519.544050:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654794112:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562519.544096:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562519.544182:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652631936:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23013us (27290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.544193:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8395 00000100:00100000:3.0:1786562519.545716:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.550152:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654794240:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562519.550201:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562519.551875:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652632064:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13306us (15041us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562519.551905:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8396 00000100:00100000:0.0:1786562519.554406:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652632448 00000100:00100000:0.0:1786562519.554419:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652632448 00000100:00100000:0.0:1786562519.554507:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6201 00000100:00100000:0.0:1786562519.554522:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+503:63881:x1873345652632448:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562519.555167:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+504:63881:x1873345652632448:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 647us (912us total) trans 8589950498 rc 0/0 00000100:00100000:0.0:1786562519.555178:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6201 00000100:00100000:0.0:1786562519.575473:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652632704 00000100:00100000:0.0:1786562519.575490:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652632704 00002000:00100000:0.0:1786562519.575573:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88313e680 x1873345652632704/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.575594:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313e680 with x1873345652632704 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.575602:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88313e680 00000100:00100000:0.0:1786562519.575660:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11242 00000100:00100000:0.0:1786562519.575683:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652632704:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562519.585926:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652632832 00000100:00100000:3.0:1786562519.585954:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652632832 00000100:00100000:0.0:1786562519.595166:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652632704:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 19461us (19844us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562519.595187:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11242 00002000:00100000:0.0:1786562519.595211:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88313e680 x1873345652632704/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.595224:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313e680 with x1873345652632704 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.595295:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88313e680 00000100:00100000:3.0:1786562519.605637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.615111:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652633088 00000100:00100000:0.0:1786562519.615136:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652633088 00000100:00100000:0.0:1786562519.615258:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6202 00000100:00100000:0.0:1786562519.615271:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63882:x1873345652633088:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562519.615650:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63882:x1873345652633088:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 381us (10048us total) trans 8589950499 rc 0/0 00000100:00100000:0.0:1786562519.615658:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6202 00000100:00100000:3.0:1786562519.621419:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.625063:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652633216 00000100:00100000:0.0:1786562519.625086:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652633216 00002000:00100000:0.0:1786562519.625236:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88317bb80 x1873345652633216/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.625250:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317bb80 with x1873345652633216 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.625259:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88317bb80 00000100:00100000:0.0:1786562519.625301:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11244 00000100:00100000:0.0:1786562519.625314:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652633216:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562519.626963:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.654086:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652633216:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 28750us (32659us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562519.654106:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11244 00002000:00100000:0.0:1786562519.654126:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88317bb80 x1873345652633216/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.654140:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317bb80 with x1873345652633216 ext(1048576->2097151) 00002000:00010000:0.0:1786562519.654149:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88317bb80 00000100:00100000:3.0:1786562519.680294:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.681049:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.681915:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652633472 00000100:00100000:3.0:1786562519.681934:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652633472 00000100:00100000:3.0:1786562519.682054:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652633600 00000100:00100000:3.0:1786562519.682058:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652633600 00000100:00100000:3.0:1786562519.682093:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17242 00000100:00100000:3.0:1786562519.682107:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63884:x1873345652633472:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562519.682135:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.682163:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070041611/0x5c655bf66689daac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc099 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.682207:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.682218:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1786562519.682224:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562519.682230:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070041611/0x5c655bf66689daac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc099 expref: 10 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.682280:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.682297:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 25 pid: 37002 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562519.682315:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654794368:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562519.682457:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88118f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562519.682511:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17243 00000100:00100000:0.0:1786562519.682526:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:63885:x1873345652633600:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562519.682539:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562519.682556:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0a0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.682580:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 7 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.682589:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1786562519.682593:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562519.682599:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a0 expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.682737:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 7 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.682751:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000510d75c6/0x5c655bf66689da97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc084 expref: 7 pid: 29967 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.682766:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654794496:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562519.682801:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562519.694793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.696187:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652633728 00000100:00100000:3.0:1786562519.696205:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652633728 00002000:00100000:3.0:1786562519.696280:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3145728->3350527) req@ffff90e88bf5c380 x1873345652633728/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.696294:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5c380 with x1873345652633728 ext(3145728->3350527) 00010000:00010000:3.0:1786562519.696306:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 26 pid: 37002 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.696333:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 26 pid: 37002 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562519.696342:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf5c380 00000100:00100000:3.0:1786562519.696386:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5869 00000100:00100000:3.0:1786562519.696400:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652633728:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562519.699137:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654794496:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562519.699179:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a0 expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.699200:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f200, rc 0) 00000100:00100000:3.0:1786562519.699255:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:63885:x1873345652633600:12345-192.168.204.29@tcp:101:cat.0 Request processed in 16733us (18255us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.699266:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17243 00000100:00100000:0.0:1786562519.722520:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652633728:12345-192.168.204.29@tcp:4:cat.0 Request processed in 26105us (27722us total) trans 17179875952 rc 0/0 00000100:00100000:0.0:1786562519.722538:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5869 00002000:00100000:0.0:1786562519.722555:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3145728->3350527) req@ffff90e88bf5c380 x1873345652633728/t17179875952(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/448 e 0 to 0 dl 1786562530 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.722567:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5c380 with x1873345652633728 ext(3145728->3350527) 00010000:00010000:0.0:1786562519.722580:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 28 pid: 37002 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.722602:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689da90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc076 expref: 28 pid: 37002 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562519.722626:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf5c380 00000100:00100000:3.0:1786562519.727077:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.727121:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.727574:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652634112 00000100:00100000:0.0:1786562519.727589:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652634112 00000100:00100000:0.0:1786562519.727682:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16980 00000100:00100000:0.0:1786562519.727694:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+504:63891:x1873345652634112:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562519.729176:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562519.729204:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689daba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0a7 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.729314:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689dac1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.729333:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689dac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562519.729350:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689dac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562519.772161:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652634496 00000100:00100000:0.0:1786562519.772182:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652634496 00002000:00100000:0.0:1786562519.772427:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e889f55880 x1873345652634496/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.772441:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55880 with x1873345652634496 ext(2097152->3145727) 00002000:00010000:0.0:1786562519.772447:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889f55880 00000100:00100000:0.0:1786562519.772533:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11246 00000100:00100000:0.0:1786562519.772545:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652634496:12345-192.168.204.29@tcp:3:cat.0 00010000:00010000:0.0:1786562519.788413:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562519.795215:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.834576:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.834773:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652634752 00000100:00100000:3.0:1786562519.834785:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652634752 00000100:00100000:3.0:1786562519.834860:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17244 00000100:00100000:3.0:1786562519.834872:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:63885:x1873345652634752:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562519.834896:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562519.834920:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0ae expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.834957:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562519.834963:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562519.834974:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.834993:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562519.835038:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7e00, rc 0) 00000100:00100000:3.0:1786562519.835103:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:63885:x1873345652634752:12345-192.168.204.29@tcp:101:cat.0 Request processed in 233us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562519.835111:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17244 00000100:00100000:3.0:1786562519.859501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.871600:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652635008 00000100:00100000:3.0:1786562519.871646:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652635008 00002000:00100000:3.0:1786562519.871719:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e889f56d80 x1873345652635008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.871733:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f56d80 with x1873345652635008 ext(3145728->4194303) 00002000:00010000:3.0:1786562519.871740:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f56d80 00000100:00100000:3.0:1786562519.871781:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11248 00000100:00100000:3.0:1786562519.871791:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652635008:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562519.948334:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.951663:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562519.951947:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652635392 00000100:00100000:0.0:1786562519.951957:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652635392 00002000:00100000:0.0:1786562519.952000:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf5d180 x1873345652635392/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562519.952028:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5d180 with x1873345652635392 ext(3145728->4194303) 00002000:00010000:0.0:1786562519.952034:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5d180 00000100:00100000:0.0:1786562519.952057:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11251 00000100:00100000:0.0:1786562519.952067:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652635392:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562519.954451:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652635136:12345-192.168.204.29@tcp:3:cat.0 Request processed in 73308us (82966us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562519.954477:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11249 00002000:00100000:3.0:1786562519.954498:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e889f56300 x1873345652635136/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.954510:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f56300 with x1873345652635136 ext(3145728->4194303) 00002000:00010000:3.0:1786562519.954517:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889f56300 00000100:00100000:3.0:1786562519.960499:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652635520 00000100:00100000:3.0:1786562519.960511:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652635520 00002000:00100000:3.0:1786562519.960573:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9bf8dd180 x1873345652635520/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.960585:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dd180 with x1873345652635520 ext(3145728->4194303) 00002000:00010000:3.0:1786562519.960591:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dd180 00000100:00100000:3.0:1786562519.960642:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11252 00000100:00100000:3.0:1786562519.960654:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652635520:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562519.965470:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562519.966169:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652635904 00000100:00100000:3.0:1786562519.966186:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652635904 00002000:00100000:3.0:1786562519.966262:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e98825ce00 x1873345652635904/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:745/0 lens 488/0 e 0 to 0 dl 1786562530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562519.966276:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ce00 with x1873345652635904 ext(4194304->5185535) 00002000:00010000:3.0:1786562519.966283:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825ce00 00000100:00100000:3.0:1786562519.966328:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11253 00000100:00100000:3.0:1786562519.966355:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652635904:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562520.015225:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652635520:12345-192.168.204.29@tcp:3:cat.0 Request processed in 54557us (57253us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562520.015247:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11252 00002000:00100000:3.0:1786562520.015273:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9bf8dd180 x1873345652635520/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.015287:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dd180 with x1873345652635520 ext(3145728->4194303) 00002000:00010000:3.0:1786562520.015296:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dd180 00000100:00100000:0.0:1786562520.031748:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652635392:12345-192.168.204.29@tcp:3:cat.0 Request processed in 79662us (80071us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562520.031766:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11251 00002000:00100000:0.0:1786562520.031784:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf5d180 x1873345652635392/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.031796:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5d180 with x1873345652635392 ext(3145728->4194303) 00002000:00010000:0.0:1786562520.031814:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5d180 00000100:00100000:3.0:1786562520.065334:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652635264:12345-192.168.204.29@tcp:3:cat.0 Request processed in 114638us (117004us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562520.065350:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11250 00002000:00100000:3.0:1786562520.065364:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf5f480 x1873345652635264/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:745/0 lens 488/440 e 0 to 0 dl 1786562530 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.065375:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5f480 with x1873345652635264 ext(2097152->3145727) 00002000:00010000:3.0:1786562520.065381:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5f480 00000100:00100000:3.0:1786562520.098433:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652636160 00000100:00100000:3.0:1786562520.098457:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652636160 00000100:00080000:3.0:1786562520.099719:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562520.131813:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652636416 00000100:00100000:0.0:1786562520.131826:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652636416 00000100:00100000:0.0:1786562520.131909:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16982 00000100:00100000:0.0:1786562520.131922:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:63891:x1873345652636416:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562520.131957:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562520.131961:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1786562520.131997:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1600/0x5c655bf66689dacf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a7 expref: 507 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132085:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689da12 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc029 expref: 506 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132108:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689da19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc030 expref: 505 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132120:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562520.132127:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562520.132149:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689db0e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0c3 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132223:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132240:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132249:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 8 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132257:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132266:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132309:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132326:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 9 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.132345:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654794880:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562520.132483:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 8 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132494:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 8 pid: 34450 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.132504:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654795008:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562520.132536:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.132545:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 9 pid: 33115 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.132554:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654795136:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.132577:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.146785:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654794880:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.146806:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654795008:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.146816:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654795136:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562520.146855:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.147661:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652636672 00000100:00100000:0.0:1786562520.147683:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652636672 00010000:00010000:0.0:1786562520.147753:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 9 pid: 34450 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.147792:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652636800 00000100:00100000:0.0:1786562520.147796:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652636800 00010000:00010000:0.0:1786562520.147816:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 10 pid: 33115 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.147846:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652636544 00000100:00100000:0.0:1786562520.147850:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652636544 00010000:00010000:0.0:1786562520.147863:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 11 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.147887:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8399 00000100:00100000:0.0:1786562520.147899:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2350:x1873345652636672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.147918:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.147926:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 9 pid: 34450 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.147938:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 9 pid: 34450 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.147969:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689da4a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc04c expref: 9 pid: 34450 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.147992:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8400 00010000:00010000:0.0:1786562520.147992:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562520.148001:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.148051:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652636800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562520.148069:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.148069:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.148080:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 11 pid: 33115 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148082:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562520.148097:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 11 pid: 33115 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.148121:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689da43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc045 expref: 11 pid: 33115 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.148138:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.148143:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.148152:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:2350:x1873345652636672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 252us (606us total) trans 0 rc 0/0 00010000:00010000:3.0:1786562520.148154:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.148168:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8399 00010000:00010000:3.0:1786562520.148169:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.148195:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8401 00000100:00100000:3.0:1786562520.148201:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652636800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 196us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.148207:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652636544:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1786562520.148217:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8400 00010000:00010000:0.0:1786562520.148219:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.148227:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 10 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148240:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 9 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148254:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689db00 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0bc expref: 9 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148265:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562520.148270:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148279:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148287:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148324:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.148348:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652636544:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 145us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.148355:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8401 00010000:00010000:0.0:1786562520.148380:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.148389:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562520.150345:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4333, 88 off351544 00000004:00080000:0.0:1786562520.150365:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952592358557ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.159723:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4315, 88 off349784 00000004:00080000:0.0:1786562520.159758:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952601751834ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.159871:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4316, 88 off349872 00000004:00080000:0.0:1786562520.159877:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952601871289ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.159919:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4334, 88 off351632 00000004:00080000:0.0:1786562520.159925:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952601918579ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.159976:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4335, 88 off351720 00000004:00080000:0.0:1786562520.159984:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952601977622ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160037:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4317, 88 off349960 00000004:00080000:0.0:1786562520.160043:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952602037152ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.160075:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4318, 88 off350048 00000004:00080000:0.0:1786562520.160081:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952602074609ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.160114:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4319, 88 off350136 00000004:00080000:0.0:1786562520.160120:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952602114427ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.160140:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4336, 88 off351808 00000004:00080000:0.0:1786562520.160146:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952602140002ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160162:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4320, 88 off350224 00000004:00080000:0.0:1786562520.160167:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952602160852ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.160186:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4337, 88 off351896 00000004:00080000:0.0:1786562520.160191:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952602184962ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160207:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4321, 88 off350312 00000004:00080000:0.0:1786562520.160211:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952602204894ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562520.160229:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4338, 88 off351984 00000004:00080000:0.0:1786562520.160233:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952602227014ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160250:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4339, 88 off352072 00000004:00080000:0.0:1786562520.160255:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952602249082ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160272:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4340, 88 off352160 00000004:00080000:0.0:1786562520.160276:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952602270352ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160358:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4342, 88 off352344 00000004:00080000:0.0:1786562520.160364:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 952602357932ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562520.160384:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4322, 88 off350400 00000004:00080000:0.0:1786562520.160388:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 952602382387ns, next at 911624464511ns, rc = 0 00000100:00100000:3.0:1786562520.190364:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652636928:12345-192.168.204.29@tcp:3:cat.0 Request processed in 36702us (42848us total) trans 0 rc 991232/991232 00000100:00100000:3.0:1786562520.190383:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11254 00002000:00100000:3.0:1786562520.190399:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88ac84e00 x1873345652636928/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:746/0 lens 488/440 e 0 to 0 dl 1786562531 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.190411:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84e00 with x1873345652636928 ext(4194304->5185535) 00002000:00010000:3.0:1786562520.190418:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88ac84e00 00000100:00100000:3.0:1786562520.214189:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.214249:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652637056 00000100:00100000:3.0:1786562520.214261:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652637056 00000100:00100000:3.0:1786562520.214335:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16983 00000100:00100000:3.0:1786562520.214348:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63884:x1873345652637056:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562520.214383:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.214408:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0ca expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.214492:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.214509:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 4/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.214538:0:35929:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.214559:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.214579:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.214583:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562520.214589:0:35929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.214610:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb38ec00, rc 0) 00000100:00100000:3.0:1786562520.214698:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63884:x1873345652637056:12345-192.168.204.29@tcp:101:cat.0 Request processed in 351us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.214707:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16983 00000001:00080000:3.0:1786562520.286423:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950503 is committed 00000004:00080000:3.0:1786562520.286447:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2831 committed 00000004:00080000:3.0:1786562520.286462:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2852 committed 00000004:00080000:3.0:1786562520.286473:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2851 committed 00000004:00080000:3.0:1786562520.286476:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2850 committed 00000004:00080000:3.0:1786562520.286478:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2849 committed 00000004:00080000:3.0:1786562520.286481:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2830 committed 00000004:00080000:3.0:1786562520.286483:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2848 committed 00000004:00080000:3.0:1786562520.286486:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2829 committed 00000004:00080000:3.0:1786562520.286488:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2847 committed 00000004:00080000:3.0:1786562520.286490:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2828 committed 00000004:00080000:3.0:1786562520.286493:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2827 committed 00000004:00080000:3.0:1786562520.286495:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2826 committed 00000004:00080000:3.0:1786562520.286498:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2846 committed 00000004:00080000:3.0:1786562520.286500:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2845 committed 00000004:00080000:3.0:1786562520.286502:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2825 committed 00000004:00080000:3.0:1786562520.286505:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2824 committed 00000004:00080000:3.0:1786562520.286507:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2844 committed 00000001:00080000:3.0:1786562520.286516:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950499 is committed 00000001:00080000:3.0:1786562520.286531:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950501 is committed 00000001:00080000:3.0:1786562520.286540:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950497 is committed 00000100:00100000:3.0:1786562520.286955:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654795264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287101:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287151:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654795776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287176:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287194:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654796288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287217:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287232:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654796800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287252:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287282:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1786562520.287288:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654795392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287314:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287333:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654795904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287353:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287371:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654796416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287392:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287410:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654796928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287432:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287470:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654795520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287496:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287515:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654796032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287533:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287550:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654796544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287570:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287587:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654797056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287620:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287639:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1786562520.287645:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654795648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287680:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654796160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562520.287736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287759:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654796672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287781:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287790:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654797184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562520.287808:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562520.287848:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654795264 00000100:00100000:3.0:1786562520.287859:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654795264 00000100:00100000:3.0:1786562520.287926:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654795776 00000100:00100000:3.0:1786562520.287929:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654795776 00000100:00100000:3.0:1786562520.287944:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796288 00000100:00100000:3.0:1786562520.287947:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796288 00000100:00100000:3.0:1786562520.287961:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796800 00000100:00100000:3.0:1786562520.287964:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796800 00000100:00100000:3.0:1786562520.287974:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654795392 00000100:00100000:3.0:1786562520.287976:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654795392 00000100:00100000:3.0:1786562520.287984:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654795904 00000100:00100000:3.0:1786562520.287986:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654795904 00000100:00100000:3.0:1786562520.287996:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796416 00000100:00100000:3.0:1786562520.287998:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796416 00000100:00100000:3.0:1786562520.288038:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796928 00000100:00100000:3.0:1786562520.288041:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796928 00000100:00100000:3.0:1786562520.288051:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654795520 00000100:00100000:3.0:1786562520.288053:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654795520 00000100:00100000:3.0:1786562520.288063:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796032 00000100:00100000:3.0:1786562520.288065:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796032 00000100:00100000:3.0:1786562520.288075:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796544 00000100:00100000:3.0:1786562520.288077:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796544 00000100:00100000:3.0:1786562520.288087:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654797056 00000100:00100000:3.0:1786562520.288089:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654797056 00000100:00100000:3.0:1786562520.288098:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654795648 00000100:00100000:3.0:1786562520.288100:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654795648 00000100:00100000:3.0:1786562520.288114:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17246 00000100:00100000:3.0:1786562520.288123:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3289:x1873345654795264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562520.288467:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562520.288473:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562514 -> 1786562514 00002000:00010000:3.0:1786562520.288476:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:3.0:1786562520.288479:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562514 -> 1786562514 00002000:00010000:3.0:1786562520.288483:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00010000:00010000:0.0:1786562520.292661:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 504 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.292687:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562520.292690:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1786562520.292697:0:33115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 6 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.292712:0:33115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 6 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.292727:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 6 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.292799:0:33115:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 6 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.292823:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654797312:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562520.292996:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.293650:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796160 00000100:00100000:0.0:1786562520.293663:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796160 00000100:00100000:0.0:1786562520.293720:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654796672 00000100:00100000:0.0:1786562520.293725:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654796672 00000100:00100000:0.0:1786562520.293741:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654797184 00000100:00100000:0.0:1786562520.293745:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654797184 00000100:00100000:0.0:1786562520.293769:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17247 00000100:00100000:0.0:1786562520.293781:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3289:x1873345654795776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562520.294188:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562520.294194:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.294197:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562520.294200:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.294204:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562520.294307:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654795776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 527us (7128us total) trans 21474843487 rc 0/0 00000100:00100000:0.0:1786562520.294316:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17247 00000100:00100000:0.0:1786562520.294423:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17248 00000100:00100000:0.0:1786562520.294432:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654796288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562520.294570:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1786562520.294574:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562520.294576:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562512 -> 1786562512 00002000:00010000:0.0:1786562520.294578:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562512 -> 1786562512 00002000:00010000:0.0:1786562520.294581:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562520.294625:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654796288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (7407us total) trans 17179875953 rc 0/0 00000100:00100000:0.0:1786562520.294633:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17248 00000100:00100000:0.0:1786562520.294647:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17249 00000100:00100000:0.0:1786562520.294655:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654796800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562520.294743:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562520.294747:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.294749:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562520.294752:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.294754:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562520.294785:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654796800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (7532us total) trans 17179875954 rc 0/0 00000100:00100000:0.0:1786562520.294793:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17249 00000100:00100000:0.0:1786562520.294807:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17250 00000100:00100000:0.0:1786562520.294816:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3289:x1873345654795392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562520.294905:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562520.294908:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562520.294911:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562520.294914:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562514 -> 1786562514 00002000:00010000:0.0:1786562520.294916:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562520.294948:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654795392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (7633us total) trans 21474843488 rc 0/0 00000100:00100000:0.0:1786562520.294956:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17250 00000100:00100000:0.0:1786562520.294968:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17251 00000100:00100000:0.0:1786562520.294976:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3289:x1873345654795904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562520.295096:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562520.295100:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.295102:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562520.295104:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.295106:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562520.295135:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654795904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (7780us total) trans 21474843489 rc 0/0 00000100:00100000:0.0:1786562520.295141:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17251 00000100:00100000:0.0:1786562520.295155:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17252 00000100:00100000:0.0:1786562520.295161:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654796416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562520.295244:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562520.295247:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562520.295249:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:0.0:1786562520.295251:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562515 -> 1786562515 00002000:00010000:0.0:1786562520.295253:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1786562520.295281:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654796416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (7887us total) trans 17179875955 rc 0/0 00000100:00100000:0.0:1786562520.295288:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17252 00000100:00100000:0.0:1786562520.295303:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17253 00000100:00100000:0.0:1786562520.295310:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654796928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562520.302504:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654797440 00000100:00100000:0.0:1786562520.302521:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654797440 00000100:00100000:0.0:1786562520.302581:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17255 00000100:00100000:0.0:1786562520.302593:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3291:x1873345654796032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562520.302860:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562520.302864:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.302867:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562520.302870:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.302872:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:0.0:1786562520.302988:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654796032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 398us (15452us total) trans 21474843491 rc 0/0 00000100:00100000:0.0:1786562520.302997:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17255 00000100:00100000:0.0:1786562520.303043:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17256 00000100:00100000:0.0:1786562520.303051:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654796544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562520.303164:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562520.303168:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:0.0:1786562520.303170:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562518 -> 1786562518 00002000:00010000:0.0:1786562520.303173:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:0.0:1786562520.303175:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:0.0:1786562520.303202:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654796544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (15631us total) trans 17179875956 rc 0/0 00000100:00100000:0.0:1786562520.303207:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17256 00000100:00100000:0.0:1786562520.303218:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17257 00000100:00100000:0.0:1786562520.303225:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654797056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562520.303301:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562520.303305:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.303307:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562520.303309:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562520.303311:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562520.307511:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3289:x1873345654795264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 19380us (20403us total) trans 21474843486 rc 0/0 00000100:00100000:3.0:1786562520.307525:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17246 00000100:00100000:3.0:1786562520.307584:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17261 00000100:00100000:3.0:1786562520.307611:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654797184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562520.307805:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:3.0:1786562520.307809:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562520.307812:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562520.307814:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562520.307816:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562520.307863:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3291:x1873345654797184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 271us (20054us total) trans 17179875958 rc 0/0 00000100:00100000:3.0:1786562520.307870:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17261 00000100:00100000:3.0:1786562520.307884:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17262 00000100:00100000:3.0:1786562520.307891:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3289:x1873345654797440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562520.307974:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562520.307977:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562520.307979:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562520.307981:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562520.307983:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562520.308147:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3289:x1873345654797440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (7497us total) trans 17179875959 rc 0/0 00000100:00100000:3.0:1786562520.308155:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17262 00000100:00080000:3.0:1786562520.308195:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562520.308202:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1786562520.308384:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88ac87b80/2, rc 0, transno 17179875959 00000100:00100000:3.0:1786562520.308393:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654797440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562520.308412:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98825f100/2, rc 0, transno 21474843486 00000100:00100000:3.0:1786562520.308416:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654795264:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562520.308563:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562520.308567:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562520.308569:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562520.308571:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562520.308574:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1786562520.308627:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3289:x1873345654796928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 13317us (21194us total) trans 17179875960 rc 0/0 00000100:00100000:3.0:1786562520.308634:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17253 00000004:00080000:3.0:1786562520.308661:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883179880/2, rc 0, transno 17179875960 00000100:00100000:3.0:1786562520.308666:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654796928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562520.309440:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654797056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (15714us total) trans 17179875957 rc 0/0 00000100:00100000:0.0:1786562520.309450:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17257 00002000:00010000:3.0:1786562520.312881:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1786562520.312891:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562520.312894:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562520.312896:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562520.312899:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562520.313002:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654796672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6731us (25214us total) trans 17179875961 rc 0/0 00000100:00100000:3.0:1786562520.313056:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17260 00000100:00100000:3.0:1786562520.317780:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652637568 00000100:00100000:3.0:1786562520.317790:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652637568 00000100:00100000:0.0:1786562520.317933:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652637440 00000100:00100000:0.0:1786562520.317938:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652637440 00000100:00100000:0.0:1786562520.317984:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6204 00000100:00100000:0.0:1786562520.317995:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63884:x1873345652637440:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:0.0:1786562520.318205:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63884:x1873345652637440:12345-192.168.204.29@tcp:49:cat.0 Request processed in 212us (4688us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.318215:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6204 00000100:00100000:3.0:1786562520.318352:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16985 00000100:00100000:3.0:1786562520.318362:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:63898:x1873345652637568:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562520.318383:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.318409:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689db46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0d8 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.318474:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.318493:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.318507:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.318525:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.318532:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.318540:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327613:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327638:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327651:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562520.327706:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:3.0:1786562520.327713:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562520.327739:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327753:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327763:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327770:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327777:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327782:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562520.327787:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327795:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327809:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562520.327812:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562520.327817:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327822:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689db4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327838:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327850:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327857:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327862:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562520.327865:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327871:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327876:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46abd00) 00010000:00010000:3.0:1786562520.327879:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562520.327881:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327887:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689db54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327933:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689db46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0d8 expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327948:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0d8 expref: 7 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.327955:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.327958:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562520.327961:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:3.0:1786562520.328089:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63898:x1873345652637568:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 9727us (14440us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.328101:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16985 00000100:00100000:0.0:1786562520.342946:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652637696 00000100:00100000:0.0:1786562520.342959:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652637696 00000100:00100000:0.0:1786562520.343068:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652637824 00000100:00100000:0.0:1786562520.343072:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652637824 00000100:00100000:0.0:1786562520.343101:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17263 00000100:00100000:0.0:1786562520.343113:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652637696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562520.343136:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562520.343159:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0df expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.343191:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562520.343197:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562520.343208:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 15 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.343228:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 15 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.343244:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ee00, rc 0) 00000100:00100000:0.0:1786562520.343309:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652637696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 199us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.343317:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17263 00000100:00100000:0.0:1786562520.343350:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17264 00000100:00100000:0.0:1786562520.343357:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652637824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562520.343365:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562520.343375:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689db69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0e6 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.343387:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562520.343391:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562520.343396:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689db69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0e6 expref: 15 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.343407:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689db69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0e6 expref: 15 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.343417:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ec00, rc 0) 00000100:00100000:0.0:1786562520.343435:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652637824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 80us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.343444:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17264 00000100:00100000:3.0:1786562520.346750:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652637952 00000100:00100000:3.0:1786562520.346763:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652637952 00000100:00100000:3.0:1786562520.346855:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16986 00000100:00100000:3.0:1786562520.346869:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+503:63897:x1873345652637952:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562520.346904:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.346937:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689db70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0ed expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347100:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347119:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347132:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562520.347169:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:3.0:1786562520.347174:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562520.347198:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347231:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689db70 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ed expref: 505 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347275:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ed expref: 504 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347286:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.347290:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562520.347294:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0200, rc 0) 00000100:00100000:3.0:1786562520.347361:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+504:63897:x1873345652637952:12345-192.168.204.29@tcp:101:cat.0 Request processed in 495us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.347369:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16986 00000100:00100000:3.0:1786562520.347399:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652638080 00000100:00100000:3.0:1786562520.347404:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652638080 00000100:00100000:3.0:1786562520.347455:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17265 00000100:00100000:3.0:1786562520.347462:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:63891:x1873345652638080:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562520.347471:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.347484:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc0f4 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347511:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689d828 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf7a expref: 14 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347523:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689daa5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc092 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347532:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 29 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.347541:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562520.347546:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562520.347551:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 29 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.349866:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 29 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.349891:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 29 pid: 29967 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.349913:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654797568:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.350060:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689daa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc092 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.350072:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689daa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc092 expref: 9 pid: 29963 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.350083:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654797696:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.350122:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689d828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf7a expref: 14 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.350134:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689d828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf7a expref: 14 pid: 29662 timeout: 1052 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.350150:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654797824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562520.350176:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.355849:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654797568:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.355866:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654797696:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562520.355875:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652638464 00000100:00100000:0.0:1786562520.355877:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654797824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562520.355887:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652638464 00010000:00010000:0.0:1786562520.355929:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 30 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.355933:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 30 pid: 29967 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.355967:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfd5a800, rc 0) 00000100:00100000:3.0:1786562520.355999:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8402 00000100:00100000:3.0:1786562520.356072:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652638464:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562520.356090:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1786562520.356101:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+30:63891:x1873345652638080:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 8637us (9399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.356111:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17265 00010000:00010000:3.0:1786562520.356120:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 30 pid: 29967 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.356137:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 29 pid: 29967 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.356166:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689da9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc08b expref: 29 pid: 29967 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.356181:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562520.356204:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652638464:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 137us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.356211:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8402 00000100:00100000:3.0:1786562520.370728:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.370829:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.377173:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.377331:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf06300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654797952:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.377348:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654798080:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562520.377390:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.394305:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562520.404899:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689db5b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0d8 expref: 9 pid: 33140 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.404945:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8404 00000100:00100000:0.0:1786562520.404958:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652638720:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.404970:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.404987:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689daa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc092 expref: 10 pid: 29963 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.406105:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8405 00000100:00100000:3.0:1786562520.406128:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+504:2350:x1873345652638848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562520.406147:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562520.406159:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ed expref: 504 pid: 35929 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.406180:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ed expref: 504 pid: 35929 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.406209:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf66689db77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ed expref: 504 pid: 35929 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.406252:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.406258:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.406269:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.406276:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562520.413464:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689daa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc092 expref: 10 pid: 29963 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.422361:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+503:2350:x1873345652638848:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 238us (29199us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.422377:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8405 00000100:00100000:3.0:1786562520.422437:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652639104 00000100:00100000:3.0:1786562520.422445:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652639104 00000100:00100000:3.0:1786562520.425076:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17266 00000100:00100000:3.0:1786562520.425607:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63893:x1873345652639104:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562520.425639:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.425665:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc102 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.425711:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070041611/0x5c655bf66689daac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc099 expref: 12 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.425724:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.425733:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.425743:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562520.425748:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562520.425754:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3756032->4194303] (req 3756032->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 12 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.427810:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689daa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc092 expref: 12 pid: 29963 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.428509:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.428530:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 29 pid: 12119 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.428549:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654798208:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.428908:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.428919:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 14 pid: 12119 timeout: 1052 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.428998:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654798336:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.429070:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070041611/0x5c655bf66689daac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc099 expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.429084:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070041611/0x5c655bf66689daac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc099 expref: 11 pid: 29966 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.429097:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654798464:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562520.429128:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562520.429214:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.430483:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652639488 00000100:00100000:3.0:1786562520.430497:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652639488 00000100:00100000:3.0:1786562520.430574:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17267 00000100:00100000:3.0:1786562520.430587:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652639488:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562520.430620:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.430641:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689db9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc109 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.448652:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.449102:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.449340:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.449410:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652638720:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 44453us (78578us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.449427:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8404 00000100:00100000:0.0:1786562520.449468:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652639744 00000100:00100000:0.0:1786562520.449479:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652639744 00010000:00010000:0.0:1786562520.449519:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 15 pid: 12119 timeout: 1052 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.449556:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652639872 00000100:00100000:0.0:1786562520.449559:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652639872 00010000:00010000:0.0:1786562520.449574:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 30 pid: 12119 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.449593:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8407 00000100:00100000:0.0:1786562520.449618:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652639744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.449638:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.449672:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 15 pid: 12119 timeout: 1052 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.449685:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689db62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0df expref: 15 pid: 12119 timeout: 1052 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.449718:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.449741:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652639744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 125us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.449748:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8407 00000100:00100000:0.0:1786562520.449762:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8408 00000100:00100000:0.0:1786562520.449769:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652639872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.449778:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.449788:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 30 pid: 12119 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.449801:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002e577cf/0x5c655bf66689dadd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ae expref: 30 pid: 12119 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.449813:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.449831:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652639872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.449838:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8408 00000100:00100000:3.0:1786562520.461669:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654798720:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562520.461787:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562520.465572:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652639232:12345-192.168.204.29@tcp:3:cat.0 Request processed in 43917us (59102us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562520.465588:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11255 00002000:00100000:3.0:1786562520.465617:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88bf07480 x1873345652639232/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/440 e 0 to 0 dl 1786562531 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.465629:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07480 with x1873345652639232 ext(0->1048575) 00002000:00010000:3.0:1786562520.465636:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf07480 00002000:00010000:3.0:1786562520.475084:0:6659:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562515 -> 1786562518 00002000:00010000:3.0:1786562520.475090:0:6659:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime: 1786562513 -> 1786562519 00002000:00010000:3.0:1786562520.475092:0:6659:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562515 -> 1786562518 00000100:00100000:3.0:1786562520.475114:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654798720:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562520.475150:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689db9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc109 expref: 11 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.475182:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689db9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc109 expref: 11 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.475200:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9c00, rc 0) 00000100:00100000:3.0:1786562520.475302:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652639488:12345-192.168.204.29@tcp:101:cat.0 Request processed in 44717us (46087us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562520.475311:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17267 00000100:00100000:3.0:1786562520.488721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.488791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.489557:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652640000 00000100:00100000:0.0:1786562520.489562:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652640000 00000100:00100000:0.0:1786562520.489617:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16988 00000100:00100000:0.0:1786562520.489625:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63898:x1873345652640000:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562520.489645:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562520.489669:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dba8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc110 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.489768:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.489787:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.489797:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.489839:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.489853:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 9 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.489869:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654798848:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.489949:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.490227:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652639616:12345-192.168.204.29@tcp:3:cat.0 Request processed in 44755us (61499us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562520.490236:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11257 00002000:00100000:0.0:1786562520.490243:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88bf06300 x1873345652639616/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/440 e 0 to 0 dl 1786562531 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.490252:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf06300 with x1873345652639616 ext(1048576->2097151) 00002000:00010000:0.0:1786562520.490258:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf06300 00000100:00100000:0.0:1786562520.502094:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.502209:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.510543:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652640256 00000100:00100000:3.0:1786562520.510565:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652640256 00000100:00100000:0.0:1786562520.510963:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.511019:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652640512 00000100:00100000:0.0:1786562520.511023:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652640512 00010000:00010000:0.0:1786562520.511075:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 10 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.511119:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8409 00000100:00100000:0.0:1786562520.511131:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652640512:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.511150:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.511159:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 10 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.511173:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 10 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.511203:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562520.511210:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.511222:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.511231:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.511254:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.511320:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652640512:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 191us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.511329:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8409 00010000:00010000:3.0:1786562520.511466:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689db8c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0fb expref: 9 pid: 36756 timeout: 1052 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.511489:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654798848:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.511517:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.511528:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.511535:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562520.511603:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:3.0:1786562520.511610:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562520.511641:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.511681:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dba8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc110 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.511699:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc110 expref: 8 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.511708:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.511711:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562520.511713:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9c1e95400, rc 0) 00000100:00100000:3.0:1786562520.511761:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63898:x1873345652640000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 22137us (23055us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.511773:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16988 00000100:00100000:0.0:1786562520.533570:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.533624:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.550696:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652640384:12345-192.168.204.29@tcp:3:cat.0 Request processed in 29479us (48484us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1786562520.550711:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11259 00002000:00100000:3.0:1786562520.550730:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf5ca80 x1873345652640384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 504/440 e 0 to 0 dl 1786562531 ref 1 fl Complete:/600/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.550742:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ca80 with x1873345652640384 ext(1048576->2097151) 00002000:00010000:3.0:1786562520.550750:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5ca80 00000100:00100000:0.0:1786562520.556636:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.574546:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.574637:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.575954:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652641280 00000100:00100000:3.0:1786562520.575962:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652641280 00000100:00100000:3.0:1786562520.576041:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17270 00000100:00100000:3.0:1786562520.576051:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:63891:x1873345652641280:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562520.576064:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.576080:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc125 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.576111:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 8 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.576121:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=1s v=(1 1) 00010000:00010000:3.0:1786562520.576126:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1786562520.576131:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->2846719] (req 2097152->2846719) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.576174:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 8 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.576193:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 8 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.576211:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af309c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654799232:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562520.576301:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.585674:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652641664 00000100:00100000:0.0:1786562520.585687:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652641664 00002000:00100000:0.0:1786562520.585756:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (3756032->3760127) req@ffff90e9bfe93100 x1873345652641664/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:746/0 lens 488/0 e 0 to 0 dl 1786562531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.585770:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe93100 with x1873345652641664 ext(3756032->3760127) 00010000:00010000:0.0:1786562520.585783:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 9 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.585817:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 9 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562520.585826:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfe93100 00000100:00100000:0.0:1786562520.585864:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5872 00000100:00100000:0.0:1786562520.585876:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652641664:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562520.586375:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652641664:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 498us (840us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562520.586385:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5872 00002000:00100000:0.0:1786562520.586393:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (3756032->3760127) req@ffff90e9bfe93100 x1873345652641664/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:746/0 lens 488/4536 e 0 to 0 dl 1786562531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.586404:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe93100 with x1873345652641664 ext(3756032->3760127) 00010000:00010000:0.0:1786562520.586411:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 9 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.586425:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 9 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562520.586433:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfe93100 00000100:00100000:3.0:1786562520.601525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.601638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.652728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562520.660656:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.660784:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652642304 00000100:00100000:0.0:1786562520.660797:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652642304 00000100:00100000:0.0:1786562520.660871:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17272 00000100:00100000:0.0:1786562520.660884:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63893:x1873345652642304:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562520.660908:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562520.660933:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc13a expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.660976:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a0 expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.660988:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689db69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0e6 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.660996:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689dae4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0b5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.661063:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(1 1) 00010000:00010000:0.0:1786562520.661069:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562520.661076:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->3547135] (req 3145728->3547135) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc13a expref: 11 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.661120:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689dae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0b5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.661135:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689dae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0b5 expref: 11 pid: 8368 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.661151:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654799488:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562520.661255:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689db69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0e6 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.661265:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689db69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0e6 expref: 14 pid: 12119 timeout: 1053 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.661274:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654799616:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562520.661333:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a0 expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.661343:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a0 expref: 16 pid: 6660 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.661352:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654799744:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.661373:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.672760:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654799488:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562520.672780:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654799616:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.683556:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689dab3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0a0 expref: 17 pid: 6660 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.683570:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654799744:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562520.683621:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc13a expref: 10 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.683634:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881200, rc 0) 00000100:00100000:3.0:1786562520.683679:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63893:x1873345652642304:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 22798us (23039us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.683689:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17272 00000100:00100000:3.0:1786562520.710720:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b575180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654799872:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562520.710757:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562520.710848:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652642560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 27845us (28501us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562520.710863:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8413 00000100:00100000:0.0:1786562520.711218:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652642816 00000100:00100000:0.0:1786562520.711229:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652642816 00002000:00100000:0.0:1786562520.711292:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3543040->3547135) req@ffff90e88ac84a80 x1873345652642816/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:746/0 lens 488/0 e 0 to 0 dl 1786562531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.711305:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84a80 with x1873345652642816 ext(3543040->3547135) 00002000:00010000:0.0:1786562520.711311:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88ac84a80 00000100:00100000:0.0:1786562520.711356:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11260 00000100:00100000:0.0:1786562520.711368:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652642816:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562520.711610:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652642816:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 245us (1053us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562520.711618:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11260 00002000:00100000:0.0:1786562520.711624:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3543040->3547135) req@ffff90e88ac84a80 x1873345652642816/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:746/0 lens 488/4536 e 0 to 0 dl 1786562531 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.711633:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84a80 with x1873345652642816 ext(3543040->3547135) 00002000:00010000:0.0:1786562520.711637:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88ac84a80 00000100:00100000:3.0:1786562520.728430:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652643200 00000100:00100000:3.0:1786562520.728444:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652643200 00000100:00100000:3.0:1786562520.728525:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6207 00000100:00100000:3.0:1786562520.728537:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63893:x1873345652643200:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562520.728993:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63893:x1873345652643200:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 456us (663us total) trans 8589950508 rc 0/0 00000100:00100000:3.0:1786562520.729049:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6207 00000100:00100000:0.0:1786562520.729200:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652642944 00000100:00100000:0.0:1786562520.729206:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652642944 00010000:00010000:0.0:1786562520.729240:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 11 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.729294:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8414 00000100:00100000:0.0:1786562520.729303:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652642944:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.729320:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562520.729345:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562518 -> 1786562519 00002000:00010000:0.0:1786562520.729349:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562518 -> 1786562519 00010000:00010000:0.0:1786562520.729355:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 11 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.729371:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 11 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.729402:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689db93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3756032->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc102 expref: 11 pid: 28862 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.729422:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:0.0:1786562520.729427:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:0.0:1786562520.729437:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.729450:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.729505:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.729522:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x70000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 28 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.729538:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654800000:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562520.729629:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562520.741948:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654800000:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562520.741988:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562520.742108:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652642944:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12805us (13866us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562520.742124:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8414 00000100:00100000:0.0:1786562520.813068:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652643328 00000100:00100000:0.0:1786562520.813081:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652643328 00002000:00100000:0.0:1786562520.813152:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2842624->2846719) req@ffff90e9bfe91180 x1873345652643328/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/0 e 0 to 0 dl 1786562531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.813198:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91180 with x1873345652643328 ext(2842624->2846719) 00010000:00010000:0.0:1786562520.813219:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 29 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.813243:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 29 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562520.813253:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfe91180 00000100:00100000:0.0:1786562520.813294:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5874 00000100:00100000:0.0:1786562520.813308:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652643328:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562520.814286:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652643328:12345-192.168.204.29@tcp:3:cat.0 Request processed in 971us (1391us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562520.814299:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5874 00002000:00100000:0.0:1786562520.814310:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2842624->2846719) req@ffff90e9bfe91180 x1873345652643328/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/4536 e 0 to 0 dl 1786562531 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.814320:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91180 with x1873345652643328 ext(2842624->2846719) 00010000:00010000:0.0:1786562520.814329:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 29 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.814346:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 29 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562520.814354:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfe91180 00000100:00100000:3.0:1786562520.836897:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652643456 00000100:00100000:3.0:1786562520.836910:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652643456 00002000:00100000:3.0:1786562520.836979:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2846719) req@ffff90e9bfb5d500 x1873345652643456/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/0 e 0 to 0 dl 1786562531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.836994:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5d500 with x1873345652643456 ext(2097152->2846719) 00010000:00010000:3.0:1786562520.837054:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 29 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.837078:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 29 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562520.837088:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfb5d500 00000100:00100000:3.0:1786562520.837134:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5875 00000100:00100000:3.0:1786562520.837146:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652643456:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562520.866753:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652643968 00000100:00100000:3.0:1786562520.866768:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652643968 00000100:00100000:3.0:1786562520.866856:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16990 00000100:00100000:3.0:1786562520.866868:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63904:x1873345652643968:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562520.866902:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.866930:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689dbe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc141 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867081:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867099:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867114:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867132:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867140:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867147:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867613:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867626:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867634:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562520.867649:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562520.867769:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867778:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867785:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867793:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9c1e94400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562520.867798:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867805:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867820:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562520.867823:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562520.867828:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867834:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dbee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867849:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867855:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867867:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867872:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a99f1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562520.867875:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867882:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867890:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46abd00) 00010000:00010000:3.0:1786562520.867893:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562520.867896:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867901:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dbf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867957:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689dbe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc141 expref: 12 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867975:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc141 expref: 11 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.867983:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562520.867985:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562520.867988:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f0c00, rc 0) 00000100:00100000:3.0:1786562520.868112:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63904:x1873345652643968:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1245us (1724us total) trans 8589950510 rc 0/0 00000100:00100000:3.0:1786562520.868125:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16990 00000100:00100000:3.0:1786562520.898286:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17274 00000100:00100000:3.0:1786562520.898303:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652644096:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562520.898316:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562520.898331:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086d57c54/0x5c655bf66689dc11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc148 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562520.898374:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af309180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654800256:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562520.898426:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00002000:00010000:3.0:1786562520.915161:0:29967:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562519 -> 1786562520 00002000:00010000:3.0:1786562520.915167:0:29967:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562519 -> 1786562520 00000100:00100000:3.0:1786562520.915187:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af309180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654800256:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562520.915213:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086d57c54/0x5c655bf66689dc11 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc148 expref: 11 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.915231:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086d57c54/0x5c655bf66689dc11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc148 expref: 11 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.915242:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1c00, rc 0) 00000100:00100000:3.0:1786562520.915280:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652644096:12345-192.168.204.29@tcp:101:cat.0 Request processed in 16983us (18179us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562520.915289:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17274 00000100:00100000:3.0:1786562520.917472:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652643456:12345-192.168.204.29@tcp:4:cat.0 Request processed in 80314us (80824us total) trans 17179875963 rc 0/0 00000100:00100000:3.0:1786562520.917496:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5875 00002000:00100000:3.0:1786562520.917512:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2846719) req@ffff90e9bfb5d500 x1873345652643456/t17179875963(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/448 e 0 to 0 dl 1786562531 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562520.917524:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5d500 with x1873345652643456 ext(2097152->2846719) 00010000:00010000:3.0:1786562520.917537:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 31 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562520.917563:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 31 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562520.917572:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfb5d500 00000100:00100000:0.0:1786562520.939457:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652644352 00000100:00100000:0.0:1786562520.939471:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652644352 00010000:00010000:0.0:1786562520.939526:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 31 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.939594:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8415 00000100:00100000:0.0:1786562520.939608:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652644352:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562520.939631:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562520.939664:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 31 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.939688:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 31 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.939719:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689dbd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x44801000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc125 expref: 31 pid: 12119 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.939742:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:0.0:1786562520.939748:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:0.0:1786562520.939758:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 30 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.939770:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 30 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562520.939833:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 30 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562520.939862:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654800384:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562520.939975:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562520.963720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.963864:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652644480 00000100:00100000:0.0:1786562520.963878:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652644480 00002000:00100000:0.0:1786562520.963949:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e9af309180 x1873345652644480/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/0 e 0 to 0 dl 1786562531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.963962:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af309180 with x1873345652644480 ext(2097152->3145727) 00002000:00010000:0.0:1786562520.963970:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af309180 00000100:00100000:0.0:1786562520.964056:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11261 00000100:00100000:0.0:1786562520.964067:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652644480:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562520.984940:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562520.985344:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652644480:12345-192.168.204.29@tcp:3:cat.0 Request processed in 21276us (21638us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562520.985360:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11261 00002000:00100000:0.0:1786562520.985376:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e9af309180 x1873345652644480/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:746/0 lens 488/440 e 0 to 0 dl 1786562531 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562520.985388:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af309180 with x1873345652644480 ext(2097152->3145727) 00002000:00010000:0.0:1786562520.985396:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af309180 00000100:00100000:3.0:1786562521.001190:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11264 00000100:00100000:3.0:1786562521.001226:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652644864:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562521.013800:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.013923:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.015265:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652645376 00000100:00100000:0.0:1786562521.015283:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652645376 00010000:00010000:0.0:1786562521.015352:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc110 expref: 9 pid: 33115 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562521.015405:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8416 00000100:00100000:0.0:1786562521.015417:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2349:x1873345652645376:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562521.015436:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562521.015445:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc110 expref: 9 pid: 33115 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.015460:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dbaf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc110 expref: 9 pid: 33115 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.015488:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562521.015495:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.015505:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.015511:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562521.015598:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2349:x1873345652645376:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 171us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562521.015607:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8416 00000100:00100000:3.0:1786562521.041515:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.041573:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652645504 00000100:00100000:3.0:1786562521.041596:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652645504 00010000:00010000:3.0:1786562521.041648:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc141 expref: 13 pid: 35929 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.041689:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8417 00000100:00100000:3.0:1786562521.041699:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652645504:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562521.041719:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562521.041727:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc141 expref: 13 pid: 35929 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.041741:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dbfc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc141 expref: 13 pid: 35929 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.041768:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562521.041775:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.041786:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.041794:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.041817:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562521.041882:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652645504:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.041890:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8417 00000100:00100000:0.0:1786562521.049206:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:63897:x1873345652645248:12345-192.168.204.29@tcp:101:cat.0 Request processed in 31279us (35409us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562521.049224:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17275 00000100:00100000:3.0:1786562521.058088:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.097480:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652645760 00000100:00100000:3.0:1786562521.097501:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652645760 00010000:00010000:3.0:1786562521.097564:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc13a expref: 12 pid: 29662 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.097634:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8418 00000100:00100000:3.0:1786562521.097647:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652645760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562521.097667:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786562521.097694:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562518 -> 1786562520 00002000:00010000:3.0:1786562521.097698:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562518 -> 1786562520 00010000:00010000:3.0:1786562521.097705:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc13a expref: 12 pid: 29662 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.097720:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc13a expref: 12 pid: 29662 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.097750:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dbe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc13a expref: 12 pid: 29662 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.097772:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1786562521.097790:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1786562521.097802:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008abc1449/0x5c655bf66689dc26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc15d expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.097814:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008abc1449/0x5c655bf66689dc26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc15d expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.097867:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008abc1449/0x5c655bf66689dc26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc15d expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.097883:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654800896:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562521.098060:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562521.102194:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.150420:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.150541:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652646144 00000100:00100000:3.0:1786562521.150554:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652646144 00000100:00100000:3.0:1786562521.150643:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17276 00000100:00100000:3.0:1786562521.150656:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63904:x1873345652646144:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562521.150680:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562521.150704:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc16b expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.150745:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 29 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.150756:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786562521.150761:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562521.150767:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 11 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.150830:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 29 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.150846:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 29 pid: 37002 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.150865:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654801024:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562521.150981:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562521.159136:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654801024:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562521.159200:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 11 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.159233:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:3.0:1786562521.159334:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63904:x1873345652646144:12345-192.168.204.29@tcp:101:cat.0 Request processed in 8677us (8926us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.159348:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17276 00000100:00100000:0.0:1786562521.169195:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.203409:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.203462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.203515:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.204435:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11266 00000100:00100000:3.0:1786562521.204450:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652646528:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562521.205713:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11267 00000100:00100000:0.0:1786562521.205745:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652646656:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562521.236568:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.236685:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652646784 00000100:00100000:3.0:1786562521.236698:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652646784 00010000:00010000:3.0:1786562521.236751:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 34 pid: 37002 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.236805:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8419 00000100:00100000:3.0:1786562521.236818:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+34:2351:x1873345652646784:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562521.236847:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562521.236880:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 34 pid: 37002 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.236899:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 34 pid: 37002 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.236929:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689db7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0f4 expref: 34 pid: 37002 timeout: 1053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.236956:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562521.236962:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562521.236972:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.236983:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.237061:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.237079:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654801152:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562521.237181:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562521.248454:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654801152:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562521.248493:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562521.248565:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652646784:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11748us (12012us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.248593:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8419 00000100:00100000:3.0:1786562521.288467:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.288600:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652646912 00000100:00100000:0.0:1786562521.288614:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652646912 00002000:00100000:0.0:1786562521.288684:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9af308a80 x1873345652646912/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:747/0 lens 488/0 e 0 to 0 dl 1786562532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562521.288697:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af308a80 with x1873345652646912 ext(1048576->2097151) 00002000:00010000:0.0:1786562521.288704:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af308a80 00000100:00100000:0.0:1786562521.288746:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11268 00000100:00100000:0.0:1786562521.288758:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652646912:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562521.305703:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652646528:12345-192.168.204.29@tcp:3:cat.0 Request processed in 101240us (102222us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562521.305721:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11266 00002000:00100000:3.0:1786562521.305738:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e886c1c700 x1873345652646528/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:747/0 lens 488/440 e 0 to 0 dl 1786562532 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562521.305751:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e886c1c700 with x1873345652646528 ext(3145728->4194303) 00002000:00010000:3.0:1786562521.305759:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e886c1c700 00000100:00100000:0.0:1786562521.398551:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652647040 00000100:00100000:0.0:1786562521.398568:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652647040 00000100:00100000:0.0:1786562521.398674:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17277 00000100:00100000:0.0:1786562521.398689:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63904:x1873345652647040:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562521.398721:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562521.398748:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc172 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.398794:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:0.0:1786562521.398801:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:0.0:1786562521.398815:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.398855:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.398875:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1600, rc 0) 00000100:00100000:0.0:1786562521.398972:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63904:x1873345652647040:12345-192.168.204.29@tcp:101:cat.0 Request processed in 286us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562521.398981:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17277 00000100:00100000:3.0:1786562521.402756:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.403265:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652647168 00000100:00100000:0.0:1786562521.403289:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652647168 00000100:00100000:0.0:1786562521.403436:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17278 00000100:00100000:0.0:1786562521.403453:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652647168:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562521.403492:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562521.403531:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc179 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.403588:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562521.403595:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562521.403612:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc179 expref: 32 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.403638:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc179 expref: 32 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.403662:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1000, rc 0) 00000100:00100000:0.0:1786562521.403785:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652647168:12345-192.168.204.29@tcp:101:cat.0 Request processed in 336us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562521.403796:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17278 00000100:00100000:3.0:1786562521.439789:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.476679:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.517492:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.517737:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652647552 00000100:00100000:3.0:1786562521.517754:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652647552 00000100:00100000:3.0:1786562521.517865:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17279 00000100:00100000:3.0:1786562521.517879:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63904:x1873345652647552:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562521.517909:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562521.517938:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc180 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.517981:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1786562521.517987:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1786562521.517999:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc180 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.518075:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc180 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.518093:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268400, rc 0) 00000100:00100000:3.0:1786562521.518169:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63904:x1873345652647552:12345-192.168.204.29@tcp:101:cat.0 Request processed in 293us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.518177:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17279 00000100:00100000:3.0:1786562521.574630:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652647808 00000100:00100000:3.0:1786562521.574651:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652647808 00000100:00100000:3.0:1786562521.574740:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6209 00000100:00100000:3.0:1786562521.574752:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+506:63897:x1873345652647808:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562521.575152:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:63897:x1873345652647808:12345-192.168.204.29@tcp:35:cat.0 Request processed in 400us (18502us total) trans 8589950513 rc 0/0 00000100:00100000:3.0:1786562521.575160:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6209 00000100:00100000:0.0:1786562521.603280:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652647936 00000100:00100000:0.0:1786562521.603293:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652647936 00002000:00100000:0.0:1786562521.603364:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e9bfe90000 x1873345652647936/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:747/0 lens 488/0 e 0 to 0 dl 1786562532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562521.603377:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90000 with x1873345652647936 ext(2097152->3145727) 00002000:00010000:0.0:1786562521.603384:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe90000 00000100:00100000:0.0:1786562521.603425:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11271 00000100:00100000:0.0:1786562521.603436:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652647936:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562521.627493:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.636221:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652648064:12345-192.168.204.29@tcp:3:cat.0 Request processed in 21053us (21522us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562521.636233:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11272 00002000:00100000:3.0:1786562521.636243:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9bfe92d80 x1873345652648064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:747/0 lens 488/440 e 0 to 0 dl 1786562532 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562521.636253:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe92d80 with x1873345652648064 ext(3145728->4194303) 00002000:00010000:3.0:1786562521.636259:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe92d80 00000100:00100000:0.0:1786562521.724722:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.725058:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.752500:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652648448 00000100:00100000:3.0:1786562521.752520:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652648448 00000100:00100000:3.0:1786562521.787994:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654801280:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562521.788036:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654801408:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562521.788080:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2310144->3051519] (req 2310144->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 18 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.788105:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99822c000, rc 0) 00000100:00100000:3.0:1786562521.788131:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:63910:x1873345652648448:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 34214us (63074us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.788143:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17280 00000100:00100000:0.0:1786562521.793152:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.793867:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652648576 00000100:00100000:3.0:1786562521.793880:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652648576 00010000:00010000:3.0:1786562521.793930:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc180 expref: 12 pid: 37002 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.793981:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8420 00000100:00100000:3.0:1786562521.793991:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652648576:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562521.794030:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562521.794057:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc180 expref: 12 pid: 37002 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.794074:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc180 expref: 12 pid: 37002 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.794102:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689dc6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc180 expref: 12 pid: 37002 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.794124:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562521.794360:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652648576:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 369us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.794369:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8420 00000100:00100000:0.0:1786562521.809408:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.811071:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.822700:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652648960 00000100:00100000:3.0:1786562521.822710:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652648960 00002000:00100000:3.0:1786562521.822768:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x730:0x0] (2310144->2314239) req@ffff90e9bfe91880 x1873345652648960/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:747/0 lens 488/0 e 0 to 0 dl 1786562532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562521.822787:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91880 with x1873345652648960 ext(2310144->2314239) 00002000:00010000:3.0:1786562521.822794:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe91880 00000100:00100000:3.0:1786562521.822828:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11275 00000100:00100000:3.0:1786562521.822840:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652648960:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562521.823085:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652648960:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 247us (3039us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562521.823093:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11275 00002000:00100000:3.0:1786562521.823099:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x730:0x0] (2310144->2314239) req@ffff90e9bfe91880 x1873345652648960/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:747/0 lens 488/4536 e 0 to 0 dl 1786562532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562521.823108:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91880 with x1873345652648960 ext(2310144->2314239) 00002000:00010000:3.0:1786562521.823112:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe91880 00010000:00010000:0.0:1786562521.836174:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562521.857236:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652649216 00000100:00100000:0.0:1786562521.857250:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652649216 00000100:00100000:0.0:1786562521.857329:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6210 00000100:00100000:0.0:1786562521.857340:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63904:x1873345652649216:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1786562521.859171:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:63904:x1873345652649216:12345-192.168.204.29@tcp:35:cat.0 Request processed in 1821us (2100us total) trans 8589950514 rc 0/0 00000100:00100000:0.0:1786562521.859190:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6210 00000100:00100000:0.0:1786562521.890267:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.890520:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652649344 00000100:00100000:3.0:1786562521.890533:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652649344 00002000:00100000:3.0:1786562521.890613:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3047424->3051519) req@ffff90e889d49180 x1873345652649344/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:747/0 lens 488/0 e 0 to 0 dl 1786562532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562521.890625:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d49180 with x1873345652649344 ext(3047424->3051519) 00002000:00010000:3.0:1786562521.890631:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d49180 00000100:00100000:3.0:1786562521.890673:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11276 00000100:00100000:3.0:1786562521.890685:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652649344:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562521.890973:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652649344:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 290us (722us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562521.890982:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11276 00002000:00100000:3.0:1786562521.890991:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3047424->3051519) req@ffff90e889d49180 x1873345652649344/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:747/0 lens 488/4536 e 0 to 0 dl 1786562532 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562521.890999:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d49180 with x1873345652649344 ext(3047424->3051519) 00002000:00010000:3.0:1786562521.891041:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d49180 00000100:00100000:3.0:1786562521.898795:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652649600 00000100:00100000:3.0:1786562521.898810:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652649600 00000100:00100000:3.0:1786562521.898892:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6211 00000100:00100000:3.0:1786562521.898905:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:63910:x1873345652649600:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562521.899473:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+508:63910:x1873345652649600:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 568us (1359us total) trans 8589950515 rc 0/0 00000100:00100000:3.0:1786562521.899482:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6211 00000100:00100000:3.0:1786562521.940154:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.940221:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562521.940689:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652649856 00000100:00100000:0.0:1786562521.940694:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652649856 00000100:00100000:0.0:1786562521.940740:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16993 00000100:00100000:0.0:1786562521.940747:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+508:63914:x1873345652649856:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562521.940767:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562521.940793:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dc81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc195 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.940884:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.940902:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.940920:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.940939:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.940945:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.940952:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941442:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647600/0x5c655bf66689dc96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941456:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647600/0x5c655bf66689dc96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941463:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647600/0x5c655bf66689dc96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562521.941476:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562521.941619:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941628:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941635:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941643:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a99f0c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562521.941649:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941657:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941673:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562521.941677:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562521.941683:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941690:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689dc88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941703:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941710:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941715:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941721:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88c647000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562521.941723:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941730:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941737:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db000) 00010000:00010000:0.0:1786562521.941740:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562521.941743:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941748:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647000/0x5c655bf66689dc8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941797:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689dc81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc195 expref: 511 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941812:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647600/0x5c655bf66689dc96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc195 expref: 510 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.941819:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562521.941822:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786562521.941824:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647600, rc 0) 00000100:00100000:0.0:1786562521.941884:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+510:63914:x1873345652649856:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1136us (1745us total) trans 8589950516 rc 0/0 00000100:00100000:0.0:1786562521.941892:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16993 00000100:00100000:0.0:1786562521.947693:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.948483:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652650368 00000100:00100000:3.0:1786562521.948490:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652650368 00000100:00100000:3.0:1786562521.948532:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652650240 00000100:00100000:3.0:1786562521.948535:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652650240 00000100:00100000:3.0:1786562521.948562:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 421 00000100:00100000:3.0:1786562521.948581:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652650368:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562521.948622:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652650368:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.948629:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 421 00000100:00100000:3.0:1786562521.948642:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 422 00000100:00100000:3.0:1786562521.948648:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652650240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562521.948672:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652650240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562521.948679:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 422 00000100:00100000:0.0:1786562521.959461:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652650496 00000100:00100000:0.0:1786562521.959479:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652650496 00000100:00100000:0.0:1786562521.959594:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 947 00000100:00100000:0.0:1786562521.959610:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+510:2351:x1873345652650496:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562521.959634:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562521.959674:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647600/0x5c655bf66689dc96 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc195 expref: 510 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562521.959703:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562521.959711:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562521.959804:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+509:2351:x1873345652650496:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 197us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562521.959813:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 947 00000100:00100000:0.0:1786562521.987268:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562521.987426:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652650624 00000100:00100000:3.0:1786562521.987440:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652650624 00000100:00100000:3.0:1786562521.987515:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17282 00000100:00100000:3.0:1786562521.987529:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63907:x1873345652650624:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562521.987559:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562521.987599:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc19c expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987643:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987654:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987663:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689da82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc06f expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987685:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1786562521.987690:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562521.987696:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [1581056->2097151] (req 1581056->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987741:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689da82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc06f expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987772:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689da82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc06f expref: 16 pid: 6660 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.987790:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654801792:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562521.987921:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.987942:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.987953:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654801920:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562521.989285:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562521.989305:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 13 pid: 29662 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562521.989319:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654802048:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562522.004409:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 10 seconds 00010000:00010000:3.0:1786562522.008183:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689da82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc06f expref: 16 pid: 6660 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.008214:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654801792:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562522.008349:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654801920:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562522.008970:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654802048:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562522.009027:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1581056->2097151] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.009049:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f6000, rc 0) 00000100:00100000:3.0:1786562522.009102:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63907:x1873345652650624:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 21576us (21849us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.009113:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17282 00000100:00080000:3.0:1786562522.009260:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562522.011146:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.011205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.011262:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652651008 00000100:00100000:3.0:1786562522.011273:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652651008 00010000:00010000:3.0:1786562522.011323:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.011359:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652651136 00000100:00100000:3.0:1786562522.011362:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652651136 00010000:00010000:3.0:1786562522.011387:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 14 pid: 29662 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.011409:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8423 00000100:00100000:3.0:1786562522.011421:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652651008:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562522.011442:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.011474:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011488:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011516:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689da89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc07d expref: 12 pid: 12119 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011541:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562522.011608:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652651008:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 189us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.011616:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8423 00000100:00100000:3.0:1786562522.011635:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8424 00000100:00100000:3.0:1786562522.011642:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652651136:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562522.011650:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.011660:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 14 pid: 29662 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011671:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 14 pid: 29662 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011686:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa2457f6/0x5c655bf66689d821 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf73 expref: 14 pid: 29662 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011699:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562522.011704:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562522.011714:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.011726:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562522.011900:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786562522.014899:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.014937:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654802176:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562522.036744:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.044055:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652650752:12345-192.168.204.29@tcp:3:cat.0 Request processed in 38644us (39171us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562522.044079:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11277 00002000:00100000:0.0:1786562522.044106:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e884114e00 x1873345652650752/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/440 e 0 to 0 dl 1786562533 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562522.044120:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884114e00 with x1873345652650752 ext(1048576->2097151) 00002000:00010000:0.0:1786562522.044132:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884114e00 00000100:00100000:3.0:1786562522.077949:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562522.085174:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 13 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.085191:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 13 pid: 28861 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.085202:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884116680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654802432:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562522.085229:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9834e1780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.098097:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884116d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654802304:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562522.098120:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884116680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654802432:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562522.098166:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1048576->1503231] (req 1048576->1503231) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 13 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.098196:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068c400, rc 0) 00000100:00100000:1.0:1786562522.098291:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:63907:x1873345652651392:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 13523us (20357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562522.098312:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17283 00000100:00100000:3.0:1786562522.098405:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652651520 00000100:00100000:3.0:1786562522.098414:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652651520 00010000:00010000:3.0:1786562522.098461:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 13 pid: 28861 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.098506:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8425 00000100:00100000:3.0:1786562522.098517:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652651520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562522.098534:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.098578:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 13 pid: 28861 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.098592:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 13 pid: 28861 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.098627:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689dc57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc16b expref: 13 pid: 28861 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.098644:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562522.098666:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652651520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 151us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.098673:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8425 00000100:00100000:0.0:1786562522.106386:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.106671:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652651648 00000100:00100000:3.0:1786562522.106685:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652651648 00010000:00010000:3.0:1786562522.106744:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc179 expref: 32 pid: 6660 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.106802:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8426 00000100:00100000:3.0:1786562522.106816:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652651648:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562522.106846:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.106881:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc179 expref: 32 pid: 6660 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.106898:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc179 expref: 32 pid: 6660 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.106927:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5fafc6/0x5c655bf66689dc65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc179 expref: 32 pid: 6660 timeout: 1054 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.106955:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562522.106961:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562522.106973:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.106984:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.107096:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.107115:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654802560:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562522.107222:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562522.126722:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.126818:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.127165:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654802560:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562522.127196:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562522.127273:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652651648:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 20460us (20906us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.127284:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8426 00000100:00100000:1.0:1786562522.128303:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652651904 00000100:00100000:1.0:1786562522.128312:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652651904 00002000:00100000:1.0:1786562522.128347:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3887104->4194303) req@ffff90e889d4aa00 x1873345652651904/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/0 e 0 to 0 dl 1786562533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562522.128358:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4aa00 with x1873345652651904 ext(3887104->4194303) 00002000:00010000:1.0:1786562522.128363:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d4aa00 00000100:00100000:1.0:1786562522.128393:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11280 00000100:00100000:1.0:1786562522.128402:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652651904:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562522.156429:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652651904:12345-192.168.204.29@tcp:3:cat.0 Request processed in 28011us (29594us total) trans 0 rc 307200/307200 00000100:00100000:1.0:1786562522.156447:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11280 00002000:00100000:1.0:1786562522.156465:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3887104->4194303) req@ffff90e889d4aa00 x1873345652651904/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/440 e 0 to 0 dl 1786562533 ref 1 fl Complete:/600/0 rc 307200/307200 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562522.156477:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4aa00 with x1873345652651904 ext(3887104->4194303) 00002000:00010000:1.0:1786562522.156486:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d4aa00 00000100:00100000:0.0:1786562522.180945:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.210131:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.210188:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.210437:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652652160 00000100:00100000:3.0:1786562522.210450:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652652160 00000100:00100000:3.0:1786562522.210515:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652652288 00000100:00100000:3.0:1786562522.210518:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652652288 00000100:00100000:3.0:1786562522.210550:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17284 00000100:00100000:3.0:1786562522.210571:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652652160:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562522.210596:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.210620:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689dcb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1aa expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.210694:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654802688:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562522.210788:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00002000:00010000:3.0:1786562522.232679:0:37002:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562514 -> 1786562521 00002000:00010000:3.0:1786562522.232693:0:37002:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562513 -> 1786562521 00002000:00010000:3.0:1786562522.232696:0:37002:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562514 -> 1786562521 00000100:00100000:3.0:1786562522.232729:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654802688:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562522.232777:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689dcb2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1aa expref: 17 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.232803:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689dcb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1aa expref: 17 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.232818:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92d600, rc 0) 00000100:00100000:3.0:1786562522.232895:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652652160:12345-192.168.204.29@tcp:101:cat.0 Request processed in 22333us (22778us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562522.232909:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17284 00000100:00100000:1.0:1786562522.237175:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652652544 00000100:00100000:1.0:1786562522.237198:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652652544 00000100:00100000:1.0:1786562522.237290:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16994 00000100:00100000:1.0:1786562522.237313:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:63922:x1873345652652544:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562522.237347:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.237376:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689dcc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1b8 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.237475:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.237491:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.237505:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.237523:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.237530:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.237538:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786562522.237795:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562522.243216:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689dcd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243263:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689dcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243298:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689dcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562522.243338:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562522.243594:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243603:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243626:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243632:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9c1e95400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562522.243648:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243656:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243681:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562522.243685:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562522.243710:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.243717:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95400/0x5c655bf66689dcc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248648:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248659:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248680:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248688:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9c1e94400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562522.248708:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248716:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248760:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562522.248764:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562522.248769:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248776:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94400/0x5c655bf66689dcce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248938:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689dcc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1b8 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248990:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689dcd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1b8 expref: 15 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.248998:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562522.249001:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562522.249029:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfd5a800, rc 0) 00000100:00100000:1.0:1786562522.249999:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:63922:x1873345652652544:12345-192.168.204.29@tcp:101:cat.0 Request processed in 12674us (12997us total) trans 8589950517 rc 0/0 00000100:00100000:1.0:1786562522.250055:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16994 00000100:00100000:3.0:1786562522.271693:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.271753:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652652672 00000100:00100000:3.0:1786562522.271779:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652652672 00000100:00100000:1.0:1786562522.272119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.272234:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.272373:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652653056 00000100:00100000:1.0:1786562522.272396:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652653056 00000100:00100000:1.0:1786562522.272611:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16995 00000100:00100000:1.0:1786562522.272638:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+509:63920:x1873345652653056:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562522.272688:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.272749:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689dce3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1cd expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.272972:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.272995:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.273047:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.273075:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.273096:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.273104:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.273451:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652652800 00000100:00100000:3.0:1786562522.273462:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652652800 00000100:00100000:3.0:1786562522.273512:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17286 00000100:00100000:3.0:1786562522.273524:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652652672:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562522.273543:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.273574:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689dcf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1bf expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.273653:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654802944:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562522.273776:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562522.273809:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17287 00000100:00100000:3.0:1786562522.273819:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652652800:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562522.273830:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.273844:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689dcff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1c6 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.273880:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654803072:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562522.273906:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1840 going to sleep for 11 seconds 00000100:00080000:3.0:1786562522.273925:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562522.273945:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689dd06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.273961:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.273984:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562522.273995:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562522.274199:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274234:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274255:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274262:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562522.274275:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274288:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274313:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562522.274316:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562522.274338:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274344:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689dcea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274394:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274401:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274406:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274434:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562522.274453:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274469:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274477:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2a00) 00010000:00010000:1.0:1786562522.274498:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562522.274501:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274518:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689dcf1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274600:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689dce3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1cd expref: 512 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274615:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689dd06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1cd expref: 511 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.274644:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562522.274646:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562522.274661:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880400, rc 0) 00000100:00100000:1.0:1786562522.274765:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+511:63920:x1873345652653056:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 2131us (2668us total) trans 8589950518 rc 0/0 00000100:00100000:1.0:1786562522.274812:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16995 00000100:00100000:1.0:1786562522.283478:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654803072:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562522.283533:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689dcff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1c6 expref: 32 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.288198:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689dcff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1c6 expref: 32 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.288274:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261c400, rc 0) 00000100:00100000:3.0:1786562522.288437:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654802944:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562522.288477:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652652800:12345-192.168.204.29@tcp:101:cat.0 Request processed in 14647us (16251us total) trans 0 rc 301/301 00010000:00010000:3.0:1786562522.288505:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689dcf8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1bf expref: 17 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.288532:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17287 00010000:00010000:3.0:1786562522.288543:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689dcf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1bf expref: 17 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.288571:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92c600, rc 0) 00000100:00100000:3.0:1786562522.288632:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652652672:12345-192.168.204.29@tcp:101:cat.0 Request processed in 15110us (16964us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562522.288641:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17286 00000100:00100000:0.0:1786562522.289994:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.290456:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652653184 00000100:00100000:3.0:1786562522.290469:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652653184 00000100:00100000:3.0:1786562522.290544:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17288 00000100:00100000:3.0:1786562522.290556:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652653184:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562522.290591:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.290612:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dd14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1d4 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.290684:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654803200:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562522.290786:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562522.291922:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.296547:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652653312 00000100:00100000:3.0:1786562522.296578:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652653312 00000100:00100000:3.0:1786562522.296681:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 948 00000100:00100000:3.0:1786562522.296692:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+511:2350:x1873345652653312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562522.296711:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.296744:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689dd06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1cd expref: 511 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.296772:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562522.296779:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562522.296855:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+510:2350:x1873345652653312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 165us (4941us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.296865:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 948 00002000:00010000:3.0:1786562522.306677:0:29965:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562520 -> 1786562521 00000100:00100000:3.0:1786562522.306724:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654803200:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562522.306794:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dd14 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1d4 expref: 12 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.306830:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dd14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1d4 expref: 12 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.306868:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:3.0:1786562522.307103:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652653184:12345-192.168.204.29@tcp:101:cat.0 Request processed in 16548us (17115us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562522.307116:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17288 00000100:00100000:0.0:1786562522.313051:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.313479:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652653568 00000100:00100000:3.0:1786562522.313497:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652653568 00000100:00100000:3.0:1786562522.313588:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6212 00000100:00100000:3.0:1786562522.313604:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+510:63914:x1873345652653568:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562522.313955:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+511:63914:x1873345652653568:12345-192.168.204.29@tcp:35:cat.0 Request processed in 354us (950us total) trans 8589950519 rc 0/0 00000100:00100000:3.0:1786562522.313964:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6212 00000100:00100000:0.0:1786562522.362687:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.364245:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.427960:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.428162:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652653952 00000100:00100000:0.0:1786562522.428172:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652653952 00000100:00100000:0.0:1786562522.428250:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17289 00000100:00100000:0.0:1786562522.428261:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63922:x1873345652653952:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562522.428282:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562522.428303:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1db expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.428337:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.428348:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1786562522.428353:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 1) 00010000:00010000:0.0:1786562522.428359:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.428403:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.428418:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 15 pid: 6659 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.428447:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654803328:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562522.428546:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.437518:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.441862:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.455617:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.455662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.459393:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652654720 00000100:00100000:1.0:1786562522.459407:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652654720 00000100:00100000:1.0:1786562522.459486:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 949 00000100:00100000:1.0:1786562522.459497:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2350:x1873345652654720:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562522.459514:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562522.459540:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689dd37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e2 expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.459575:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562522.459581:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562522.459628:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652654720:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 132us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562522.459636:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 949 00000100:00100000:1.0:1786562522.491165:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.491392:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652654848 00000100:00100000:0.0:1786562522.491407:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652654848 00010000:00010000:0.0:1786562522.491458:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 18 pid: 6659 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.491515:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8427 00000100:00100000:0.0:1786562522.491525:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652654848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562522.491540:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562522.491576:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 18 pid: 6659 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.491590:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 18 pid: 6659 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.491612:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689dc73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2310144->3051519) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc187 expref: 18 pid: 6659 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.491630:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 1) 00010000:00010000:0.0:1786562522.491634:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 1) 00010000:00010000:0.0:1786562522.491642:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.491653:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.491703:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.491718:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654803456:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562522.491930:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.515401:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.525124:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.527294:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652655232 00000100:00100000:3.0:1786562522.527308:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652655232 00000100:00100000:3.0:1786562522.527416:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17290 00000100:00100000:3.0:1786562522.527426:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:63920:x1873345652655232:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562522.527445:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.527463:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1e9 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.527492:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 13 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.527502:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562522.527506:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562522.527511:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1937408->2097151] (req 1937408->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 18 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.527545:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 13 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.527569:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 13 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.527583:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654803584:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562522.527667:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.528867:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.533257:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652655104 00000100:00100000:3.0:1786562522.533273:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652655104 00002000:00100000:3.0:1786562522.533330:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e98873c380 x1873345652655104/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:748/0 lens 488/0 e 0 to 0 dl 1786562533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562522.533343:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c380 with x1873345652655104 ext(3145728->4194303) 00002000:00010000:3.0:1786562522.533350:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873c380 00000100:00100000:3.0:1786562522.533379:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11285 00000100:00100000:3.0:1786562522.533390:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652655104:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562522.539078:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.539131:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652655360 00000100:00100000:1.0:1786562522.539140:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652655360 00002000:00100000:1.0:1786562522.539185:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1581056->2097151) req@ffff90e9a99f9c00 x1873345652655360/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:748/0 lens 488/0 e 0 to 0 dl 1786562533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562522.539197:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f9c00 with x1873345652655360 ext(1581056->2097151) 00010000:00010000:1.0:1786562522.539206:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 14 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.539223:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 14 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562522.539232:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9a99f9c00 00000100:00100000:1.0:1786562522.539256:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5879 00000100:00100000:1.0:1786562522.539266:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652655360:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:3.0:1786562522.542058:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654803584:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562522.542098:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1937408->2097151] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 18 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.542119:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9864c0a00, rc 0) 00000100:00100000:3.0:1786562522.542174:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:63920:x1873345652655232:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 14749us (17058us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.542184:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17290 00000100:00100000:0.0:1786562522.557927:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652655360:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 18651us (18846us total) trans 21474843496 rc 0/0 00000100:00100000:0.0:1786562522.557942:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5879 00002000:00100000:0.0:1786562522.557956:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1581056->2097151) req@ffff90e9a99f9c00 x1873345652655360/t21474843496(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:748/0 lens 488/448 e 0 to 0 dl 1786562533 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562522.557966:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f9c00 with x1873345652655360 ext(1581056->2097151) 00010000:00010000:0.0:1786562522.557975:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 16 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.557992:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 16 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562522.558000:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9a99f9c00 00000100:00100000:1.0:1786562522.608657:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.608789:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652655616 00000100:00100000:3.0:1786562522.608803:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652655616 00010000:00010000:3.0:1786562522.608877:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 16 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.608936:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8428 00000100:00100000:3.0:1786562522.608948:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652655616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562522.608968:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.609003:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 16 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.609061:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 16 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.609103:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689dca4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc19c expref: 16 pid: 29964 timeout: 1054 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.609126:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1786562522.609131:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562522.609141:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.609154:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.609202:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.609221:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654803712:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562522.609328:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562522.629531:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654803712:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562522.629581:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562522.637361:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.637969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.639904:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16998 00000100:00100000:3.0:1786562522.639917:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:63931:x1873345652656256:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562522.639931:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.639941:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1c00/0x5c655bf66689dd6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1fe expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.639988:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.639998:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640026:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640041:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640047:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640054:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640302:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689dd84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640312:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689dd84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640319:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689dd84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562522.640326:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562522.640380:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640392:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640398:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640403:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9864c1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562522.640407:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640413:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640421:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562522.640424:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562522.640427:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640431:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689dd76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640440:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640446:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640451:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640455:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562522.640459:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640464:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640470:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab000) 00010000:00010000:3.0:1786562522.640472:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562522.640474:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640479:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689dd7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640509:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1c00/0x5c655bf66689dd6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1fe expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640520:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689dd84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1fe expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.640526:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562522.640528:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562522.640530:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:3.0:1786562522.640570:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63931:x1873345652656256:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 657us (2601us total) trans 8589950523 rc 0/0 00000100:00100000:3.0:1786562522.640578:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16998 00000100:00100000:0.0:1786562522.641078:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652655616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 32121us (32425us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562522.641095:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8428 00000100:00100000:1.0:1786562522.647070:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.647156:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.647263:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652656000 00000100:00100000:0.0:1786562522.647275:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652656000 00000100:00100000:0.0:1786562522.647346:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17291 00000100:00100000:0.0:1786562522.647358:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652656000:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562522.647381:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562522.647405:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090feda1a/0x5c655bf66689dd92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc1f7 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.647489:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654803840:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562522.647599:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1d5780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562522.650268:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652655872 00000100:00100000:3.0:1786562522.650284:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652655872 00002000:00100000:3.0:1786562522.650348:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1937408->1941503) req@ffff90e9a99f8000 x1873345652655872/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/0 e 0 to 0 dl 1786562533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562522.650366:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8000 with x1873345652655872 ext(1937408->1941503) 00002000:00010000:3.0:1786562522.650372:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99f8000 00000100:00100000:3.0:1786562522.650424:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11286 00000100:00100000:3.0:1786562522.650434:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652655872:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562522.650998:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652655872:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 564us (3936us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562522.651028:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11286 00002000:00100000:3.0:1786562522.651037:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1937408->1941503) req@ffff90e9a99f8000 x1873345652655872/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/4536 e 0 to 0 dl 1786562533 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562522.651045:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8000 with x1873345652655872 ext(1937408->1941503) 00002000:00010000:3.0:1786562522.651049:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99f8000 00000100:00100000:0.0:1786562522.657251:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.657350:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652656384 00000100:00100000:1.0:1786562522.657359:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652656384 00000100:00100000:1.0:1786562522.657414:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 950 00000100:00100000:1.0:1786562522.657422:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:2349:x1873345652656384:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562522.657436:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562522.657459:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689dd84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1fe expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.657479:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562522.657484:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562522.657528:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2349:x1873345652656384:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562522.657535:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 950 00000100:00100000:1.0:1786562522.657602:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.657662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.660892:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.660929:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.661002:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652656640 00000100:00100000:1.0:1786562522.661029:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652656640 00000100:00100000:1.0:1786562522.661084:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6214 00000100:00100000:1.0:1786562522.661094:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:63931:x1873345652656640:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562522.661341:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63931:x1873345652656640:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 246us (3737us total) trans 8589950524 rc 0/0 00000100:00100000:1.0:1786562522.661349:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6214 00000100:00100000:3.0:1786562522.661460:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652657024 00000100:00100000:1.0:1786562522.661470:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652656768 00000100:00100000:3.0:1786562522.661475:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652657024 00000100:00100000:1.0:1786562522.661479:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652656768 00000100:00100000:1.0:1786562522.661518:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652656896 00000100:00100000:1.0:1786562522.661521:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652656896 00000100:00100000:1.0:1786562522.661548:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17292 00000100:00100000:1.0:1786562522.661569:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652656768:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562522.661580:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.661604:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075eb5e7d/0x5c655bf66689dd99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc205 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.661641:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 951 00000100:00100000:3.0:1786562522.661656:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+513:2348:x1873345652657024:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1786562522.661669:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654803968:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562522.661736:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9834e1780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.661759:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17293 00000100:00100000:1.0:1786562522.661768:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652656896:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562522.661776:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.661787:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc20c expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.661810:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(3 1) 00010000:00010000:1.0:1786562522.661814:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 1) 00010000:00010000:1.0:1786562522.661824:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 19 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.661840:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 19 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.661851:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99cd81400, rc 0) 00000100:00100000:1.0:1786562522.661873:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652656896:12345-192.168.204.29@tcp:101:cat.0 Request processed in 107us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562522.661880:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17293 00000100:00100000:1.0:1786562522.662040:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654803840:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562522.662070:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090feda1a/0x5c655bf66689dd92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1f7 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.662100:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090feda1a/0x5c655bf66689dd92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1f7 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.662111:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e800, rc 0) 00000100:00100000:1.0:1786562522.662138:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652656000:12345-192.168.204.29@tcp:101:cat.0 Request processed in 14783us (14981us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562522.662144:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17291 00010000:00010000:3.0:1786562522.662980:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562522.663030:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22200/0x5c655bf66689dd61 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1f0 expref: 513 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.663054:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562522.663061:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562522.663128:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+512:2348:x1873345652657024:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1476us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.663142:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 951 00000100:00100000:0.0:1786562522.671804:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.671879:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.671969:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652657408 00000100:00100000:3.0:1786562522.671985:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652657408 00000100:00100000:3.0:1786562522.672107:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17294 00000100:00100000:3.0:1786562522.672123:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+33:63920:x1873345652657408:12345-192.168.204.29@tcp:101:multiop.0 00000100:00100000:1.0:1786562522.672132:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652657280 00000100:00100000:1.0:1786562522.672144:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652657280 00010000:00010000:3.0:1786562522.672151:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.672183:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc21a expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.672206:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16999 00000100:00100000:1.0:1786562522.672218:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63931:x1873345652657280:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562522.672230:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672240:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.672243:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1786562522.672245:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1786562522.672251:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562522.672261:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1048576->1593343] (req 1048576->1593343) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 34 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672281:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689dcd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1b8 expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.672314:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672314:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689db1c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0ca expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672367:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562522.672370:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 11 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672376:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562522.672394:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689ddae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc213 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.672395:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654804096:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562522.672469:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672485:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672497:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672506:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.672512:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1786562522.672544:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672569:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 511 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.672584:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804224:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562522.672659:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.672669:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 511 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.672691:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804352:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562522.672716:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882dde40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562522.687043:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652657536 00000100:00100000:3.0:1786562522.687055:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652657536 00000100:00100000:3.0:1786562522.687128:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17000 00000100:00100000:3.0:1786562522.687140:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63922:x1873345652657536:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562522.687173:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562522.687201:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc221 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.687280:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.687292:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 4/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.687313:0:35929:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.687327:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.687344:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562522.687347:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562522.687350:0:35929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.687357:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:3.0:1786562522.687431:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+20:63922:x1873345652657536:12345-192.168.204.29@tcp:101:cat.0 Request processed in 293us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.687440:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17000 00000100:00100000:0.0:1786562522.696094:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.696131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.696178:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652657792 00000100:00100000:0.0:1786562522.696189:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652657792 00010000:00010000:0.0:1786562522.696236:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.696297:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8429 00000100:00100000:0.0:1786562522.696312:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+512:2348:x1873345652657792:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562522.696327:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562522.696340:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.696370:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.696398:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562522.696405:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.696427:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.696436:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562522.696487:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+512:2348:x1873345652657792:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562522.696494:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8429 00000100:00100000:0.0:1786562522.696564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.696642:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.696931:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652657920 00000100:00100000:1.0:1786562522.696937:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652657920 00010000:00010000:1.0:1786562522.696956:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.696987:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8430 00000100:00100000:1.0:1786562522.696995:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+512:2348:x1873345652657920:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562522.697037:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562522.697043:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.697055:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.697072:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562522.697077:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.697087:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.697096:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.697106:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 19 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.697116:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658048 00000100:00100000:3.0:1786562522.697125:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658048 00010000:00010000:1.0:1786562522.697126:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562522.697175:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+513:2348:x1873345652657920:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 180us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562522.697183:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8430 00000100:00100000:3.0:1786562522.697234:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17001 00000100:00100000:3.0:1786562522.697248:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+512:63930:x1873345652658048:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562522.697269:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.697276:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261de00/0x5c655bf66689dc49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc164 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.697295:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc228 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.697297:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804224:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562522.697323:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689db15 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc0c3 expref: 512 pid: 33115 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.697334:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804352:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562522.697354:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.697443:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.697619:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654804096:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562522.697643:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->1593343] (req 1048576->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 32 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.697661:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:0.0:1786562522.697700:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+32:63920:x1873345652657408:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 25583us (25820us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562522.697708:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17294 00010000:00010000:1.0:1786562522.701348:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.701368:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.706260:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.706292:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562522.706297:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562522.706305:0:33115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 19 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.706319:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:3.0:1786562522.706422:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+511:63930:x1873345652658048:12345-192.168.204.29@tcp:101:cat.0 Request processed in 9177us (9778us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.706434:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17001 00000040:00080000:0.0:1786562522.709676:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4343, 88 off352432 00000004:00080000:0.0:1786562522.709693:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955151686891ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.711874:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4323, 88 off350488 00000004:00080000:0.0:1786562522.711890:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955153884171ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.711934:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4324, 88 off350576 00000004:00080000:0.0:1786562522.711939:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955153933321ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.711961:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4344, 88 off352520 00000004:00080000:0.0:1786562522.711966:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955153960366ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.711989:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4345, 88 off352608 00000004:00080000:0.0:1786562522.711993:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955153987440ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.713346:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4325, 88 off350664 00000004:00080000:0.0:1786562522.713358:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955155351914ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.714213:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4326, 88 off350752 00000004:00080000:0.0:1786562522.714222:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955156216240ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.714257:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4327, 88 off350840 00000004:00080000:0.0:1786562522.714261:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955156255617ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.714280:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4346, 88 off352696 00000004:00080000:0.0:1786562522.714284:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955156278480ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.714317:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4328, 88 off350928 00000004:00080000:0.0:1786562522.714322:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955156316254ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.714339:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4347, 88 off352784 00000004:00080000:0.0:1786562522.714343:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955156336912ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.714362:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4329, 88 off351016 00000004:00080000:0.0:1786562522.714367:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955156361381ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562522.714577:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4348, 88 off352872 00000004:00080000:0.0:1786562522.714584:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955156577829ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.714611:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4349, 88 off352960 00000004:00080000:0.0:1786562522.714616:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955156609851ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.714631:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4350, 88 off353048 00000004:00080000:0.0:1786562522.714635:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955156629434ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.714649:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4351, 88 off353136 00000004:00080000:0.0:1786562522.714653:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955156647157ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562522.714667:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4330, 88 off351104 00000004:00080000:0.0:1786562522.714670:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 955156664369ns, next at 911624464511ns, rc = 0 00000100:00100000:3.0:1786562522.739519:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652657664:12345-192.168.204.29@tcp:4:cat.0 Request processed in 43096us (43414us total) trans 17179875965 rc 0/0 00000100:00100000:3.0:1786562522.739539:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5880 00002000:00100000:3.0:1786562522.739570:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x713:0x0] (1048576->1503231) req@ffff90e88b519180 x1873345652657664/t17179875965(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:748/0 lens 488/448 e 0 to 0 dl 1786562533 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562522.739583:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519180 with x1873345652657664 ext(1048576->1503231) 00010000:00010000:3.0:1786562522.739599:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 14 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.739620:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 14 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562522.739630:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b519180 00000100:00100000:1.0:1786562522.764357:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658176 00000100:00100000:1.0:1786562522.764371:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658176 00010000:00010000:1.0:1786562522.764426:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 14 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.764474:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8431 00000100:00100000:1.0:1786562522.764486:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652658176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562522.764507:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562522.764539:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 14 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.764566:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 14 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.764603:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689dcab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1503231) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1a3 expref: 14 pid: 8368 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.764621:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562522.764626:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562522.764635:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.764647:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.765097:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.765118:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654804480:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562522.765233:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a9a3e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.771480:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654804480:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562522.771513:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562522.771590:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652658176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 7105us (7344us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562522.771604:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8431 00000001:00080000:3.0:1786562522.823285:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950525 is committed 00000004:00080000:3.0:1786562522.823302:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2839 committed 00000004:00080000:3.0:1786562522.823314:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2861 committed 00000004:00080000:3.0:1786562522.823320:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2860 committed 00000004:00080000:3.0:1786562522.823323:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2859 committed 00000004:00080000:3.0:1786562522.823325:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2858 committed 00000004:00080000:3.0:1786562522.823327:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2838 committed 00000004:00080000:3.0:1786562522.823329:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2857 committed 00000004:00080000:3.0:1786562522.823331:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2837 committed 00000004:00080000:3.0:1786562522.823333:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2856 committed 00000004:00080000:3.0:1786562522.823335:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2836 committed 00000004:00080000:3.0:1786562522.823337:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2835 committed 00000004:00080000:3.0:1786562522.823339:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2834 committed 00000004:00080000:3.0:1786562522.823340:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2855 committed 00000004:00080000:3.0:1786562522.823342:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2854 committed 00000004:00080000:3.0:1786562522.823344:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2833 committed 00000004:00080000:3.0:1786562522.823346:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2832 committed 00000004:00080000:3.0:1786562522.823348:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2853 committed 00000001:00080000:3.0:1786562522.823355:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950516 is committed 00000001:00080000:3.0:1786562522.823369:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950518 is committed 00010000:00010000:1.0:1786562522.823681:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 17 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823700:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562522.823703:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1786562522.823708:0:34450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823721:0:34450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823735:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823744:0:34450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 508 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823751:0:34450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 508 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823758:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 508 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.823826:0:34450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 508 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.823849:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804608:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562522.823992:0:34450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.824028:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804736:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562522.824056:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff40000 going to sleep for 11 seconds 00000001:00080000:3.0:1786562522.824532:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950507 is committed 00000001:00080000:3.0:1786562522.824562:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950522 is committed 00000100:00100000:1.0:1786562522.826136:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654804864 00000100:00100000:1.0:1786562522.826150:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654804864 00000100:00100000:1.0:1786562522.826253:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17295 00000100:00100000:1.0:1786562522.826265:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3290:x1873345654804864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562522.826562:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562522.826567:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562514 -> 1786562514 00002000:00010000:1.0:1786562522.826570:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562513 -> 1786562513 00002000:00010000:1.0:1786562522.826573:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562514 -> 1786562514 00002000:00010000:1.0:1786562522.826575:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00080000:0.0:1786562522.832206:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562522.836671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.836768:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.836804:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658304 00000100:00100000:0.0:1786562522.836827:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658304 00000100:00100000:0.0:1786562522.836883:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658432 00000100:00100000:0.0:1786562522.836886:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658432 00000100:00100000:0.0:1786562522.836910:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6215 00000100:00100000:0.0:1786562522.836921:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63922:x1873345652658304:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:0.0:1786562522.837130:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63922:x1873345652658304:12345-192.168.204.29@tcp:49:cat.0 Request processed in 210us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562522.837140:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6215 00000100:00100000:0.0:1786562522.837161:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6216 00000100:00100000:0.0:1786562522.837358:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+502:63930:x1873345652658432:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:0.0:1786562522.837430:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+502:63930:x1873345652658432:12345-192.168.204.29@tcp:49:cat.0 Request processed in 76us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562522.837437:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6216 00000100:00100000:0.0:1786562522.837574:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804608:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562522.837591:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654804736:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562522.837640:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80200/0x5c655bf66689ddae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 10 pid: 34450 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.837672:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 9 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.837700:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:0.0:1786562522.837725:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63931:x1873345652657280:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 165511us (165933us total) trans 8589950525 rc 0/0 00000100:00100000:0.0:1786562522.837732:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16999 00000100:00100000:3.0:1786562522.841636:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654805248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.842284:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.842358:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654805760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562522.847874:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805248 00000100:00100000:0.0:1786562522.847899:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805248 00000100:00100000:0.0:1786562522.847995:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17296 00000100:00100000:0.0:1786562522.848026:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654805248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562522.848318:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562522.848323:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562516 -> 1786562516 00002000:00010000:0.0:1786562522.848325:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562522.848327:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1786562522.848329:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562522.852258:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3290:x1873345654804864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 25992us (27510us total) trans 21474843497 rc 0/0 00000100:00100000:1.0:1786562522.852272:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17295 00000100:00100000:3.0:1786562522.858641:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.858728:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654806272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562522.859045:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805760 00000100:00100000:1.0:1786562522.859058:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805760 00000100:00100000:1.0:1786562522.859132:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17297 00000100:00100000:1.0:1786562522.859145:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3289:x1873345654805760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562522.859456:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562522.859460:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:1.0:1786562522.859463:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.859465:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:1.0:1786562522.859467:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1786562522.859523:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3289:x1873345654805760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 379us (894us total) trans 21474843499 rc 0/0 00000100:00100000:1.0:1786562522.859531:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17297 00000100:00100000:3.0:1786562522.861253:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.861337:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654806784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.861411:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786562522.861480:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88317b100/2, rc 0, transno 21474843499 00000100:00100000:3.0:1786562522.861489:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654805760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.861527:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654804992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.861570:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.861591:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654805504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.861612:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.861627:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.861649:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.861671:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.861690:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.861713:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1786562522.861720:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654805120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.861737:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.862000:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654805632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.862055:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.862076:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.862097:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562522.862115:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.862135:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562522.862301:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806272 00000100:00100000:1.0:1786562522.862311:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806272 00000100:00100000:1.0:1786562522.862372:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806784 00000100:00100000:1.0:1786562522.862376:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806784 00000100:00100000:1.0:1786562522.862393:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654804992 00000100:00100000:1.0:1786562522.862396:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654804992 00000100:00100000:1.0:1786562522.862411:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805504 00000100:00100000:1.0:1786562522.862414:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805504 00000100:00100000:1.0:1786562522.862422:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806016 00000100:00100000:1.0:1786562522.862424:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806016 00000100:00100000:1.0:1786562522.862431:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806528 00000100:00100000:1.0:1786562522.862433:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806528 00000100:00100000:1.0:1786562522.862442:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805120 00000100:00100000:1.0:1786562522.862444:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805120 00000100:00100000:1.0:1786562522.862453:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805632 00000100:00100000:1.0:1786562522.862456:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805632 00000100:00100000:1.0:1786562522.862464:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806144 00000100:00100000:1.0:1786562522.862466:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806144 00000100:00100000:1.0:1786562522.862476:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806656 00000100:00100000:1.0:1786562522.862478:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806656 00000100:00100000:1.0:1786562522.862492:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17298 00000100:00100000:1.0:1786562522.862503:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3289:x1873345654806272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.863077:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17299 00000100:00100000:3.0:1786562522.863090:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3289:x1873345654806784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562522.863263:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1786562522.863268:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.863271:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.863273:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.863276:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562522.863345:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3289:x1873345654806272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 844us (4537us total) trans 17179875966 rc 0/0 00000100:00100000:1.0:1786562522.863353:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17298 00000100:00100000:1.0:1786562522.863379:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17300 00000100:00100000:1.0:1786562522.863387:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3291:x1873345654804992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562522.863497:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562522.863501:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.863503:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.863505:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.863507:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562522.863542:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654804992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (1971us total) trans 21474843500 rc 0/0 00000100:00100000:1.0:1786562522.863561:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17300 00000100:00100000:1.0:1786562522.863573:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17301 00000100:00100000:1.0:1786562522.863580:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3291:x1873345654805504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562522.863661:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562522.863664:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.863666:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.863668:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.863670:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562522.863698:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654805504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (2084us total) trans 21474843501 rc 0/0 00000100:00100000:1.0:1786562522.863704:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17301 00000100:00100000:1.0:1786562522.863716:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17302 00000100:00100000:1.0:1786562522.863722:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654806016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562522.863959:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:3.0:1786562522.863963:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562522.863965:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562522.863967:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562522.863970:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562522.864032:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3289:x1873345654806784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 920us (2594us total) trans 17179875967 rc 0/0 00000100:00100000:3.0:1786562522.864040:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17299 00000100:00100000:3.0:1786562522.864055:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17303 00000100:00100000:3.0:1786562522.864064:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654806528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562522.864151:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562522.864155:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562522.864158:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562522.864160:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562522.864162:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1786562522.864320:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562522.864324:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.864326:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.864328:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.864330:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1786562522.864358:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3291:x1873345654806016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 637us (2708us total) trans 17179875969 rc 0/0 00000100:00100000:1.0:1786562522.864365:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17302 00000100:00100000:1.0:1786562522.864377:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17304 00000100:00100000:1.0:1786562522.864384:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3291:x1873345654805120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562522.867652:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3291:x1873345654806528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3580us (5951us total) trans 17179875968 rc 0/0 00000100:00100000:3.0:1786562522.867670:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17303 00000100:00100000:3.0:1786562522.867724:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17305 00000100:00100000:3.0:1786562522.867755:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654805632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562522.867979:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562522.867983:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.867985:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.867988:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562521 -> 1786562521 00002000:00010000:1.0:1786562522.867990:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562522.868045:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654805120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3661us (6305us total) trans 21474843502 rc 0/0 00000100:00100000:1.0:1786562522.868054:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17304 00000100:00100000:1.0:1786562522.868071:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17306 00000100:00100000:1.0:1786562522.868080:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654806144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562522.868794:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562522.868801:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562522.868803:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.869035:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:1.0:1786562522.869039:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562520 -> 1786562520 00002000:00010000:1.0:1786562522.869041:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562519 -> 1786562518 00002000:00010000:1.0:1786562522.869043:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562520 -> 1786562520 00002000:00010000:1.0:1786562522.869045:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:1.0:1786562522.869101:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3291:x1873345654806144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1020us (7000us total) trans 17179875970 rc 0/0 00000100:00100000:1.0:1786562522.869109:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17306 00000100:00100000:1.0:1786562522.869133:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17307 00000100:00100000:1.0:1786562522.869142:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3291:x1873345654806656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562522.869346:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562522.869349:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.869351:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.869353:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.869355:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1786562522.869383:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3291:x1873345654806656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (7246us total) trans 17179875971 rc 0/0 00000100:00100000:1.0:1786562522.869390:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17307 00010000:00010000:1.0:1786562522.869444:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786562522.869464:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1786562522.869518:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9af30b100/2, rc 0, transno 21474843502 00000100:00100000:1.0:1786562522.869526:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654805120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562522.869540:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98825c380/2, rc 0, transno 17179875970 00000100:00100000:1.0:1786562522.869580:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562522.869591:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fe300/2, rc 0, transno 17179875971 00000100:00100000:1.0:1786562522.869594:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562522.869604:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9af30b800/2, rc 0, transno 21474843500 00000100:00100000:1.0:1786562522.869608:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654804992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562522.869619:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88317ad80/2, rc 0, transno 21474843501 00000100:00100000:1.0:1786562522.869623:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654805504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562522.869631:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88317a300/2, rc 0, transno 17179875969 00000100:00100000:1.0:1786562522.869635:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562522.869645:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fea00/2, rc 0, transno 17179875968 00000100:00100000:1.0:1786562522.869648:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654806528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562522.869738:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98825fb80/2, rc 0, transno 17179875966 00000100:00100000:1.0:1786562522.869757:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654806272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562522.869768:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fdc00/2, rc 0, transno 17179875967 00000100:00100000:1.0:1786562522.869771:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654806784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562522.869776:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562522.869791:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654806912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562522.870083:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3289:x1873345654805248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 22076us (27799us total) trans 21474843498 rc 0/0 00000100:00100000:0.0:1786562522.870093:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17296 00002000:00010000:3.0:1786562522.870399:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562522.870402:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562522.870465:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3291:x1873345654805632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2719us (8408us total) trans 21474843503 rc 0/0 00000100:00100000:3.0:1786562522.870473:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17305 00000004:00080000:0.0:1786562522.872107:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883178700/2, rc 0, transno 21474843503 00000100:00100000:0.0:1786562522.872123:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654805632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562522.872506:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786562522.872577:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b575180/2, rc 0, transno 21474843498 00000100:00100000:1.0:1786562522.872583:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654805248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562522.872715:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806912 00000100:00100000:0.0:1786562522.872724:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806912 00000100:00100000:0.0:1786562522.872797:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17308 00000100:00100000:0.0:1786562522.872822:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3289:x1873345654806912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562522.873131:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562522.873135:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:0.0:1786562522.873138:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562522.873140:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:0.0:1786562522.873143:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:0.0:1786562522.873406:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3289:x1873345654806912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 591us (899us total) trans 17179875972 rc 0/0 00000100:00100000:0.0:1786562522.873414:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17308 00000004:00080000:1.0:1786562522.873513:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e884339500/2, rc 0, transno 17179875972 00000100:00100000:1.0:1786562522.873520:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654806912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562522.889986:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805376 00000100:00100000:3.0:1786562522.890022:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805376 00000100:00100000:1.0:1786562522.890425:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654805888 00000100:00100000:1.0:1786562522.890431:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654805888 00000100:00100000:1.0:1786562522.890453:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654806400 00000100:00100000:1.0:1786562522.890457:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654806400 00000100:00100000:1.0:1786562522.890523:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17309 00000100:00100000:1.0:1786562522.890535:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3290:x1873345654806400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562522.891073:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562522.891078:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.891080:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.891083:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.891086:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562522.892056:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3290:x1873345654806400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1514us (17691us total) trans 17179875973 rc 0/0 00000100:00100000:1.0:1786562522.892072:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17309 00000100:00100000:1.0:1786562522.892231:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17310 00000100:00100000:1.0:1786562522.892246:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3290:x1873345654805376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562522.892458:0:28862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1786562522.892463:0:28862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.892465:0:28862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562522.892466:0:28862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:1.0:1786562522.892470:0:28862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562522.892523:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3290:x1873345654805376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 281us (18465us total) trans 21474843504 rc 0/0 00000100:00100000:1.0:1786562522.892530:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17310 00000100:00100000:1.0:1786562522.892597:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17311 00000100:00100000:1.0:1786562522.892605:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3290:x1873345654805888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562522.892720:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1786562522.892724:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562513 -> 1786562513 00002000:00010000:1.0:1786562522.892727:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562512 -> 1786562512 00002000:00010000:1.0:1786562522.892729:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562512 -> 1786562512 00002000:00010000:1.0:1786562522.892731:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562522.892777:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3290:x1873345654805888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (18629us total) trans 17179875974 rc 0/0 00000100:00100000:1.0:1786562522.892784:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17311 00000100:00100000:0.0:1786562522.897278:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.899555:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658560 00000100:00100000:1.0:1786562522.899576:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658560 00002000:00100000:1.0:1786562522.899655:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72f:0x0] (1937408->2097151) req@ffff90e88b51bb80 x1873345652658560/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/0 e 0 to 0 dl 1786562533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562522.899670:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51bb80 with x1873345652658560 ext(1937408->2097151) 00002000:00010000:1.0:1786562522.899677:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b51bb80 00000100:00100000:1.0:1786562522.899728:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11287 00000100:00100000:1.0:1786562522.899738:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652658560:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:1.0:1786562522.904227:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652658560:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 4472us (6947us total) trans 21474843505 rc 0/0 00000100:00100000:1.0:1786562522.904247:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11287 00002000:00100000:1.0:1786562522.904264:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72f:0x0] (1937408->2097151) req@ffff90e88b51bb80 x1873345652658560/t21474843505(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:748/0 lens 488/448 e 0 to 0 dl 1786562533 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562522.904276:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51bb80 with x1873345652658560 ext(1937408->2097151) 00002000:00010000:1.0:1786562522.904285:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b51bb80 00000100:00100000:3.0:1786562522.918601:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.918654:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.918707:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.919061:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658688 00000100:00100000:1.0:1786562522.919075:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658688 00000100:00100000:1.0:1786562522.919131:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658816 00000100:00100000:1.0:1786562522.919134:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658816 00000100:00100000:1.0:1786562522.919156:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652658944 00000100:00100000:1.0:1786562522.919159:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652658944 00000100:00100000:1.0:1786562522.919185:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17312 00000100:00100000:1.0:1786562522.919197:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652658688:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562522.919222:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.919245:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689ddca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc22f expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.919325:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654807040:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562522.919425:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff40240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.919451:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17313 00000100:00100000:1.0:1786562522.919458:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652658816:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562522.919467:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.919480:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ddd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc236 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.919515:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654807168:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562522.919542:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562522.919577:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17314 00000100:00100000:1.0:1786562522.919585:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:63931:x1873345652658944:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562522.919593:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.919604:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc23d expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919627:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689d813 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf65 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919636:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689d9fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc01b expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919645:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 31 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919653:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1786562522.919659:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562522.919665:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [507904->536575] (req 507904->536575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919693:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 31 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919708:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 31 pid: 29966 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.919726:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654807296:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562522.919777:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689d9fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc01b expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.919786:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689d9fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc01b expref: 16 pid: 6659 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562522.919795:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654807424:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562522.938467:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689d813 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf65 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.938497:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689d813 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf65 expref: 12 pid: 29662 timeout: 1055 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.938518:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654807552:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562522.938581:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff40000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562522.947543:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.947600:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652659072 00000100:00100000:0.0:1786562522.947611:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652659072 00010000:00010000:0.0:1786562522.947660:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 32 pid: 29966 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562522.947707:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8432 00000100:00100000:0.0:1786562522.947718:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652659072:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562522.947736:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562522.947772:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 32 pid: 29966 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.947787:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 32 pid: 29966 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562522.948517:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562522.948616:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652659072:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 897us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562522.948626:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8432 00010000:00010000:3.0:1786562522.949158:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689d9f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc014 expref: 31 pid: 29966 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562522.949187:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654807296:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562522.949237:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654807040:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562522.949274:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689ddca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc22f expref: 14 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.949293:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689ddca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc22f expref: 14 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.949303:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:3.0:1786562522.949356:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652658688:12345-192.168.204.29@tcp:101:cat.0 Request processed in 30162us (30771us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562522.949364:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17312 00000100:00100000:0.0:1786562522.970676:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562522.970828:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562522.973042:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654807424:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562522.976138:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652659200 00000100:00100000:1.0:1786562522.976157:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652659200 00000100:00100000:1.0:1786562522.976257:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17315 00000100:00100000:1.0:1786562522.976271:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652659200:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562522.976295:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562522.976327:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689dddf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc244 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.976360:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562522.976379:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689dddf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc244 expref: 32 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.976404:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689dddf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc244 expref: 32 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562522.976428:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0548c00, rc 0) 00000100:00100000:1.0:1786562522.976515:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652659200:12345-192.168.204.29@tcp:101:cat.0 Request processed in 247us (5854us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562522.976523:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17315 00000100:00100000:3.0:1786562522.978001:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654807552:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562522.978089:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [507904->536575] (req 507904->536575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 14 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562522.978112:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfd5a800, rc 0) 00000100:00100000:3.0:1786562522.978167:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:63931:x1873345652658944:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 58582us (59458us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562522.978175:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17314 00000100:00100000:1.0:1786562522.983560:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562522.983599:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:1.0:1786562522.985043:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562523.001519:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652659840 00000100:00100000:0.0:1786562523.001527:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652659840 00000100:00100000:0.0:1786562523.001590:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6217 00000100:00100000:0.0:1786562523.001600:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63922:x1873345652659840:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1786562523.001958:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63922:x1873345652659840:12345-192.168.204.29@tcp:35:cat.0 Request processed in 358us (771us total) trans 8589950526 rc 0/0 00000100:00100000:0.0:1786562523.001967:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6217 00000100:00100000:1.0:1786562523.002058:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652659968 00000100:00100000:1.0:1786562523.002063:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652659968 00000100:00100000:1.0:1786562523.002099:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17316 00000100:00100000:1.0:1786562523.002106:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+31:63930:x1873345652659968:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562523.002117:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.002138:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc24b expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.002172:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.002182:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562523.002187:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562523.002193:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 32 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.002234:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.002255:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 12 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.002272:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654807808:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562523.002336:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff40000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562523.032201:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652660096 00000100:00100000:0.0:1786562523.032226:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652660096 00002000:00100000:0.0:1786562523.032330:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x711:0x0] (507904->511999) req@ffff90e88be23b80 x1873345652660096/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.032344:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23b80 with x1873345652660096 ext(507904->511999) 00010000:00010000:0.0:1786562523.032355:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 13 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562523.032380:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 13 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562523.032390:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be23b80 00000100:00100000:0.0:1786562523.032438:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5881 00000100:00100000:0.0:1786562523.032450:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652660096:12345-192.168.204.29@tcp:3:multiop.0 00000100:00080000:1.0:1786562523.032870:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562523.035021:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652660096:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 2541us (33538us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562523.035039:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5881 00002000:00100000:0.0:1786562523.035055:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x711:0x0] (507904->511999) req@ffff90e88be23b80 x1873345652660096/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/4536 e 0 to 0 dl 1786562534 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.035067:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23b80 with x1873345652660096 ext(507904->511999) 00010000:00010000:0.0:1786562523.035079:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 13 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562523.035107:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 13 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562523.035116:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be23b80 00000100:00100000:3.0:1786562523.043162:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652660224 00000100:00100000:3.0:1786562523.043184:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652660224 00002000:00100000:3.0:1786562523.043263:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1589248->1593343) req@ffff90e88be20380 x1873345652660224/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.043277:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20380 with x1873345652660224 ext(1589248->1593343) 00002000:00010000:3.0:1786562523.043284:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be20380 00000100:00100000:3.0:1786562523.043443:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11289 00000100:00100000:3.0:1786562523.043455:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652660224:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562523.043789:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652660224:12345-192.168.204.29@tcp:3:cat.0 Request processed in 335us (16554us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562523.043798:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11289 00002000:00100000:3.0:1786562523.043925:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1589248->1593343) req@ffff90e88be20380 x1873345652660224/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/4536 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.044045:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20380 with x1873345652660224 ext(1589248->1593343) 00002000:00010000:3.0:1786562523.044049:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be20380 00000100:00100000:3.0:1786562523.044137:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.051798:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.052046:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652660608 00000100:00100000:3.0:1786562523.052058:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652660608 00000100:00100000:3.0:1786562523.052128:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6218 00000100:00100000:3.0:1786562523.052141:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+502:63920:x1873345652660608:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562523.052575:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:63920:x1873345652660608:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 436us (791us total) trans 8589950527 rc 0/0 00000100:00100000:3.0:1786562523.052584:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6218 00000100:00100000:0.0:1786562523.070154:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.070436:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652660736 00000100:00100000:3.0:1786562523.070449:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652660736 00002000:00100000:3.0:1786562523.070519:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (507904->536575) req@ffff90e88b51ad80 x1873345652660736/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.070533:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51ad80 with x1873345652660736 ext(507904->536575) 00010000:00010000:3.0:1786562523.070558:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 13 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.070582:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 13 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562523.070591:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b51ad80 00000100:00100000:3.0:1786562523.070631:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5883 00000100:00100000:3.0:1786562523.070644:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652660736:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:1.0:1786562523.077570:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652660736:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 6901us (7405us total) trans 17179875975 rc 0/0 00000100:00100000:1.0:1786562523.077586:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5883 00002000:00100000:1.0:1786562523.077603:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (507904->536575) req@ffff90e88b51ad80 x1873345652660736/t17179875975(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/448 e 0 to 0 dl 1786562534 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.077615:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51ad80 with x1873345652660736 ext(507904->536575) 00010000:00010000:1.0:1786562523.077629:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 15 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.077651:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000041d6a715/0x5c655bf66689ddd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->536575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc23d expref: 15 pid: 29965 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562523.077662:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b51ad80 00000100:00100000:0.0:1786562523.089316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.137924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.138327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.138363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.138411:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.140337:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652660992 00000100:00100000:0.0:1786562523.140357:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652660992 00002000:00100000:0.0:1786562523.140441:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88bf5f100 x1873345652660992/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.140455:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5f100 with x1873345652660992 ext(0->1048575) 00002000:00010000:0.0:1786562523.140462:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5f100 00000100:00100000:0.0:1786562523.140511:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661248 00000100:00100000:0.0:1786562523.140516:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661248 00002000:00100000:0.0:1786562523.140559:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88bf5ed80 x1873345652661248/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.140568:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ed80 with x1873345652661248 ext(1048576->2097151) 00002000:00010000:0.0:1786562523.140572:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5ed80 00000100:00100000:0.0:1786562523.140592:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661120 00000100:00100000:0.0:1786562523.140595:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661120 00002000:00100000:0.0:1786562523.140611:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88ac84380 x1873345652661120/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.140620:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84380 with x1873345652661120 ext(1048576->2097151) 00002000:00010000:0.0:1786562523.140625:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88ac84380 00000100:00100000:0.0:1786562523.140637:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661376 00000100:00100000:0.0:1786562523.140640:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661376 00002000:00100000:0.0:1786562523.140655:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x713:0x0] (1593344->2097151) req@ffff90e88bf04000 x1873345652661376/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.140662:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04000 with x1873345652661376 ext(1593344->2097151) 00002000:00010000:0.0:1786562523.140676:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04000 00000100:00100000:0.0:1786562523.140697:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11290 00000100:00100000:0.0:1786562523.140708:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652660992:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562523.143347:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11292 00000100:00100000:0.0:1786562523.143365:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652661120:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562523.144572:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11293 00000100:00100000:0.0:1786562523.144589:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+34:2350:x1873345652661376:12345-192.168.204.29@tcp:3:cat.0 00000100:00080000:1.0:1786562523.146593:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562523.218184:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652661376:12345-192.168.204.29@tcp:3:cat.0 Request processed in 73582us (79754us total) trans 0 rc 503808/503808 00000100:00100000:1.0:1786562523.218201:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11293 00002000:00100000:1.0:1786562523.218220:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x713:0x0] (1593344->2097151) req@ffff90e88bf04000 x1873345652661376/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 503808/503808 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.218232:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04000 with x1873345652661376 ext(1593344->2097151) 00002000:00010000:1.0:1786562523.218239:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04000 00000100:00100000:3.0:1786562523.219232:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652661248:12345-192.168.204.29@tcp:3:cat.0 Request processed in 77182us (80898us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562523.219244:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11291 00002000:00100000:3.0:1786562523.219253:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88bf5ed80 x1873345652661248/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.219261:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ed80 with x1873345652661248 ext(1048576->2097151) 00002000:00010000:3.0:1786562523.219266:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5ed80 00000100:00100000:0.0:1786562523.315956:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661504 00000100:00100000:0.0:1786562523.315977:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661504 00002000:00100000:0.0:1786562523.316082:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88be21f80 x1873345652661504/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.316097:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be21f80 with x1873345652661504 ext(2097152->3145727) 00002000:00010000:0.0:1786562523.316106:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be21f80 00000100:00100000:0.0:1786562523.316157:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11294 00000100:00100000:0.0:1786562523.316169:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652661504:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562523.328784:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661632 00000100:00100000:3.0:1786562523.328799:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661632 00002000:00100000:3.0:1786562523.328883:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88be22d80 x1873345652661632/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.328896:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22d80 with x1873345652661632 ext(3145728->4194303) 00002000:00010000:3.0:1786562523.328903:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be22d80 00000100:00100000:3.0:1786562523.328934:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661760 00000100:00100000:3.0:1786562523.328938:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661760 00002000:00100000:3.0:1786562523.328956:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88be23800 x1873345652661760/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.328965:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23800 with x1873345652661760 ext(2097152->3145727) 00002000:00010000:3.0:1786562523.328970:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be23800 00000100:00100000:3.0:1786562523.328988:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652661888 00000100:00100000:3.0:1786562523.328990:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652661888 00002000:00100000:3.0:1786562523.329052:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88be20000 x1873345652661888/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.329061:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20000 with x1873345652661888 ext(3145728->4194303) 00002000:00010000:3.0:1786562523.329064:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be20000 00000100:00100000:3.0:1786562523.329089:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11295 00000100:00100000:3.0:1786562523.329101:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652661632:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562523.329911:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11296 00000100:00100000:3.0:1786562523.329924:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652661760:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562523.330803:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11297 00000100:00100000:1.0:1786562523.330817:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652661888:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562523.355369:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:2349:x1873345652661504:12345-192.168.204.29@tcp:3:cat.0 Request processed in 39196us (41920us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562523.355386:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11294 00002000:00100000:0.0:1786562523.355400:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88be21f80 x1873345652661504/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.355412:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be21f80 with x1873345652661504 ext(2097152->3145727) 00002000:00010000:0.0:1786562523.355417:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be21f80 00000100:00100000:0.0:1786562523.361037:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.361484:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652662400 00000100:00100000:1.0:1786562523.361495:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652662400 00000100:00100000:1.0:1786562523.361571:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17003 00000100:00100000:1.0:1786562523.361583:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+503:63941:x1873345652662400:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562523.361614:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.361645:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689de10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc259 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.365682:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.365721:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.365736:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.365757:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.365765:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.365778:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366275:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366286:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366294:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562523.366305:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562523.366418:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366426:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366433:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366439:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562523.366444:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366451:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366464:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562523.366467:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562523.366472:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366478:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366493:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366498:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366504:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366508:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562523.366511:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366516:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366523:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2a00) 00010000:00010000:1.0:1786562523.366525:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562523.366527:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366532:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366603:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689de10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc259 expref: 506 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366625:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc259 expref: 505 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.366632:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562523.366634:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562523.366637:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268400, rc 0) 00000100:00100000:1.0:1786562523.366723:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+505:63941:x1873345652662400:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 5142us (5720us total) trans 8589950529 rc 0/0 00000100:00100000:1.0:1786562523.366734:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17003 00000100:00100000:3.0:1786562523.375316:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652661632:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46199us (46787us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562523.375333:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11295 00002000:00100000:3.0:1786562523.375349:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88be22d80 x1873345652661632/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.375370:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22d80 with x1873345652661632 ext(3145728->4194303) 00002000:00010000:3.0:1786562523.375377:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be22d80 00000100:00100000:1.0:1786562523.421957:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.422394:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652662656 00000100:00100000:0.0:1786562523.422408:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652662656 00000100:00100000:1.0:1786562523.425486:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17004 00000100:00100000:1.0:1786562523.425515:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63938:x1873345652662656:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562523.425569:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.425598:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689de33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc260 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.425701:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.425720:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.425738:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.425758:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.425766:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.425773:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426241:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689de48 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426254:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689de48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426262:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689de48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562523.426275:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562523.426804:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426814:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426821:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426828:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562523.426833:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426841:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426866:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562523.426869:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562523.426874:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426880:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689de3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426898:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426905:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426911:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426916:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562523.426920:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426925:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426933:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2a00) 00010000:00010000:1.0:1786562523.426935:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562523.426938:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426944:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689de41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.426998:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689de33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc260 expref: 15 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.427055:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689de48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc260 expref: 14 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.427065:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562523.427067:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562523.427071:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:1.0:1786562523.427146:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:63938:x1873345652662656:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1643us (5202us total) trans 8589950530 rc 0/0 00000100:00100000:1.0:1786562523.427156:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17004 00000100:00100000:1.0:1786562523.430916:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654808192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562523.431027:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562523.431104:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562523.431111:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654808064:0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.431148:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562523.431175:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654808576:0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.431204:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562523.431271:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654808320:0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.431302:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562523.431324:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562523.431330:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654808448:0@lo:400:kworker.0 00000100:00100000:0.0:1786562523.431862:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654808576 00000100:00100000:0.0:1786562523.431868:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654808576 00000100:00100000:0.0:1786562523.431903:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654808320 00000100:00100000:0.0:1786562523.431906:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654808320 00000100:00100000:0.0:1786562523.431939:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1786562523.431947:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654808576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.432076:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562523.432113:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654808448 00000100:00100000:1.0:1786562523.432118:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654808448 00000100:00100000:1.0:1786562523.432148:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1786562523.432155:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654808320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.432195:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654808320:12345-0@lo:400:kworker.0 Request processed in 41us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562523.432202:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1786562523.432220:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1786562523.432226:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654808448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.432254:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654808448:12345-0@lo:400:kworker.0 Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562523.432260:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:1.0:1786562523.432281:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562523.432297:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654808704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562523.432329:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562523.432363:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654808704 00000100:00100000:1.0:1786562523.432367:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654808704 00000100:00100000:1.0:1786562523.432386:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1786562523.432393:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3292:x1873345654808704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562523.432408:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 465371136 pending 11927552 free 3829399552 avail 3827302400 00000100:00100000:1.0:1786562523.432445:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3292:x1873345654808704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562523.432452:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1786562523.432497:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654808704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562523.432532:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654808448:0@lo:400:kworker.0 00000100:00100000:1.0:1786562523.432559:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654808320:0@lo:400:kworker.0 00000100:00100000:3.0:1786562523.433896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.435508:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652662912 00000100:00100000:1.0:1786562523.435526:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652662912 00000100:00100000:1.0:1786562523.435622:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17318 00000100:00100000:1.0:1786562523.435634:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652662912:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562523.435657:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.435681:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5a83e9/0x5c655bf66689de5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc26e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.436916:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654808832:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562523.437067:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00000100:00080000:3.0:1786562523.440269:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562523.445351:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.445509:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652663040 00000100:00100000:3.0:1786562523.445522:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652663040 00000100:00100000:3.0:1786562523.445635:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17319 00000100:00100000:3.0:1786562523.445649:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652663040:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562523.445676:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562523.445699:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689de64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc275 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562523.445778:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af308700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654808960:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562523.447940:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc1b6840 going to sleep for 11 seconds 00000100:00100000:1.0:1786562523.473801:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.473850:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:0.0:1786562523.475388:0:6659:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562521 -> 1786562522 00002000:00010000:0.0:1786562523.475398:0:6659:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562521 -> 1786562522 00002000:00010000:0.0:1786562523.475401:0:6659:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562521 -> 1786562522 00000100:00100000:0.0:1786562523.475433:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654808832:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562523.475482:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5a83e9/0x5c655bf66689de5d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc26e expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562523.475513:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5a83e9/0x5c655bf66689de5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc26e expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562523.475530:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:0.0:1786562523.475638:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652662912:12345-192.168.204.29@tcp:101:cat.0 Request processed in 40005us (41746us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562523.475649:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17318 00002000:00010000:3.0:1786562523.482143:0:37002:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562521 -> 1786562522 00002000:00010000:3.0:1786562523.482158:0:37002:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime: 1786562521 -> 1786562522 00002000:00010000:3.0:1786562523.482160:0:37002:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562521 -> 1786562522 00000100:00100000:3.0:1786562523.482194:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af308700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654808960:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562523.482241:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689de64 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc275 expref: 16 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.482271:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689de64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc275 expref: 16 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.482293:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65e00, rc 0) 00000100:00100000:3.0:1786562523.482383:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652663040:12345-192.168.204.29@tcp:101:cat.0 Request processed in 36737us (37042us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562523.482395:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17319 00000100:00100000:1.0:1786562523.504244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.504564:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652663552 00000100:00100000:3.0:1786562523.504578:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652663552 00002000:00100000:3.0:1786562523.504649:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e889d48a80 x1873345652663552/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.504664:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d48a80 with x1873345652663552 ext(4194304->5185535) 00002000:00010000:3.0:1786562523.504671:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d48a80 00000100:00100000:3.0:1786562523.504707:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11298 00000100:00100000:3.0:1786562523.504719:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652663552:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562523.513651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.513825:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652663680 00000100:00100000:1.0:1786562523.513839:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652663680 00000100:00100000:1.0:1786562523.513906:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17320 00000100:00100000:1.0:1786562523.513917:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:63938:x1873345652663680:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562523.513941:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.513964:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc27c expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.514042:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.514055:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.514065:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=2s v=(4 1) 00010000:00010000:1.0:1786562523.514070:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 1) 00010000:00010000:1.0:1786562523.514076:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.514120:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.514137:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.514167:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654809088:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562523.514283:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.514294:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.514304:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654809216:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562523.514330:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1840 going to sleep for 11 seconds 00000001:00080000:0.0:1786562523.574903:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843498 is committed 00000001:00080000:0.0:1786562523.574935:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843496 is committed 00000001:00080000:0.0:1786562523.575066:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843505 is committed 00000001:00080000:0.0:1786562523.575080:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843504 is committed 00000001:00080000:0.0:1786562523.575170:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843467 is committed 00000100:00100000:1.0:1786562523.580703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.581333:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654809088:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562523.581352:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654809216:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562523.581410:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562523.581436:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92d600, rc 0) 00000100:00100000:0.0:1786562523.581520:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:63938:x1873345652663680:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 67604us (67884us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562523.581531:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17320 00000100:00100000:3.0:1786562523.582701:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652663808 00000100:00100000:3.0:1786562523.582716:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652663808 00010000:00010000:3.0:1786562523.582766:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562523.582806:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8436 00000100:00100000:3.0:1786562523.582818:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652663808:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562523.582838:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562523.582866:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.582888:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.582919:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d04b4083/0x5c655bf66689dc5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc172 expref: 16 pid: 29964 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.582938:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562523.582982:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652663808:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 166us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562523.582989:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8436 00000100:00100000:3.0:1786562523.583253:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652663552:12345-192.168.204.29@tcp:3:cat.0 Request processed in 78536us (79024us total) trans 0 rc 991232/991232 00000100:00100000:3.0:1786562523.583264:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11298 00002000:00100000:3.0:1786562523.583276:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e889d48a80 x1873345652663552/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.583286:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d48a80 with x1873345652663552 ext(4194304->5185535) 00010000:00010000:3.0:1786562523.583294:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 32 pid: 12119 timeout: 1055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.583307:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 32 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562523.583315:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e889d48a80 00000100:00100000:1.0:1786562523.584035:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652663936 00000100:00100000:1.0:1786562523.584044:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652663936 00002000:00100000:1.0:1786562523.584089:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88be20a80 x1873345652663936/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.584100:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20a80 with x1873345652663936 ext(0->1048575) 00002000:00010000:1.0:1786562523.584105:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be20a80 00000100:00100000:1.0:1786562523.584135:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652664064 00000100:00100000:1.0:1786562523.584139:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652664064 00002000:00100000:1.0:1786562523.584169:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88be21180 x1873345652664064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.584178:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be21180 with x1873345652664064 ext(1048576->2097151) 00002000:00010000:1.0:1786562523.584183:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be21180 00000100:00100000:1.0:1786562523.584204:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11299 00000100:00100000:1.0:1786562523.584214:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652663936:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562523.585335:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11300 00000100:00100000:3.0:1786562523.585349:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652664064:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562523.598751:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.599065:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652664192 00000100:00100000:1.0:1786562523.599080:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652664192 00000100:00100000:1.0:1786562523.599164:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17321 00000100:00100000:1.0:1786562523.599176:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+32:63930:x1873345652664192:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562523.599199:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.599228:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000854a751/0x5c655bf66689de72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc283 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.599269:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(4 1) 00010000:00010000:1.0:1786562523.599275:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 4) 00010000:00010000:1.0:1786562523.599287:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000854a751/0x5c655bf66689de72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc283 expref: 33 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.599306:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000854a751/0x5c655bf66689de72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc283 expref: 33 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.599324:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a6600, rc 0) 00000100:00100000:1.0:1786562523.599518:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+33:63930:x1873345652664192:12345-192.168.204.29@tcp:101:cat.0 Request processed in 343us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562523.599528:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17321 00000100:00100000:3.0:1786562523.635245:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.635318:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.636822:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652664448 00000100:00100000:1.0:1786562523.636832:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652664448 00010000:00010000:1.0:1786562523.636869:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.636909:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8437 00000100:00100000:1.0:1786562523.636918:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+33:2348:x1873345652664448:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562523.636933:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562523.636969:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.636986:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.637044:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dbd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc133 expref: 33 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.637064:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 4) 00010000:00010000:1.0:1786562523.637069:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 4) 00010000:00010000:1.0:1786562523.637081:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.637096:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.637260:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.637278:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654809344:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562523.637555:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652664064:12345-192.168.204.29@tcp:3:cat.0 Request processed in 52208us (53925us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562523.637568:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11300 00002000:00100000:3.0:1786562523.637582:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88be21180 x1873345652664064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.637593:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be21180 with x1873345652664064 ext(1048576->2097151) 00002000:00010000:3.0:1786562523.637599:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be21180 00000100:00100000:0.0:1786562523.637733:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652663936:12345-192.168.204.29@tcp:3:cat.0 Request processed in 53514us (54203us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562523.637743:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11299 00002000:00100000:0.0:1786562523.637749:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88be20a80 x1873345652663936/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562523.637756:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20a80 with x1873345652663936 ext(0->1048575) 00002000:00010000:0.0:1786562523.637760:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be20a80 00000100:00100000:0.0:1786562523.638566:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562523.672985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.674287:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652664576 00000100:00100000:1.0:1786562523.674308:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652664576 00002000:00100000:1.0:1786562523.674403:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e88b51b100 x1873345652664576/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.674416:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b100 with x1873345652664576 ext(5181440->5185535) 00002000:00010000:1.0:1786562523.674423:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51b100 00000100:00100000:1.0:1786562523.674525:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11301 00000100:00100000:1.0:1786562523.674546:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+33:2349:x1873345652664576:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562523.674861:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+33:2349:x1873345652664576:12345-192.168.204.29@tcp:3:cat.0 Request processed in 316us (1893us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562523.674871:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11301 00002000:00100000:1.0:1786562523.674880:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e88b51b100 x1873345652664576/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/4536 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.674889:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b100 with x1873345652664576 ext(5181440->5185535) 00002000:00010000:1.0:1786562523.674893:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51b100 00000100:00100000:0.0:1786562523.704131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.712527:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.713128:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652664832 00000100:00100000:1.0:1786562523.713142:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652664832 00000100:00100000:1.0:1786562523.713221:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17323 00000100:00100000:1.0:1786562523.713233:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63938:x1873345652664832:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562523.713260:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.713286:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc291 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.713328:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.713339:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.713347:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(3 1) 00010000:00010000:1.0:1786562523.713352:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:1.0:1786562523.713370:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->3211263] (req 3145728->3211263) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.713417:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.713435:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 14 pid: 28861 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.713452:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654809472:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562523.713581:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.713590:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.713600:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654809600:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562523.713628:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562523.720458:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654809472:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562523.720481:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654809600:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562523.720524:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->3211263] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.720565:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a7000, rc 0) 00000100:00100000:1.0:1786562523.720668:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63938:x1873345652664832:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 7437us (8155us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562523.720680:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17323 00000100:00100000:0.0:1786562523.725262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.725378:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652665088 00000100:00100000:3.0:1786562523.725391:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652665088 00000100:00100000:3.0:1786562523.725468:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6220 00000100:00100000:3.0:1786562523.725482:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+505:63930:x1873345652665088:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562523.726103:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+506:63930:x1873345652665088:12345-192.168.204.29@tcp:35:cat.0 Request processed in 623us (856us total) trans 8589950532 rc 0/0 00000100:00100000:3.0:1786562523.726113:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6220 00000100:00100000:0.0:1786562523.737202:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.737246:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.737279:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.737462:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652665216 00000100:00100000:3.0:1786562523.737474:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652665216 00010000:00010000:3.0:1786562523.737525:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562523.737579:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652665472 00000100:00100000:3.0:1786562523.737583:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652665472 00010000:00010000:3.0:1786562523.737597:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 15 pid: 28861 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562523.737622:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8438 00000100:00100000:3.0:1786562523.737632:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652665216:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562523.737652:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562523.737692:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737707:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737744:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066288f5f/0x5c655bf66689dd1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1db expref: 8 pid: 6660 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737769:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562523.737847:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652665216:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 215us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562523.737857:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8438 00000100:00100000:3.0:1786562523.737878:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8439 00000100:00100000:3.0:1786562523.737886:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652665472:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562523.737895:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562523.737905:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 15 pid: 28861 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737923:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 15 pid: 28861 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737938:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689dda0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc20c expref: 15 pid: 28861 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737950:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1786562523.737956:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1786562523.737965:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.737976:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.738076:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562523.738094:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654809728:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562523.738171:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562523.738378:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652665344 00000100:00100000:1.0:1786562523.738384:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652665344 00000100:00100000:1.0:1786562523.738431:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17324 00000100:00100000:1.0:1786562523.738440:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63940:x1873345652665344:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562523.738456:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562523.738473:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689de87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc298 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.738504:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.738512:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1786562523.738515:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562523.738519:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689de87 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc298 expref: 8 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.738555:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.738569:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 14 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562523.738582:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654809856:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562523.738612:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562523.746687:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562523.802952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562523.803400:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652665856 00000100:00100000:1.0:1786562523.803411:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652665856 00002000:00100000:1.0:1786562523.803480:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (2002944->2097151) req@ffff90e88b51a680 x1873345652665856/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562523.803493:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51a680 with x1873345652665856 ext(2002944->2097151) 00010000:00010000:1.0:1786562523.803504:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 15 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562523.803545:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 15 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562523.803554:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b51a680 00000100:00100000:1.0:1786562523.803601:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5884 00000100:00100000:1.0:1786562523.803613:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652665856:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:3.0:1786562523.817424:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af30a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654809728:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562523.817465:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562523.817551:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652665472:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 79664us (80269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562523.817565:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8439 00000100:00100000:3.0:1786562523.825541:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652665856:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 21903us (22574us total) trans 21474843506 rc 0/0 00000100:00100000:3.0:1786562523.825560:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5884 00002000:00100000:3.0:1786562523.825578:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (2002944->2097151) req@ffff90e88b51a680 x1873345652665856/t21474843506(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:749/0 lens 488/448 e 0 to 0 dl 1786562534 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.825591:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51a680 with x1873345652665856 ext(2002944->2097151) 00010000:00010000:3.0:1786562523.825605:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 16 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562523.825631:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d3db30d/0x5c655bf66689dd45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc1e9 expref: 16 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562523.825640:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b51a680 00000100:00100000:1.0:1786562523.845890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.874579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562523.882886:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562523.918734:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562523.920894:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652666240 00000100:00100000:3.0:1786562523.920918:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652666240 00002000:00100000:3.0:1786562523.921057:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88b518700 x1873345652666240/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/0 e 0 to 0 dl 1786562534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562523.921073:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518700 with x1873345652666240 ext(1048576->2097151) 00002000:00010000:3.0:1786562523.921082:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b518700 00000100:00100000:3.0:1786562523.921134:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11304 00000100:00100000:3.0:1786562523.921148:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652666240:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562524.021841:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652666240:12345-192.168.204.29@tcp:3:cat.0 Request processed in 100679us (103106us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562524.021861:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11304 00002000:00100000:1.0:1786562524.021882:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88b518700 x1873345652666240/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:749/0 lens 488/440 e 0 to 0 dl 1786562534 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.021894:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518700 with x1873345652666240 ext(1048576->2097151) 00002000:00010000:1.0:1786562524.021902:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b518700 00000100:00100000:1.0:1786562524.079117:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:0.0:1786562524.087133:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562524.101559:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.103910:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652666624 00000100:00100000:1.0:1786562524.103934:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652666624 00000100:00100000:1.0:1786562524.104081:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17325 00000100:00100000:1.0:1786562524.104093:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:63940:x1873345652666624:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562524.104119:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562524.104144:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2a6 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.104192:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.104203:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=1s v=(2 0) 00010000:00010000:1.0:1786562524.104208:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562524.104214:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.104257:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.104273:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 31 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.104289:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654810112:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562524.104423:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.108665:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.108740:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652666752 00000100:00100000:1.0:1786562524.108753:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652666752 00000100:00100000:1.0:1786562524.108842:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 953 00000100:00100000:1.0:1786562524.108855:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+509:2350:x1873345652666752:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.108875:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.109238:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689dea3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc29f expref: 509 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.109268:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562524.109274:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562524.109342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+508:2350:x1873345652666752:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 490us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.109423:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 953 00000100:00100000:3.0:1786562524.140425:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.140490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.140541:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652667136 00000100:00100000:3.0:1786562524.140553:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652667136 00000100:00100000:3.0:1786562524.140620:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17006 00000100:00100000:3.0:1786562524.140631:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+508:63950:x1873345652667136:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562524.140663:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562524.140688:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689deb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2ad expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.142512:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.142557:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.142574:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.142610:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.142617:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.142623:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562524.144155:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562524.144836:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654810112:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562524.144876:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.144898:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22400, rc 0) 00000100:00100000:1.0:1786562524.144966:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:63940:x1873345652666624:12345-192.168.204.29@tcp:101:cat.0 Request processed in 40874us (43422us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.144976:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17325 00010000:00010000:3.0:1786562524.147589:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557e00/0x5c655bf66689decd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.147616:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557e00/0x5c655bf66689decd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.147631:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557e00/0x5c655bf66689decd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562524.147647:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562524.149684:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149706:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149716:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149723:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf64800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562524.149728:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149737:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149759:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562524.149763:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562524.149769:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149776:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689debf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149808:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149815:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149826:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149832:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf65600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562524.149835:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149841:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149850:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab000) 00010000:00010000:3.0:1786562524.149852:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562524.149856:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.149863:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dec6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.156570:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689deb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ad expref: 511 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.156613:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557e00/0x5c655bf66689decd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ad expref: 510 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.156627:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562524.156630:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562524.156635:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988557e00, rc 0) 00000100:00100000:3.0:1786562524.157245:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+510:63950:x1873345652667136:12345-192.168.204.29@tcp:101:cat.0 Request processed in 16612us (16895us total) trans 8589950535 rc 0/0 00000100:00100000:3.0:1786562524.157260:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17006 00000001:00080000:3.0:1786562524.182804:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875972 is committed 00000001:00080000:3.0:1786562524.182842:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875952 is committed 00000001:00080000:3.0:1786562524.182858:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875951 is committed 00000001:00080000:3.0:1786562524.182876:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875931 is committed 00000100:00100000:3.0:1786562524.188982:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+32:2351:x1873345652666880:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 45211us (48475us total) trans 17179875976 rc 0/0 00000100:00100000:3.0:1786562524.189000:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5885 00002000:00100000:3.0:1786562524.189044:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x713:0x0] (1048576->1593343) req@ffff90e98873c000 x1873345652666880/t17179875976(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/448 e 0 to 0 dl 1786562535 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.189056:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c000 with x1873345652666880 ext(1048576->1593343) 00010000:00010000:3.0:1786562524.189070:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 32 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.189094:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 32 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562524.189103:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98873c000 00000100:00100000:0.0:1786562524.190291:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652667392 00000100:00100000:0.0:1786562524.190301:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652667392 00000100:00100000:0.0:1786562524.190361:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652667648 00000100:00100000:0.0:1786562524.190364:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652667648 00000100:00100000:0.0:1786562524.190385:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652667264 00000100:00100000:0.0:1786562524.190388:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652667264 00000100:00100000:0.0:1786562524.190401:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652667520 00000100:00100000:0.0:1786562524.190403:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652667520 00000100:00100000:0.0:1786562524.190422:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17326 00000100:00100000:0.0:1786562524.190432:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+33:2348:x1873345652667392:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562524.190452:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562524.190475:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689dedb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2bb expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.190559:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654810240:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562524.190641:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562524.190862:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652667776 00000100:00100000:0.0:1786562524.190867:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652667776 00000100:00100000:0.0:1786562524.190915:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 954 00000100:00100000:0.0:1786562524.190923:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+510:2350:x1873345652667776:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562524.190936:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562524.190963:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557e00/0x5c655bf66689decd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ad expref: 510 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.190984:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562524.190990:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562524.191061:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+509:2350:x1873345652667776:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 138us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562524.191069:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 954 00000100:00100000:0.0:1786562524.191099:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17327 00000100:00100000:0.0:1786562524.191107:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652667648:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562524.191116:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562524.191127:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80f1dcc/0x5c655bf66689dee2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2c9 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.191280:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654810368:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562524.191313:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562524.191737:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17329 00000100:00100000:3.0:1786562524.191748:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652667520:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562524.191756:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562524.191769:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689def0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2c2 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.191965:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689def0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2c2 expref: 35 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.191981:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689def0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2c2 expref: 35 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.191992:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65e00, rc 0) 00000001:00080000:1.0:1786562524.193456:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875975 is committed 00000001:00080000:1.0:1786562524.193476:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875974 is committed 00000001:00080000:1.0:1786562524.193494:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875964 is committed 00000001:00080000:1.0:1786562524.193558:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875932 is committed 00000100:00100000:3.0:1786562524.195072:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652667520:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3314us (5166us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562524.195086:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17329 00000100:00100000:0.0:1786562524.200974:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.201245:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652668160 00000100:00100000:3.0:1786562524.201260:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652668160 00000100:00100000:1.0:1786562524.201452:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17007 00000100:00100000:1.0:1786562524.201468:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:63952:x1873345652668160:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562524.201501:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562524.201542:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23200/0x5c655bf66689def7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2d7 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.201648:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.201679:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.201694:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.201713:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.201722:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.201729:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203432:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689df0c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203453:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689df0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203465:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689df0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562524.203478:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562524.203618:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203627:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203634:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203642:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f22000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562524.203646:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203654:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203671:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562524.203674:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562524.203680:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203686:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689defe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203703:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203709:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203715:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203720:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f22e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562524.203733:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203741:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203754:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562524.203756:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562524.203759:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.203766:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689df05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562524.203895:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562524.209256:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23200/0x5c655bf66689def7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d7 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.209298:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689df0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d7 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.209309:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562524.209313:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562524.209318:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23c00, rc 0) 00000100:00100000:1.0:1786562524.209545:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:63952:x1873345652668160:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 8080us (8584us total) trans 8589950536 rc 0/0 00000100:00100000:1.0:1786562524.209557:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17007 00000100:00100000:0.0:1786562524.223296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:0.0:1786562524.231252:0:6658:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562522 -> 1786562523 00002000:00010000:0.0:1786562524.231268:0:6658:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562522 -> 1786562523 00000100:00100000:0.0:1786562524.231303:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654810240:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562524.231357:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689dedb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2bb expref: 29 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.231391:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689dedb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2bb expref: 29 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.231410:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:0.0:1786562524.231483:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652667392:12345-192.168.204.29@tcp:101:cat.0 Request processed in 41051us (41782us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562524.231494:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17326 00000100:00100000:0.0:1786562524.255381:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.255430:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.255453:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.255513:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.255594:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.255714:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652668288 00000100:00100000:1.0:1786562524.255727:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652668288 00010000:00010000:1.0:1786562524.255780:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 28 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.255828:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652668672 00000100:00100000:1.0:1786562524.255832:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652668672 00000100:00100000:1.0:1786562524.255859:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652668800 00000100:00100000:1.0:1786562524.255863:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652668800 00010000:00010000:1.0:1786562524.255877:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689dee9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2b4 expref: 18 pid: 29967 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.255890:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652668928 00000100:00100000:1.0:1786562524.255893:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652668928 00010000:00010000:1.0:1786562524.255918:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689de87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc298 expref: 8 pid: 28862 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.255936:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8441 00000100:00100000:1.0:1786562524.255947:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652668288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.255965:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.255995:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 28 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256038:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 28 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256070:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689dda7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1593343) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc21a expref: 28 pid: 29967 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256090:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562524.256096:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562524.256106:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 7 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256124:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 7 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256175:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 7 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.256192:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654810752:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562524.256293:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.256335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8442 00000100:00100000:1.0:1786562524.256343:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652668800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.256352:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.256368:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689dee9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2b4 expref: 18 pid: 29967 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256380:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689dee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2b4 expref: 18 pid: 29967 timeout: 1056 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256397:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562524.256427:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652668800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 84us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.256435:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8442 00000100:00100000:1.0:1786562524.256457:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8443 00000100:00100000:1.0:1786562524.256464:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652668928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.256471:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.256481:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689de87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc298 expref: 8 pid: 28862 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256491:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689de87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc298 expref: 8 pid: 28862 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256504:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562524.256507:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562524.256514:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256536:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256560:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.256572:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654810880:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562524.256599:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.256619:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 955 00000100:00100000:1.0:1786562524.256628:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2350:x1873345652668672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.256638:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.256656:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689df0c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d7 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.256679:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562524.256684:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562524.256702:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2350:x1873345652668672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 75us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.256709:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 955 00000100:00100000:3.0:1786562524.259045:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652668544 00000100:00100000:3.0:1786562524.259054:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652668544 00000100:00100000:3.0:1786562524.259114:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6222 00000100:00100000:3.0:1786562524.259124:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:63952:x1873345652668544:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562524.259394:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:63952:x1873345652668544:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 272us (3963us total) trans 8589950537 rc 0/0 00000100:00100000:3.0:1786562524.259401:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6222 00000100:00100000:0.0:1786562524.269479:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.275128:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652669056 00000100:00100000:3.0:1786562524.275149:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652669056 00000100:00100000:3.0:1786562524.275235:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17331 00000100:00100000:3.0:1786562524.275248:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+16:63950:x1873345652669056:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562524.275273:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562524.275302:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc2de expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.275349:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.275359:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562524.275364:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1786562524.275370:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.275419:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.275436:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562524.275452:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654811008:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562524.275589:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9863ae540 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.281623:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.282130:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652669184 00000100:00100000:3.0:1786562524.282142:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652669184 00002000:00100000:3.0:1786562524.282211:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (2080768->2084863) req@ffff90e88720f800 x1873345652669184/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.282225:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720f800 with x1873345652669184 ext(2080768->2084863) 00010000:00010000:3.0:1786562524.282237:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 18 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.282276:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 18 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562524.282285:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88720f800 00000100:00100000:3.0:1786562524.282314:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5886 00000100:00100000:3.0:1786562524.282326:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652669184:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.282605:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652669184:12345-192.168.204.29@tcp:3:cat.0 Request processed in 280us (996us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562524.282614:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5886 00002000:00100000:3.0:1786562524.282621:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (2080768->2084863) req@ffff90e88720f800 x1873345652669184/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/4536 e 0 to 0 dl 1786562535 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.282630:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720f800 with x1873345652669184 ext(2080768->2084863) 00010000:00010000:3.0:1786562524.282636:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 18 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.282648:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 18 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562524.282656:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88720f800 00000100:00100000:1.0:1786562524.287568:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.292402:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654811008:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562524.292450:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.292481:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65e00, rc 0) 00000100:00100000:3.0:1786562524.292571:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+17:63950:x1873345652669056:12345-192.168.204.29@tcp:101:cat.0 Request processed in 17325us (23106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562524.292582:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17331 00000100:00100000:0.0:1786562524.304850:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.304945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.307771:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652669696 00000100:00100000:3.0:1786562524.307778:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652669696 00002000:00100000:3.0:1786562524.307835:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (2940928->2945023) req@ffff90e88b11f100 x1873345652669696/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.307846:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11f100 with x1873345652669696 ext(2940928->2945023) 00002000:00010000:3.0:1786562524.307852:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11f100 00000100:00100000:3.0:1786562524.308134:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11306 00000100:00100000:3.0:1786562524.308144:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2349:x1873345652669696:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562524.308693:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2349:x1873345652669696:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 548us (3745us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562524.308703:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11306 00002000:00100000:3.0:1786562524.308710:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (2940928->2945023) req@ffff90e88b11f100 x1873345652669696/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/4536 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.308719:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11f100 with x1873345652669696 ext(2940928->2945023) 00002000:00010000:3.0:1786562524.308723:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11f100 00000100:00100000:0.0:1786562524.309952:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652669440 00000100:00100000:0.0:1786562524.309960:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652669440 00002000:00100000:0.0:1786562524.310041:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72f:0x0] (2080768->2097151) req@ffff90e9a99fbb80 x1873345652669440/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 16872/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.310052:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fbb80 with x1873345652669440 ext(2080768->2097151) 00010000:00010000:0.0:1786562524.310062:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.310086:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 17 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562524.310095:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9a99fbb80 00000100:00100000:0.0:1786562524.310127:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5887 00000100:00100000:0.0:1786562524.310137:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652669440:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562524.310635:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652669440:12345-192.168.204.29@tcp:4:cat.0 Request processed in 497us (949us total) trans 21474843507 rc 0/0 00000100:00100000:0.0:1786562524.310645:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5887 00002000:00100000:0.0:1786562524.310652:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72f:0x0] (2080768->2097151) req@ffff90e9a99fbb80 x1873345652669440/t21474843507(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 16872/448 e 0 to 0 dl 1786562535 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.310660:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fbb80 with x1873345652669440 ext(2080768->2097151) 00010000:00010000:0.0:1786562524.310667:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 19 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.310676:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 19 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562524.310682:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9a99fbb80 00000100:00100000:0.0:1786562524.322417:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652669312:12345-192.168.204.29@tcp:3:cat.0 Request processed in 34132us (34846us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562524.322435:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11305 00002000:00100000:0.0:1786562524.322453:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88720c000 x1873345652669312/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.322466:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720c000 with x1873345652669312 ext(1048576->2097151) 00010000:00010000:0.0:1786562524.322479:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 8 pid: 8368 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.322498:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 8 pid: 8368 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562524.322508:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88720c000 00000100:00100000:3.0:1786562524.330589:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.330730:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652669824 00000100:00100000:1.0:1786562524.330745:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652669824 00010000:00010000:1.0:1786562524.330809:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 19 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.330864:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8444 00000100:00100000:1.0:1786562524.330877:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652669824:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.330898:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.330927:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 19 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.330945:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 19 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.330974:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689df1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2d0 expref: 19 pid: 12119 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.331066:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:1.0:1786562524.331072:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:1.0:1786562524.331082:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 18 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.331095:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 18 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.331147:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 18 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.331165:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654811264:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562524.331279:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.338336:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.339141:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654811264:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562524.339175:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562524.339256:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652669824:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 8380us (8682us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.339271:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8444 00000100:00100000:1.0:1786562524.346956:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.347136:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652670080 00000100:00100000:3.0:1786562524.347150:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652670080 00002000:00100000:3.0:1786562524.347218:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (3158016->3162111) req@ffff90e88720ce00 x1873345652670080/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.347233:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720ce00 with x1873345652670080 ext(3158016->3162111) 00002000:00010000:3.0:1786562524.347240:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720ce00 00000100:00100000:3.0:1786562524.347280:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11307 00000100:00100000:3.0:1786562524.347291:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652670080:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562524.347595:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652670080:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 305us (651us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562524.347604:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11307 00002000:00100000:3.0:1786562524.347611:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (3158016->3162111) req@ffff90e88720ce00 x1873345652670080/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/4536 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.347620:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720ce00 with x1873345652670080 ext(3158016->3162111) 00002000:00010000:3.0:1786562524.347624:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720ce00 00000100:00100000:3.0:1786562524.359637:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.361975:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652670208 00000100:00100000:1.0:1786562524.361995:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652670208 00002000:00100000:1.0:1786562524.362121:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88be22a00 x1873345652670208/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.362143:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22a00 with x1873345652670208 ext(1048576->2097151) 00002000:00010000:1.0:1786562524.362149:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be22a00 00000100:00100000:1.0:1786562524.362185:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11308 00000100:00100000:1.0:1786562524.362195:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652670208:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562524.383445:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.383553:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.384277:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652670336 00000100:00100000:0.0:1786562524.384283:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652670336 00010000:00010000:0.0:1786562524.384316:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 10 pid: 8368 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.384354:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8445 00000100:00100000:0.0:1786562524.384362:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652670336:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562524.384374:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562524.384409:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 10 pid: 8368 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.384426:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 10 pid: 8368 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.384454:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689deb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2a6 expref: 10 pid: 8368 timeout: 1056 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.384480:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562524.384484:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562524.384492:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.384501:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.384561:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.384580:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654811392:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562524.384663:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562524.393754:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652670208:12345-192.168.204.29@tcp:3:cat.0 Request processed in 31558us (34134us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562524.393765:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11308 00002000:00100000:0.0:1786562524.393782:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88be22a00 x1873345652670208/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.393795:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22a00 with x1873345652670208 ext(1048576->2097151) 00002000:00010000:0.0:1786562524.393803:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be22a00 00000100:00100000:3.0:1786562524.402627:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.424582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.424726:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652670848 00000100:00100000:0.0:1786562524.424739:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652670848 00000100:00100000:0.0:1786562524.424821:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6223 00000100:00100000:0.0:1786562524.424833:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+509:63946:x1873345652670848:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562524.425196:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+510:63946:x1873345652670848:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 365us (628us total) trans 8589950538 rc 0/0 00000100:00100000:0.0:1786562524.425204:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6223 00000100:00100000:3.0:1786562524.441829:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.442001:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652670976 00000100:00100000:1.0:1786562524.442058:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652670976 00002000:00100000:1.0:1786562524.442130:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1409024->2097151) req@ffff90e88b518e00 x1873345652670976/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.442143:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518e00 with x1873345652670976 ext(1409024->2097151) 00002000:00010000:1.0:1786562524.442149:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b518e00 00000100:00100000:1.0:1786562524.442178:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11310 00000100:00100000:1.0:1786562524.442188:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652670976:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.463799:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.463843:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.463880:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.463916:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652671104 00000100:00100000:3.0:1786562524.463928:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652671104 00002000:00100000:3.0:1786562524.463990:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b519f80 x1873345652671104/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.464039:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519f80 with x1873345652671104 ext(2097152->3145727) 00002000:00010000:3.0:1786562524.464048:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519f80 00000100:00100000:3.0:1786562524.464073:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652671232 00000100:00100000:3.0:1786562524.464077:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652671232 00002000:00100000:3.0:1786562524.464093:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3162112->4145151) req@ffff90e88b519c00 x1873345652671232/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.464102:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519c00 with x1873345652671232 ext(3162112->4145151) 00002000:00010000:3.0:1786562524.464106:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519c00 00000100:00100000:3.0:1786562524.464122:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11311 00000100:00100000:3.0:1786562524.464133:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652671104:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.464943:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652671360 00000100:00100000:3.0:1786562524.464953:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652671360 00002000:00100000:3.0:1786562524.464986:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (2097152->2940927) req@ffff90e88313c380 x1873345652671360/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.464996:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313c380 with x1873345652671360 ext(2097152->2940927) 00002000:00010000:3.0:1786562524.465001:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313c380 00000100:00100000:3.0:1786562524.465054:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11312 00000100:00100000:3.0:1786562524.465063:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652671232:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.465764:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11313 00000100:00100000:3.0:1786562524.465776:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652671360:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562524.467317:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652670976:12345-192.168.204.29@tcp:3:cat.0 Request processed in 25115us (25493us total) trans 0 rc 688128/688128 00000100:00100000:1.0:1786562524.467332:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11310 00002000:00100000:1.0:1786562524.467347:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1409024->2097151) req@ffff90e88b518e00 x1873345652670976/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 688128/688128 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.467358:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518e00 with x1873345652670976 ext(1409024->2097151) 00002000:00010000:1.0:1786562524.467366:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b518e00 00000100:00100000:0.0:1786562524.506868:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.508840:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652671232:12345-192.168.204.29@tcp:3:cat.0 Request processed in 43774us (44991us total) trans 0 rc 983040/983040 00000100:00100000:3.0:1786562524.508851:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11312 00002000:00100000:3.0:1786562524.508859:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (3162112->4145151) req@ffff90e88b519c00 x1873345652671232/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.508876:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519c00 with x1873345652671232 ext(3162112->4145151) 00002000:00010000:3.0:1786562524.508881:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519c00 00000100:00100000:3.0:1786562524.508973:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652671104:12345-192.168.204.29@tcp:3:cat.0 Request processed in 44842us (45191us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562524.508980:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11311 00002000:00100000:3.0:1786562524.508987:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b519f80 x1873345652671104/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.508996:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519f80 with x1873345652671104 ext(2097152->3145727) 00002000:00010000:3.0:1786562524.508999:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519f80 00000100:00100000:1.0:1786562524.536931:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.537083:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652671616 00000100:00100000:0.0:1786562524.537097:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652671616 00002000:00100000:0.0:1786562524.537166:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88720dc00 x1873345652671616/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.537180:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720dc00 with x1873345652671616 ext(2097152->3145727) 00002000:00010000:0.0:1786562524.537187:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720dc00 00000100:00100000:0.0:1786562524.537228:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11314 00000100:00100000:0.0:1786562524.537240:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652671616:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562524.547593:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.558093:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652671616:12345-192.168.204.29@tcp:3:cat.0 Request processed in 20836us (21159us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562524.558113:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11314 00002000:00100000:0.0:1786562524.558132:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88720dc00 x1873345652671616/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.558146:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720dc00 with x1873345652671616 ext(2097152->3145727) 00002000:00010000:0.0:1786562524.558154:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720dc00 00000100:00100000:0.0:1786562524.561953:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17336 00000100:00100000:0.0:1786562524.561971:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63940:x1873345652671744:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562524.561997:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562524.562069:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc301 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.562113:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 10 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.562125:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.562134:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000400:0x714:0x0].0x0 since=1s v=(0 4) 00010000:00010000:0.0:1786562524.562140:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:0.0:1786562524.562146:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.562192:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.562208:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 10 pid: 6658 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.562224:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654811520:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562524.562875:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 10 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.562889:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 10 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.562907:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654811648:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562524.562939:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.579741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.592951:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654811520:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562524.592972:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654811648:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562524.593058:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.593087:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9883f7600, rc 0) 00000100:00100000:0.0:1786562524.593157:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63940:x1873345652671744:12345-192.168.204.29@tcp:101:cat.0 Request processed in 31189us (45580us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562524.593168:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17336 00000100:00100000:1.0:1786562524.595150:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.595256:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652672000 00000100:00100000:0.0:1786562524.595269:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652672000 00002000:00100000:0.0:1786562524.595339:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88720c700 x1873345652672000/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 504/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.595353:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720c700 with x1873345652672000 ext(3145728->4194303) 00010000:00010000:0.0:1786562524.595372:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 10 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.595388:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 10 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.595399:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 10 pid: 6658 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.595411:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 10 pid: 6658 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562524.595418:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 2 locks timeout for req ffff90e88720c700 00000100:00100000:0.0:1786562524.595453:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5888 00000100:00100000:0.0:1786562524.595464:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652672000:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562524.623671:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652672000:12345-192.168.204.29@tcp:4:cat.0 Request processed in 28205us (28530us total) trans 17179875977 rc 0/0 00000100:00100000:0.0:1786562524.623684:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5888 00002000:00100000:0.0:1786562524.623697:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88720c700 x1873345652672000/t17179875977(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 504/448 e 0 to 0 dl 1786562535 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.623708:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720c700 with x1873345652672000 ext(3145728->4194303) 00010000:00010000:0.0:1786562524.623738:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 12 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.623752:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 12 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.623762:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 12 pid: 6658 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.623771:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689de6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc27c expref: 12 pid: 6658 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562524.623786:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 2 locks timeout for req ffff90e88720c700 00000100:00100000:3.0:1786562524.624418:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.626314:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652672128 00000100:00100000:0.0:1786562524.626335:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652672128 00002000:00100000:0.0:1786562524.626414:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (2940928->3211263) req@ffff90e9831ffb80 x1873345652672128/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.626427:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ffb80 with x1873345652672128 ext(2940928->3211263) 00010000:00010000:0.0:1786562524.626437:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 7 pid: 6660 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.626457:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 7 pid: 6660 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562524.626468:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9831ffb80 00000100:00100000:0.0:1786562524.626523:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5889 00000100:00100000:0.0:1786562524.626536:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652672128:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562524.642260:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.642445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.653212:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652672128:12345-192.168.204.29@tcp:4:cat.0 Request processed in 26661us (28782us total) trans 21474843508 rc 0/0 00000100:00100000:1.0:1786562524.653230:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5889 00002000:00100000:1.0:1786562524.653246:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (2940928->3211263) req@ffff90e9831ffb80 x1873345652672128/t21474843508(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/448 e 0 to 0 dl 1786562535 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.653258:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ffb80 with x1873345652672128 ext(2940928->3211263) 00010000:00010000:1.0:1786562524.653270:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 9 pid: 6660 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.653288:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc291 expref: 9 pid: 6660 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562524.653297:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9831ffb80 00000100:00100000:0.0:1786562524.661143:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652672256 00000100:00100000:0.0:1786562524.661165:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652672256 00010000:00010000:1.0:1786562524.661474:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 12 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.661534:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8446 00000100:00100000:1.0:1786562524.661546:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652672256:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.661564:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562524.661602:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562520 -> 1786562523 00002000:00010000:1.0:1786562524.661606:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562518 -> 1786562523 00010000:00010000:1.0:1786562524.661613:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 13 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.661630:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 13 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562524.679469:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.679523:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652672640 00000100:00100000:3.0:1786562524.679533:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652672640 00000100:00100000:3.0:1786562524.679591:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17008 00000100:00100000:3.0:1786562524.679602:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+510:63957:x1873345652672640:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562524.679635:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562524.679660:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689df52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc30f expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.679773:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.679791:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.679806:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.679824:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.679831:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.679838:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680327:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81d200/0x5c655bf66689df67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680339:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81d200/0x5c655bf66689df67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680347:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81d200/0x5c655bf66689df67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562524.680359:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562524.680480:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680489:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680496:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680504:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068da00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562524.680523:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680532:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680546:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562524.680551:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562524.680556:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680563:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689df59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680578:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680585:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680592:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680597:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562524.680600:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680607:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680615:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab200) 00010000:00010000:3.0:1786562524.680618:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562524.680623:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680629:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689df60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680678:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689df52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc30f expref: 513 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680694:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81d200/0x5c655bf66689df67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc30f expref: 512 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.680702:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562524.680705:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562524.680708:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af81d200, rc 0) 00000100:00100000:3.0:1786562524.680773:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+512:63957:x1873345652672640:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1173us (1309us total) trans 8589950539 rc 0/0 00000100:00100000:3.0:1786562524.680781:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17008 00000100:00100000:3.0:1786562524.690639:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562524.699751:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689df2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4145151] (req 3145728->3162111) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2ec expref: 11 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.699788:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:1.0:1786562524.699794:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:1.0:1786562524.699805:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.699818:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.699893:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.699914:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654812032:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562524.700070:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562524.706857:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.706971:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652673024 00000100:00100000:1.0:1786562524.706988:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652673024 00000100:00100000:1.0:1786562524.707102:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17009 00000100:00100000:1.0:1786562524.707115:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:63958:x1873345652673024:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562524.707151:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562524.707184:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689df75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc316 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707290:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707308:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707321:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707338:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707344:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707351:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707820:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689df8a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707832:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689df8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707840:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689df8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562524.707852:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562524.707976:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707990:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.707997:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708029:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562524.708035:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708043:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708059:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562524.708062:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562524.708068:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708074:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689df7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708093:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708099:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708106:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708112:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562524.708116:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708122:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708129:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562524.708132:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562524.708135:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708140:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689df83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708190:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689df75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc316 expref: 19 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708205:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689df8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc316 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.708214:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562524.708216:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562524.708219:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0400, rc 0) 00000100:00100000:1.0:1786562524.708297:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:63958:x1873345652673024:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1184us (1456us total) trans 8589950540 rc 0/0 00000100:00100000:1.0:1786562524.708305:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17009 00000100:00100000:0.0:1786562524.718335:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.718687:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652673152 00000100:00100000:1.0:1786562524.718713:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654812032:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562524.718717:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652673152 00010000:00010000:1.0:1786562524.718754:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562524.718848:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652672256:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 57303us (76600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.718864:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8446 00000100:00100000:3.0:1786562524.719203:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 956 00000100:00100000:3.0:1786562524.719215:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+512:2350:x1873345652673152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562524.719232:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562524.719265:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81d200/0x5c655bf66689df67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc30f expref: 512 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562524.719292:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562524.719297:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562524.719320:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+511:2350:x1873345652673152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 109us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562524.719327:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 956 00000100:00100000:0.0:1786562524.722116:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.725654:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652673280 00000100:00100000:1.0:1786562524.725678:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652673280 00002000:00100000:1.0:1786562524.725766:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88b11dc00 x1873345652673280/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.725791:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11dc00 with x1873345652673280 ext(2097152->3145727) 00002000:00010000:1.0:1786562524.725799:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11dc00 00000100:00100000:1.0:1786562524.725841:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11315 00000100:00100000:1.0:1786562524.725853:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652673280:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562524.741268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562524.741318:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.741416:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652673408 00000100:00100000:1.0:1786562524.741431:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652673408 00002000:00100000:1.0:1786562524.741498:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b11d180 x1873345652673408/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.741521:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11d180 with x1873345652673408 ext(3145728->4194303) 00002000:00010000:1.0:1786562524.741528:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11d180 00000100:00100000:1.0:1786562524.741566:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11316 00000100:00100000:1.0:1786562524.741578:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652673408:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.743375:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652673664 00000100:00100000:3.0:1786562524.743393:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652673664 00000100:00100000:3.0:1786562524.743594:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6224 00000100:00100000:3.0:1786562524.743607:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:63958:x1873345652673664:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562524.748136:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63958:x1873345652673664:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 4516us (6800us total) trans 8589950541 rc 0/0 00000100:00100000:3.0:1786562524.748153:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6224 00000100:00100000:0.0:1786562524.748404:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.769191:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652673280:12345-192.168.204.29@tcp:3:cat.0 Request processed in 43321us (47072us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562524.769209:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11315 00002000:00100000:1.0:1786562524.769227:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88b11dc00 x1873345652673280/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.769240:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11dc00 with x1873345652673280 ext(2097152->3145727) 00002000:00010000:1.0:1786562524.769249:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11dc00 00000100:00100000:1.0:1786562524.789146:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652673408:12345-192.168.204.29@tcp:3:cat.0 Request processed in 47553us (47878us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562524.789164:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11316 00002000:00100000:1.0:1786562524.789181:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b11d180 x1873345652673408/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.789194:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11d180 with x1873345652673408 ext(3145728->4194303) 00002000:00010000:1.0:1786562524.789201:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11d180 00000100:00100000:1.0:1786562524.804201:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652673920 00000100:00100000:1.0:1786562524.804225:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652673920 00000100:00100000:1.0:1786562524.804346:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17338 00000100:00100000:1.0:1786562524.804361:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+29:63950:x1873345652673920:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562524.804392:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562524.804423:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689df98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc31d expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.804467:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:1.0:1786562524.804474:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:1.0:1786562524.804487:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689df98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc31d expref: 30 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.804521:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689df98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc31d expref: 30 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.804539:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0c00, rc 0) 00000100:00100000:1.0:1786562524.804637:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+30:63950:x1873345652673920:12345-192.168.204.29@tcp:101:cat.0 Request processed in 279us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.804646:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17338 00000100:00100000:0.0:1786562524.808548:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.812587:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652674048 00000100:00100000:1.0:1786562524.812611:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652674048 00000100:00100000:1.0:1786562524.812729:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17339 00000100:00100000:1.0:1786562524.812744:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63940:x1873345652674048:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562524.812781:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562524.812812:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6b383da/0x5c655bf66689df9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc324 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.812852:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562524.812859:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562524.812871:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b383da/0x5c655bf66689df9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc324 expref: 9 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.812893:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6b383da/0x5c655bf66689df9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc324 expref: 9 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.812911:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc1c00, rc 0) 00000100:00100000:1.0:1786562524.813059:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63940:x1873345652674048:12345-192.168.204.29@tcp:101:cat.0 Request processed in 318us (4528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562524.813068:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17339 00000100:00100000:0.0:1786562524.834576:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.837236:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652674176 00000100:00100000:3.0:1786562524.837259:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652674176 00002000:00100000:3.0:1786562524.837349:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b11e300 x1873345652674176/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562524.837364:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11e300 with x1873345652674176 ext(3145728->4194303) 00002000:00010000:3.0:1786562524.837372:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11e300 00000100:00100000:3.0:1786562524.837423:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11317 00000100:00100000:3.0:1786562524.837435:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652674176:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.852391:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562524.852446:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.852844:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652674304 00000100:00100000:1.0:1786562524.852858:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652674304 00002000:00100000:1.0:1786562524.852920:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9831fd880 x1873345652674304/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.852942:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd880 with x1873345652674304 ext(3145728->4194303) 00002000:00010000:1.0:1786562524.852949:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9831fd880 00000100:00100000:1.0:1786562524.852984:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652674432 00000100:00100000:1.0:1786562524.852987:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652674432 00002000:00100000:1.0:1786562524.853002:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9831ff480 x1873345652674432/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/0 e 0 to 0 dl 1786562535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562524.853059:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff480 with x1873345652674432 ext(3145728->4194303) 00002000:00010000:1.0:1786562524.853064:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9831ff480 00000100:00100000:1.0:1786562524.853084:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11318 00000100:00100000:1.0:1786562524.853094:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652674304:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562524.853983:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11319 00000100:00100000:3.0:1786562524.853997:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652674432:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562524.885747:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652674176:12345-192.168.204.29@tcp:3:cat.0 Request processed in 48299us (51172us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562524.885765:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11317 00002000:00100000:0.0:1786562524.885782:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b11e300 x1873345652674176/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:750/0 lens 488/440 e 0 to 0 dl 1786562535 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562524.885794:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11e300 with x1873345652674176 ext(3145728->4194303) 00002000:00010000:0.0:1786562524.885801:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11e300 00000100:00100000:0.0:1786562524.886785:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562524.911226:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562524.922588:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.931979:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.932070:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.935157:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17342 00000100:00100000:1.0:1786562524.935175:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652674944:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562524.935187:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562524.935204:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689dfb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc339 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.935277:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654812416:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562524.935407:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562524.950252:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:0.0:1786562524.951495:0:6659:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime: 1786562522 -> 1786562524 00000100:00100000:0.0:1786562524.951551:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654812416:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562524.951599:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689dfb4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc339 expref: 11 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.951629:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689dfb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc339 expref: 11 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.951644:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc1c00, rc 0) 00000100:00100000:0.0:1786562524.951739:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652674944:12345-192.168.204.29@tcp:101:cat.0 Request processed in 16570us (19667us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562524.951750:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17342 00000100:00100000:0.0:1786562524.952935:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675072 00000100:00100000:0.0:1786562524.952950:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675072 00000100:00100000:0.0:1786562524.953112:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17343 00000100:00100000:0.0:1786562524.953126:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652675072:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562524.953151:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562524.953176:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1820d4f/0x5c655bf66689dfbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc340 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.953211:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562524.953227:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1820d4f/0x5c655bf66689dfbb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc340 expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.953250:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1820d4f/0x5c655bf66689dfbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc340 expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562524.953263:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0515200, rc 0) 00000100:00100000:0.0:1786562524.953324:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652675072:12345-192.168.204.29@tcp:101:cat.0 Request processed in 201us (3090us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562524.953332:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17343 00000100:00100000:1.0:1786562524.974844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.974894:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562524.974927:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675328 00000100:00100000:1.0:1786562524.974940:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675328 00010000:00010000:1.0:1786562524.974992:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf66689df4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc308 expref: 20 pid: 29662 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.975049:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8450 00000100:00100000:1.0:1786562524.975073:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652675328:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562524.975094:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562524.975132:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf66689df4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc308 expref: 20 pid: 29662 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.975149:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf66689df4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc308 expref: 20 pid: 29662 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.975179:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf66689df4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc308 expref: 20 pid: 29662 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.975202:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562524.975207:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562524.975215:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.975227:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.975274:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562524.975297:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654812544:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562524.975829:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562524.976328:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675200 00000100:00100000:0.0:1786562524.976347:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675200 00000100:00100000:0.0:1786562524.976456:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17344 00000100:00100000:0.0:1786562524.976466:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652675200:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562524.976486:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562524.976517:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02ec842/0x5c655bf66689dfc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc347 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562524.976575:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654812672:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562524.976627:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562524.988252:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654812544:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562524.988291:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562524.988964:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:2349:x1873345652675328:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13890us (14065us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562524.988980:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8450 00002000:00010000:1.0:1786562524.998626:0:6659:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562523 -> 1786562524 00002000:00010000:1.0:1786562524.998646:0:6659:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562523 -> 1786562524 00002000:00010000:1.0:1786562524.998648:0:6659:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562523 -> 1786562524 00000100:00100000:1.0:1786562524.998693:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654812672:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562524.998786:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d02ec842/0x5c655bf66689dfc2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc347 expref: 20 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.998822:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02ec842/0x5c655bf66689dfc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc347 expref: 20 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562524.998839:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0514600, rc 0) 00000100:00100000:1.0:1786562524.998944:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652675200:12345-192.168.204.29@tcp:101:cat.0 Request processed in 22477us (24114us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562524.998958:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17344 00000100:00100000:0.0:1786562525.005316:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.006313:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675456 00000100:00100000:3.0:1786562525.006332:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675456 00002000:00100000:3.0:1786562525.006441:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (2908160->2912255) req@ffff90e88b11df80 x1873345652675456/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562525.006455:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11df80 with x1873345652675456 ext(2908160->2912255) 00002000:00010000:3.0:1786562525.006462:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11df80 00000100:00080000:0.0:1786562525.006587:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562525.008700:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11320 00000100:00100000:3.0:1786562525.008740:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652675456:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562525.009053:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652675456:12345-192.168.204.29@tcp:3:cat.0 Request processed in 336us (3753us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562525.009061:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11320 00002000:00100000:3.0:1786562525.009073:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (2908160->2912255) req@ffff90e88b11df80 x1873345652675456/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/4536 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562525.009083:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11df80 with x1873345652675456 ext(2908160->2912255) 00002000:00010000:3.0:1786562525.009091:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11df80 00000100:00100000:3.0:1786562525.028552:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.029041:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675584 00000100:00100000:0.0:1786562525.029066:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675584 00002000:00100000:0.0:1786562525.029170:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9831fed80 x1873345652675584/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.029184:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fed80 with x1873345652675584 ext(4194304->5185535) 00002000:00010000:0.0:1786562525.029191:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831fed80 00000100:00100000:0.0:1786562525.029231:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11321 00000100:00100000:0.0:1786562525.029244:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652675584:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562525.034358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.126283:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652675584:12345-192.168.204.29@tcp:3:cat.0 Request processed in 97025us (97733us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562525.126301:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11321 00002000:00100000:1.0:1786562525.126319:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9831fed80 x1873345652675584/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562525.126345:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fed80 with x1873345652675584 ext(4194304->5185535) 00002000:00010000:1.0:1786562525.126355:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831fed80 00000100:00100000:3.0:1786562525.131550:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.131589:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.131648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.132123:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675840 00000100:00100000:0.0:1786562525.132136:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675840 00000100:00100000:0.0:1786562525.132207:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652675968 00000100:00100000:0.0:1786562525.132211:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652675968 00000100:00100000:0.0:1786562525.132249:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652676096 00000100:00100000:0.0:1786562525.132252:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652676096 00000100:00100000:0.0:1786562525.132278:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17345 00000100:00100000:0.0:1786562525.132289:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652675840:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562525.132313:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562525.132445:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689dfc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc34e expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562525.132537:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654812800:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562525.132639:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562525.132664:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17346 00000100:00100000:0.0:1786562525.132672:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652675968:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562525.132682:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562525.132694:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02ec842/0x5c655bf66689dfd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc355 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.132841:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17347 00000100:00100000:3.0:1786562525.132853:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63958:x1873345652676096:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562525.132861:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.132872:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689dfd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc35c expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.132894:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 13 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.132905:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689df98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc31d expref: 30 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.132913:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562525.132918:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562525.132924:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689dfd7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc35c expref: 13 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.132955:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689df98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc31d expref: 30 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.132969:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689df98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc31d expref: 30 pid: 28862 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.132980:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654812928:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562525.133061:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 13 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.133070:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689df44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc301 expref: 13 pid: 6660 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.133079:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654813056:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562525.133101:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562525.136708:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654813184:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562525.136891:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2780 going to sleep for 11 seconds 00000100:00080000:0.0:1786562525.136935:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562525.151173:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654813184:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562525.151228:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d02ec842/0x5c655bf66689dfd0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc355 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.151260:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02ec842/0x5c655bf66689dfd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc355 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.151277:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0514600, rc 0) 00000100:00100000:1.0:1786562525.151379:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652675968:12345-192.168.204.29@tcp:101:cat.0 Request processed in 18706us (19787us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562525.151391:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17346 00000100:00100000:3.0:1786562525.155433:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.155561:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.155592:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652676352 00000100:00100000:3.0:1786562525.155605:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652676352 00000100:00100000:3.0:1786562525.155670:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17348 00000100:00100000:3.0:1786562525.155682:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+30:63957:x1873345652676352:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562525.155711:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.156095:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc363 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.156192:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562525.156198:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562525.156206:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->3411967] (req 3145728->3411967) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 31 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.156220:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->3411967] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 31 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.156241:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af81d200, rc 0) 00000100:00100000:3.0:1786562525.156307:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+31:63957:x1873345652676352:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 627us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.156315:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17348 00000100:00100000:1.0:1786562525.160327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.162193:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652676480 00000100:00100000:3.0:1786562525.162210:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652676480 00000100:00100000:3.0:1786562525.162290:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17349 00000100:00100000:3.0:1786562525.162302:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652676480:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562525.162330:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.162357:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689dfe5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc36a expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.162391:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 4) 00010000:00010000:3.0:1786562525.162412:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689dfe5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc36a expref: 31 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.162439:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689dfe5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc36a expref: 31 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.162457:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:3.0:1786562525.162556:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652676480:12345-192.168.204.29@tcp:101:cat.0 Request processed in 254us (2240us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562525.162564:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17349 00002000:00010000:0.0:1786562525.164063:0:29964:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562523 -> 1786562524 00002000:00010000:0.0:1786562525.164074:0:29964:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562523 -> 1786562524 00000100:00100000:0.0:1786562525.164105:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654812800:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562525.164160:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689dfc9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc34e expref: 12 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.164182:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689dfc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc34e expref: 12 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.164195:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0515200, rc 0) 00000100:00100000:0.0:1786562525.164252:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652675840:12345-192.168.204.29@tcp:101:cat.0 Request processed in 31965us (32718us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562525.164260:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17345 00000100:00100000:1.0:1786562525.216554:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.227844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.227981:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.229352:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652676864 00000100:00100000:0.0:1786562525.229371:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652676864 00000100:00100000:0.0:1786562525.229453:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652677120 00000100:00100000:0.0:1786562525.229456:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652677120 00000100:00100000:0.0:1786562525.229494:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6225 00000100:00100000:0.0:1786562525.229518:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+511:63950:x1873345652676864:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562525.230367:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6226 00000100:00100000:3.0:1786562525.230381:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:63940:x1873345652677120:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562525.230574:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63940:x1873345652677120:12345-192.168.204.29@tcp:35:cat.0 Request processed in 196us (2591us total) trans 8589950543 rc 0/0 00000100:00100000:3.0:1786562525.230583:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6226 00000100:00100000:0.0:1786562525.231045:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+512:63950:x1873345652676864:12345-192.168.204.29@tcp:35:cat.0 Request processed in 1528us (3216us total) trans 8589950542 rc 0/0 00000100:00100000:0.0:1786562525.231069:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6225 00000100:00100000:1.0:1786562525.235980:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.237624:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652677248 00000100:00100000:0.0:1786562525.237643:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652677248 00002000:00100000:0.0:1786562525.237743:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3792896->3796991) req@ffff90e9bfe92300 x1873345652677248/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.237757:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe92300 with x1873345652677248 ext(3792896->3796991) 00002000:00010000:0.0:1786562525.237763:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfe92300 00000100:00100000:0.0:1786562525.237816:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11323 00000100:00100000:0.0:1786562525.237827:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652677248:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562525.240127:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652677248:12345-192.168.204.29@tcp:3:cat.0 Request processed in 2287us (4141us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562525.240145:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11323 00002000:00100000:0.0:1786562525.240161:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3792896->3796991) req@ffff90e9bfe92300 x1873345652677248/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/4536 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.240174:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe92300 with x1873345652677248 ext(3792896->3796991) 00002000:00010000:0.0:1786562525.240181:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfe92300 00000100:00100000:1.0:1786562525.246943:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.248306:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652677376 00000100:00100000:0.0:1786562525.248324:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652677376 00002000:00100000:0.0:1786562525.248399:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3407872->3411967) req@ffff90e98873c700 x1873345652677376/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.248412:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c700 with x1873345652677376 ext(3407872->3411967) 00002000:00010000:0.0:1786562525.248418:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873c700 00000100:00100000:0.0:1786562525.248461:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11324 00000100:00100000:0.0:1786562525.248471:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652677376:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562525.248923:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652677376:12345-192.168.204.29@tcp:3:cat.0 Request processed in 451us (1994us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562525.248943:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11324 00002000:00100000:0.0:1786562525.248951:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3407872->3411967) req@ffff90e98873c700 x1873345652677376/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/4536 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.248961:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c700 with x1873345652677376 ext(3407872->3411967) 00002000:00010000:0.0:1786562525.248965:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873c700 00000100:00100000:1.0:1786562525.256479:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.256783:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652677632 00000100:00100000:3.0:1786562525.256796:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652677632 00000100:00100000:3.0:1786562525.256915:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6227 00000100:00100000:3.0:1786562525.256928:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+512:63957:x1873345652677632:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562525.264382:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.264551:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652677760 00000100:00100000:3.0:1786562525.264564:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652677760 00000100:00100000:3.0:1786562525.264643:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17350 00000100:00100000:3.0:1786562525.264659:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63958:x1873345652677760:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562525.264686:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.264989:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc371 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.265081:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.265094:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562525.265100:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 3) 00010000:00010000:3.0:1786562525.265106:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.265153:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.265171:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 18 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.265189:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654813568:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562525.265292:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e180 going to sleep for 11 seconds 00000100:00100000:1.0:1786562525.269188:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.269362:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654813568:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562525.269413:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.269442:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:3.0:1786562525.269527:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63958:x1873345652677760:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 4872us (5164us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.269539:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17350 00000100:00100000:0.0:1786562525.269970:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652677888 00000100:00100000:0.0:1786562525.269981:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652677888 00002000:00100000:0.0:1786562525.270121:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (2908160->3145727) req@ffff90e889d4b800 x1873345652677888/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.270133:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4b800 with x1873345652677888 ext(2908160->3145727) 00010000:00010000:0.0:1786562525.270141:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 19 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.270158:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 19 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562525.270166:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e889d4b800 00000100:00100000:0.0:1786562525.270195:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5890 00000100:00100000:0.0:1786562525.270207:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652677888:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562525.324310:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+21:2349:x1873345652677888:12345-192.168.204.29@tcp:4:cat.0 Request processed in 54088us (55120us total) trans 21474843509 rc 0/0 00000100:00100000:0.0:1786562525.324331:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5890 00002000:00100000:0.0:1786562525.324349:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (2908160->3145727) req@ffff90e889d4b800 x1873345652677888/t21474843509(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/448 e 0 to 0 dl 1786562536 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.324363:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4b800 with x1873345652677888 ext(2908160->3145727) 00010000:00010000:0.0:1786562525.324377:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 21 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.324405:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 21 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562525.324416:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e889d4b800 00000100:00100000:1.0:1786562525.327598:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652678016 00000100:00100000:1.0:1786562525.327611:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652678016 00010000:00010000:1.0:1786562525.327844:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 21 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562525.327939:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8453 00000100:00100000:1.0:1786562525.327954:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652678016:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562525.327975:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562525.328097:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 21 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.328115:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 21 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.328150:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689dfa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc32b expref: 21 pid: 29967 timeout: 1057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.328174:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 3) 00010000:00010000:1.0:1786562525.328179:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 3) 00010000:00010000:1.0:1786562525.328190:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.328213:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.328297:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562525.328317:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654813696:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562525.328515:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562525.359337:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652678144 00000100:00100000:3.0:1786562525.359360:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652678144 00000100:00100000:1.0:1786562525.425870:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.426073:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652678400 00000100:00100000:3.0:1786562525.426087:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652678400 00000100:00100000:3.0:1786562525.426180:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17010 00000100:00100000:3.0:1786562525.426309:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:63965:x1873345652678400:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562525.426347:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.426378:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689dff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc378 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.426488:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.426520:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.426534:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.426555:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.426563:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.426570:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427089:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e008 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427102:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e008 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427110:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e008 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562525.427122:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562525.427934:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427946:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427954:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427963:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf65600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562525.427968:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427976:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.427994:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562525.427998:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562525.428035:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428043:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689dffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428062:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428069:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428074:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428080:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562525.428082:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428088:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428100:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab000) 00010000:00010000:3.0:1786562525.428103:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562525.428106:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428112:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428175:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689dff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc378 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428205:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e008 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc378 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.428214:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562525.428217:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562525.428219:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068da00, rc 0) 00000100:00100000:3.0:1786562525.428320:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:63965:x1873345652678400:12345-192.168.204.29@tcp:101:cat.0 Request processed in 2129us (2464us total) trans 8589950545 rc 0/0 00000100:00100000:3.0:1786562525.428331:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17010 00000100:00100000:1.0:1786562525.437622:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.437751:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.442485:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.443001:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652678784 00000100:00100000:3.0:1786562525.443060:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652678784 00000100:00100000:3.0:1786562525.443144:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 958 00000100:00100000:3.0:1786562525.443155:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2349:x1873345652678784:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562525.443176:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562525.443226:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e008 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc378 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.443255:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562525.443261:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562525.443334:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+20:2349:x1873345652678784:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 181us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.443342:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 958 00000100:00100000:3.0:1786562525.448209:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17352 00000100:00100000:3.0:1786562525.448243:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652678656:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562525.448268:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.448294:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e01d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc386 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.448346:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e01d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc386 expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.448373:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e01d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc386 expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.448392:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068c400, rc 0) 00000100:00100000:3.0:1786562525.448508:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652678656:12345-192.168.204.29@tcp:101:cat.0 Request processed in 268us (10741us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562525.448517:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17352 00000100:00100000:0.0:1786562525.476617:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652678912 00000100:00100000:0.0:1786562525.476634:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652678912 00002000:00100000:0.0:1786562525.476712:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e9831fd500 x1873345652678912/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.476726:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd500 with x1873345652678912 ext(1048576->2097151) 00002000:00010000:0.0:1786562525.476733:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9831fd500 00000100:00100000:0.0:1786562525.476787:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11326 00000100:00100000:0.0:1786562525.476800:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652678912:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562525.504365:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652678912:12345-192.168.204.29@tcp:3:cat.0 Request processed in 27551us (28854us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562525.504382:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11326 00002000:00100000:0.0:1786562525.504399:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e9831fd500 x1873345652678912/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.504412:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd500 with x1873345652678912 ext(1048576->2097151) 00002000:00010000:0.0:1786562525.504421:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9831fd500 00000100:00100000:1.0:1786562525.518920:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.518987:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652679168 00000100:00100000:1.0:1786562525.519000:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652679168 00000100:00100000:1.0:1786562525.519204:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17011 00000100:00100000:1.0:1786562525.519217:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+513:63968:x1873345652679168:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562525.519250:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562525.519277:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689e024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc38d expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.519379:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.519396:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.519409:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.519427:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.519435:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.519442:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520139:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1600/0x5c655bf66689e039 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520157:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1600/0x5c655bf66689e039 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520166:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1600/0x5c655bf66689e039 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562525.520178:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562525.520305:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520314:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520319:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520326:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a99f1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562525.520330:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520339:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520353:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562525.520357:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562525.520363:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520370:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689e02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520392:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520397:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520403:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520409:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a99f1000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562525.520412:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520419:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520427:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562525.520429:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562525.520432:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520438:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520628:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0c00/0x5c655bf66689e024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc38d expref: 516 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520647:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1600/0x5c655bf66689e039 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc38d expref: 515 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.520662:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562525.520665:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562525.520668:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1600, rc 0) 00000100:00100000:1.0:1786562525.520749:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+515:63968:x1873345652679168:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1534us (1844us total) trans 8589950546 rc 0/0 00000100:00100000:1.0:1786562525.520759:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17011 00000100:00100000:0.0:1786562525.526685:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.526850:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652679296 00000100:00100000:1.0:1786562525.526864:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652679296 00000100:00100000:1.0:1786562525.526954:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 959 00000100:00100000:1.0:1786562525.526967:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+515:2350:x1873345652679296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562525.526989:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786562525.527847:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.527945:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652679424 00000100:00100000:0.0:1786562525.527954:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652679424 00000100:00100000:0.0:1786562525.528211:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17353 00000100:00100000:0.0:1786562525.528225:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652679424:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562525.528254:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562525.528282:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689e047 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc394 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.528335:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689e047 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc394 expref: 31 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.528360:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689e047 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc394 expref: 31 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.528377:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364200, rc 0) 00000100:00100000:0.0:1786562525.528471:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652679424:12345-192.168.204.29@tcp:101:cat.0 Request processed in 251us (629us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562525.528480:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17353 00010000:00010000:1.0:1786562525.530424:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1600/0x5c655bf66689e039 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc38d expref: 515 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.530456:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562525.530463:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562525.534140:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+514:2350:x1873345652679296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6029us (6323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562525.534164:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 959 00000100:00100000:0.0:1786562525.549635:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.550086:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652679552 00000100:00100000:1.0:1786562525.550104:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652679552 00000100:00100000:1.0:1786562525.550186:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17354 00000100:00100000:1.0:1786562525.550207:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652679552:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562525.550233:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562525.550258:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689e04e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc39b expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562525.550343:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654813952:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562525.550452:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562525.569454:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.569525:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.569560:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652679808 00000100:00100000:3.0:1786562525.569572:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652679808 00000100:00100000:3.0:1786562525.569652:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17012 00000100:00100000:3.0:1786562525.569663:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+514:63970:x1873345652679808:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562525.569705:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.569731:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e055 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3a2 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.569851:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.570208:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.570245:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.570266:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.570273:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.570280:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.573849:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e06a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575040:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575061:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562525.575081:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562525.575258:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575269:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575277:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575284:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068da00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562525.575289:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575298:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575314:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562525.575317:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562525.575323:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575329:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575349:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575360:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575367:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575373:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99822c000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562525.575376:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575383:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575390:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab000) 00010000:00010000:3.0:1786562525.575393:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562525.575397:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575403:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575466:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a2 expref: 517 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575483:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e06a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a2 expref: 516 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.575491:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562525.575504:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562525.575508:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfd5a800, rc 0) 00000100:00100000:3.0:1786562525.575562:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+516:63970:x1873345652679808:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 5899us (6035us total) trans 8589950547 rc 0/0 00000100:00100000:3.0:1786562525.575572:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17012 00000100:00100000:0.0:1786562525.581536:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654814080:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562525.581588:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e071 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a9 expref: 11 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.581618:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:0.0:1786562525.581702:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63965:x1873345652679936:12345-192.168.204.29@tcp:101:cat.0 Request processed in 7314us (12248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562525.581713:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17355 00000100:00100000:0.0:1786562525.585648:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.606872:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9c1d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+32:2351:x1873345652680064:12345-192.168.204.29@tcp:4:cat.0 Request processed in 20229us (21225us total) trans 17179875978 rc 0/0 00000100:00100000:1.0:1786562525.606890:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5891 00002000:00100000:1.0:1786562525.606907:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x713:0x0] (1048576->1409023) req@ffff90e9c1d19c50 x1873345652680064/t17179875978(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/448 e 0 to 0 dl 1786562536 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562525.606918:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9c1d19c50 with x1873345652680064 ext(1048576->1409023) 00010000:00010000:1.0:1786562525.607950:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 32 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.607983:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 32 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562525.607996:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9c1d19c50 00000100:00100000:0.0:1786562525.610269:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.610736:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652680192 00000100:00100000:3.0:1786562525.610750:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652680192 00000100:00100000:3.0:1786562525.610835:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 960 00000100:00100000:3.0:1786562525.610847:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+516:2350:x1873345652680192:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562525.610866:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562525.611158:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e06a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a2 expref: 516 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.611209:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562525.611218:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562525.611326:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+515:2350:x1873345652680192:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 479us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.611337:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 960 00000100:00100000:3.0:1786562525.614281:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.617580:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.617948:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652680576 00000100:00100000:3.0:1786562525.617962:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652680576 00000100:00100000:3.0:1786562525.618135:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17013 00000100:00100000:3.0:1786562525.618148:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+20:63972:x1873345652680576:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562525.618183:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.618212:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3b7 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562525.618216:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562525.618310:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.618328:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.618342:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.618359:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.618366:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.618373:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621416:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689e09b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621438:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689e09b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621453:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689e09b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562525.621466:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000100:00100000:0.0:1786562525.621512:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562525.621608:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621618:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621625:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621633:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562525.621638:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621646:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621662:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562525.621665:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562525.621670:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621675:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c400/0x5c655bf66689e08d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621690:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621697:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621703:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621709:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068da00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562525.621712:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621719:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621730:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab000) 00010000:00010000:3.0:1786562525.621732:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562525.621735:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621742:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621802:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b7 expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621817:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689e09b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b7 expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.621825:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562525.621827:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562525.621830:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9a00, rc 0) 00000100:00100000:3.0:1786562525.621894:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:63972:x1873345652680576:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 3748us (4326us total) trans 8589950548 rc 0/0 00000100:00100000:3.0:1786562525.621905:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17013 00000100:00100000:3.0:1786562525.621960:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652680832 00000100:00100000:3.0:1786562525.621969:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652680832 00010000:00010000:3.0:1786562525.621999:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 32 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.622058:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8454 00000100:00100000:3.0:1786562525.622068:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:2351:x1873345652680832:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562525.622084:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562525.622107:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 32 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.622120:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 32 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.622140:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187d4fc0/0x5c655bf66689df28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2e5 expref: 32 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.622156:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562525.622161:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562525.622169:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e071 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a9 expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.622180:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a9 expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.622223:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a9 expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.622238:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654814336:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562525.622302:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562525.632690:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654814336:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562525.632760:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562525.632876:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2351:x1873345652680832:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10806us (11686us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.632894:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8454 00000100:00100000:0.0:1786562525.633179:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.633370:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652680960 00000100:00100000:1.0:1786562525.633380:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652680960 00002000:00100000:1.0:1786562525.633436:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88b11f480 x1873345652680960/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562525.633448:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11f480 with x1873345652680960 ext(1048576->2097151) 00002000:00010000:1.0:1786562525.633454:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11f480 00000100:00100000:1.0:1786562525.633489:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11327 00000100:00100000:1.0:1786562525.633510:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652680960:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562525.667952:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652681216 00000100:00100000:1.0:1786562525.667966:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652681216 00000100:00100000:1.0:1786562525.668079:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6228 00000100:00100000:1.0:1786562525.668092:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:63972:x1873345652681216:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562525.668483:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+22:63972:x1873345652681216:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 393us (2518us total) trans 8589950549 rc 0/0 00000100:00100000:1.0:1786562525.668501:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6228 00000100:00100000:3.0:1786562525.671929:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652680704:12345-192.168.204.29@tcp:4:cat.0 Request processed in 51599us (53696us total) trans 21474843510 rc 0/0 00000100:00100000:3.0:1786562525.671949:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5892 00002000:00100000:3.0:1786562525.671967:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3375103) req@ffff90e88b11c380 x1873345652680704/t21474843510(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/448 e 0 to 0 dl 1786562536 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562525.671981:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11c380 with x1873345652680704 ext(3145728->3375103) 00010000:00010000:3.0:1786562525.671994:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 12 pid: 6660 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.672060:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b3af784e/0x5c655bf66689dfec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc371 expref: 12 pid: 6660 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562525.672072:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b11c380 00000100:00100000:1.0:1786562525.675546:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.675841:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652680960:12345-192.168.204.29@tcp:3:cat.0 Request processed in 42330us (42663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562525.675855:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11327 00002000:00100000:3.0:1786562525.675872:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88b11f480 x1873345652680960/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562525.675885:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11f480 with x1873345652680960 ext(1048576->2097151) 00002000:00010000:3.0:1786562525.675892:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11f480 00000100:00100000:3.0:1786562525.690913:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654814464:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562525.690954:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562525.691065:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652681472:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11558us (15533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.691080:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8455 00000100:00100000:1.0:1786562525.715928:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.725001:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.742246:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.742410:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652681856 00000100:00100000:0.0:1786562525.742423:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652681856 00002000:00100000:0.0:1786562525.742498:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3411968->3792895) req@ffff90e88b7eaa00 x1873345652681856/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.742512:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7eaa00 with x1873345652681856 ext(3411968->3792895) 00002000:00010000:0.0:1786562525.742519:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7eaa00 00000100:00100000:0.0:1786562525.742561:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11329 00000100:00100000:0.0:1786562525.742573:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652681856:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562525.758735:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652681856:12345-192.168.204.29@tcp:3:cat.0 Request processed in 16159us (16501us total) trans 0 rc 380928/380928 00000100:00100000:0.0:1786562525.758745:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11329 00002000:00100000:0.0:1786562525.758752:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3411968->3792895) req@ffff90e88b7eaa00 x1873345652681856/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 380928/380928 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.758856:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7eaa00 with x1873345652681856 ext(3411968->3792895) 00002000:00010000:0.0:1786562525.758861:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7eaa00 00000100:00100000:1.0:1786562525.769547:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.772860:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652681984 00000100:00100000:0.0:1786562525.772884:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652681984 00002000:00100000:0.0:1786562525.772967:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88b7e8380 x1873345652681984/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.772981:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7e8380 with x1873345652681984 ext(2097152->3145727) 00002000:00010000:0.0:1786562525.772989:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7e8380 00000100:00100000:0.0:1786562525.773087:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11330 00000100:00100000:0.0:1786562525.773099:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652681984:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562525.819043:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562525.819287:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652681984:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46187us (49755us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562525.819302:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11330 00002000:00100000:0.0:1786562525.819317:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88b7e8380 x1873345652681984/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.819330:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7e8380 with x1873345652681984 ext(2097152->3145727) 00002000:00010000:0.0:1786562525.819337:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7e8380 00000100:00100000:3.0:1786562525.823348:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652682112 00000100:00100000:3.0:1786562525.823371:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652682112 00000100:00100000:3.0:1786562525.823473:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17358 00000100:00100000:3.0:1786562525.823497:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+31:63968:x1873345652682112:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562525.823523:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.823549:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3c5 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.823593:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 32 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.823604:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689dfd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc35c expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.823612:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000400:0x714:0x0].0x0 since=1s v=(2 4) 00010000:00010000:3.0:1786562525.823618:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 4) 00010000:00010000:3.0:1786562525.823623:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 32 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.823668:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689dfd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc35c expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.823703:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689dfd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc35c expref: 10 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.823720:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654814592:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562525.824108:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 32 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.824118:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 32 pid: 29966 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.824128:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654814720:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562525.824156:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562525.841774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.841833:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562525.842070:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654814592:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562525.842088:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654814720:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562525.842133:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 32 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.842160:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9c00, rc 0) 00000100:00100000:3.0:1786562525.842254:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+32:63968:x1873345652682112:12345-192.168.204.29@tcp:101:cat.0 Request processed in 18770us (23224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562525.842265:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17358 00000100:00100000:0.0:1786562525.844403:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5894 00000100:00100000:0.0:1786562525.844426:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652682368:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562525.848623:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.891949:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562525.892021:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652682624 00000100:00100000:1.0:1786562525.892034:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652682624 00010000:00010000:1.0:1786562525.892085:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 34 pid: 29966 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562525.892138:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8456 00000100:00100000:1.0:1786562525.892150:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:2350:x1873345652682624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562525.892167:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562525.893302:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562523 -> 1786562524 00010000:00010000:1.0:1786562525.893321:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 34 pid: 29966 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.893339:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 34 pid: 29966 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.893373:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a49a99f/0x5c655bf66689dfde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [3145728->3792895] (req 3145728->3411967) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc363 expref: 34 pid: 29966 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.893396:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562525.893471:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652682624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1322us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562525.893482:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8456 00000100:00100000:1.0:1786562525.915480:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562525.925359:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562525.959603:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652682880 00000100:00100000:0.0:1786562525.959618:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652682880 00000100:00100000:3.0:1786562525.959630:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683392 00000100:00100000:3.0:1786562525.959637:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683392 00002000:00100000:0.0:1786562525.959701:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9831ff480 x1873345652682880/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.959721:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff480 with x1873345652682880 ext(3145728->4194303) 00002000:00010000:0.0:1786562525.959729:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831ff480 00000100:00100000:3.0:1786562525.961716:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17360 00000100:00100000:3.0:1786562525.961746:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:63970:x1873345652683392:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562525.961770:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562525.961797:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3d3 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.961842:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.961853:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.961862:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 3) 00010000:00010000:3.0:1786562525.961867:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 3) 00010000:00010000:3.0:1786562525.961873:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 5/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3244032->4128767] (req 3244032->4128767) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 22 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.961922:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.961938:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 11 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562525.961978:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683264 00000100:00100000:0.0:1786562525.961987:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683264 00002000:00100000:0.0:1786562525.962048:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9831fe680 x1873345652683264/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562525.962060:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fe680 with x1873345652683264 ext(3145728->4194303) 00010000:00010000:0.0:1786562525.962069:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562525.962084:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562525.962093:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9831fe680 00000100:00100000:0.0:1786562525.962119:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5895 00000100:00100000:0.0:1786562525.962127:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652683264:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562525.963234:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11331 00000100:00100000:0.0:1786562525.963250:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652682880:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562525.964222:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654815104:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562525.964370:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562525.964391:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562525.964405:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654815232:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562525.964435:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562525.973601:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683136 00000100:00100000:1.0:1786562525.973615:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683136 00002000:00100000:1.0:1786562525.973683:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9831fd500 x1873345652683136/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562525.973695:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd500 with x1873345652683136 ext(3145728->4194303) 00010000:00010000:1.0:1786562525.973707:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 23 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562525.973724:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 23 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562525.973733:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9831fd500 00000100:00100000:1.0:1786562525.975461:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683008 00000100:00100000:1.0:1786562525.975480:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683008 00002000:00100000:1.0:1786562525.975557:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9831ff800 x1873345652683008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/0 e 0 to 0 dl 1786562536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562525.975576:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff800 with x1873345652683008 ext(3145728->4194303) 00002000:00010000:1.0:1786562525.975582:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831ff800 00000100:00100000:3.0:1786562525.978112:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11332 00000100:00100000:3.0:1786562525.978284:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652683008:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562525.985113:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654815104:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562526.004707:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654815232:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.004770:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3244032->4128767] (req 3244032->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 24 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.004800:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9a00, rc 0) 00000100:00100000:1.0:1786562526.006269:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+24:63970:x1873345652683392:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 44526us (46821us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.006284:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17360 00000100:00100000:1.0:1786562526.018696:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652683264:12345-192.168.204.29@tcp:3:cat.0 Request processed in 56548us (67169us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562526.018717:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5895 00002000:00100000:1.0:1786562526.018740:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9831fe680 x1873345652683264/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:H/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.018753:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fe680 with x1873345652683264 ext(3145728->4194303) 00010000:00010000:1.0:1786562526.018768:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.018792:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.018801:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9831fe680 00000100:00100000:3.0:1786562526.032544:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652682880:12345-192.168.204.29@tcp:3:cat.0 Request processed in 69270us (81144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.032571:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11331 00002000:00100000:3.0:1786562526.032595:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9831ff480 x1873345652682880/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562526.032609:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff480 with x1873345652682880 ext(3145728->4194303) 00002000:00010000:3.0:1786562526.032619:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831ff480 00000100:00100000:3.0:1786562526.037062:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652683136:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 60587us (77557us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.037081:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5896 00002000:00100000:3.0:1786562526.037105:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9831fd500 x1873345652683136/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:H/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562526.037118:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd500 with x1873345652683136 ext(3145728->4194303) 00000100:00100000:0.0:1786562526.037123:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562526.037136:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.037158:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562526.037168:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9831fd500 00000100:00100000:1.0:1786562526.038394:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683520 00000100:00100000:1.0:1786562526.038412:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683520 00010000:00010000:1.0:1786562526.038471:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.038548:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8458 00000100:00100000:1.0:1786562526.038560:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652683520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.038581:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.038611:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.038628:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.038660:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e0a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3be expref: 12 pid: 6658 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.042853:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.042978:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652683520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4408us (5845us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.042996:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8458 00000100:00100000:3.0:1786562526.047998:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.049341:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683648 00000100:00100000:0.0:1786562526.049357:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683648 00010000:00010000:0.0:1786562526.049412:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.049469:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8459 00000100:00100000:0.0:1786562526.049481:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:2350:x1873345652683648:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.049511:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.049541:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.049559:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.049592:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689e07f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3b0 expref: 22 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.049614:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 3) 00010000:00010000:0.0:1786562526.049620:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 3) 00010000:00010000:0.0:1786562526.049630:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.049643:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.049705:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.049722:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654815360:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562526.050461:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.054435:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652683776 00000100:00100000:0.0:1786562526.054451:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652683776 00000100:00100000:0.0:1786562526.054533:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17361 00000100:00100000:0.0:1786562526.054547:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63965:x1873345652683776:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562526.054574:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562526.054599:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e0c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3da expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.054641:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.054653:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 3) 00010000:00010000:0.0:1786562526.054659:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 3) 00010000:00010000:0.0:1786562526.054666:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e0c5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3da expref: 12 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.054892:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.054910:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.054929:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654815488:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.055067:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562526.058535:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652683008:12345-192.168.204.29@tcp:3:cat.0 Request processed in 80391us (85083us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562526.058553:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11332 00002000:00100000:1.0:1786562526.058572:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9831ff800 x1873345652683008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:751/0 lens 488/440 e 0 to 0 dl 1786562536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.058593:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff800 with x1873345652683008 ext(3145728->4194303) 00002000:00010000:1.0:1786562526.058601:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831ff800 00000100:00100000:3.0:1786562526.066266:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654815360:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562526.066305:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562526.066385:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:2350:x1873345652683648:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 16905us (18401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.066400:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8459 00000100:00100000:3.0:1786562526.068552:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.070124:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654815488:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.070168:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e0c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3da expref: 12 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.070192:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1600, rc 0) 00000100:00100000:0.0:1786562526.070255:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63965:x1873345652683776:12345-192.168.204.29@tcp:101:cat.0 Request processed in 15711us (16692us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.070264:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17361 00000100:00100000:3.0:1786562526.075663:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.079301:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652684032 00000100:00100000:0.0:1786562526.079321:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652684032 00002000:00100000:1.0:1786562526.083244:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88b7ec380 x1873345652684032/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:752/0 lens 504/0 e 0 to 0 dl 1786562537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.083264:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ec380 with x1873345652684032 ext(3145728->4194303) 00010000:00010000:1.0:1786562526.083277:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.083304:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.083314:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b7ec380 00000100:00100000:1.0:1786562526.083423:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5898 00000100:00100000:1.0:1786562526.083437:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652684032:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562526.100724:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652684032:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 17270us (25057us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1786562526.100742:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5898 00002000:00100000:1.0:1786562526.100770:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88b7ec380 x1873345652684032/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:752/0 lens 504/440 e 0 to 0 dl 1786562537 ref 1 fl Complete:H/600/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.100784:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ec380 with x1873345652684032 ext(3145728->4194303) 00010000:00010000:1.0:1786562526.100797:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.100830:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.100839:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b7ec380 00000100:00100000:3.0:1786562526.140159:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652684416 00000100:00100000:3.0:1786562526.140175:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652684416 00000100:00100000:3.0:1786562526.140257:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17362 00000100:00100000:3.0:1786562526.140270:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63972:x1873345652684416:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562526.140298:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.140328:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3e1 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140370:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 10 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140388:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140397:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 20 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140407:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1786562526.140412:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.140418:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1376256->2097151] (req 1376256->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 13 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140465:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 20 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140479:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 20 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.140511:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654815616:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.140631:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140641:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.140657:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654815744:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.140703:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 10 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.140713:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 10 pid: 29662 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.140723:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654815872:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.140746:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.141534:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652684288 00000100:00100000:0.0:1786562526.141541:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652684288 00000100:00100000:0.0:1786562526.141594:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6229 00000100:00100000:0.0:1786562526.141601:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+515:63970:x1873345652684288:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562526.141950:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+516:63970:x1873345652684288:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 348us (2324us total) trans 8589950550 rc 0/0 00000100:00100000:0.0:1786562526.141958:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6229 00000100:00080000:3.0:1786562526.142423:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562526.142765:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652684544 00000100:00100000:1.0:1786562526.142775:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652684544 00002000:00100000:1.0:1786562526.142833:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (3244032->4128767) req@ffff90e88720f100 x1873345652684544/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:752/0 lens 488/0 e 0 to 0 dl 1786562537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.142846:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720f100 with x1873345652684544 ext(3244032->4128767) 00010000:00010000:1.0:1786562526.142856:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.142875:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 21 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.142883:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88720f100 00000100:00100000:1.0:1786562526.142920:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5899 00000100:00100000:1.0:1786562526.142932:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:2351:x1873345652684544:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:1.0:1786562526.148611:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652684800 00000100:00100000:1.0:1786562526.148624:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652684800 00000100:00100000:1.0:1786562526.148711:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17364 00000100:00100000:1.0:1786562526.148724:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652684800:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562526.148761:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562526.148788:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008abc1449/0x5c655bf66689e0da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3ef expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.148868:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654816000:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562526.148975:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.177408:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.177456:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.177514:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.177618:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652685056 00000100:00100000:1.0:1786562526.177632:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652685056 00010000:00010000:1.0:1786562526.177719:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 11 pid: 29662 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.177766:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652684928 00000100:00100000:1.0:1786562526.177770:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652684928 00010000:00010000:1.0:1786562526.177786:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 25 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.177806:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652685184 00000100:00100000:1.0:1786562526.177809:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652685184 00010000:00010000:1.0:1786562526.177822:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.177846:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8460 00000100:00100000:1.0:1786562526.177857:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652685056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.177876:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.177908:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 11 pid: 29662 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.177923:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 11 pid: 29662 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.177957:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689d81a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf6c expref: 11 pid: 29662 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.177980:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.178094:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652685056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 238us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.178103:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8460 00000100:00100000:1.0:1786562526.178125:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8461 00000100:00100000:1.0:1786562526.178131:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652684928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.178140:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.178149:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 25 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178160:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 25 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178174:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689da04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc022 expref: 25 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178185:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.178205:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652684928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 75us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.178212:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8461 00000100:00100000:1.0:1786562526.178226:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8462 00000100:00100000:1.0:1786562526.178234:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652685184:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.178242:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.178250:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178260:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178274:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689da20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc037 expref: 13 pid: 37002 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178286:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562526.178291:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562526.178300:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178312:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.178358:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.178376:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654816128:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562526.178439:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a1840 going to sleep for 11 seconds 00000100:00080000:0.0:1786562526.180325:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1786562526.185150:0:6658:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562524 -> 1786562525 00002000:00010000:3.0:1786562526.185164:0:6658:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562524 -> 1786562525 00002000:00010000:3.0:1786562526.185167:0:6658:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562524 -> 1786562525 00000100:00100000:3.0:1786562526.185196:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654816000:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562526.185251:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008abc1449/0x5c655bf66689e0da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3ef expref: 23 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.185282:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008abc1449/0x5c655bf66689e0da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3ef expref: 23 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.185298:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647000, rc 0) 00000100:00100000:3.0:1786562526.185358:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652684800:12345-192.168.204.29@tcp:101:cat.0 Request processed in 36636us (36903us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562526.185372:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17364 00000100:00100000:1.0:1786562526.187821:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654816128:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562526.187855:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.187921:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652685184:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 9687us (10405us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.187936:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8462 00000100:00100000:3.0:1786562526.189807:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.202569:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652684544:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 59621us (62812us total) trans 21474843511 rc 0/0 00000100:00100000:1.0:1786562526.202589:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5899 00002000:00100000:1.0:1786562526.202608:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (3244032->4128767) req@ffff90e88720f100 x1873345652684544/t21474843511(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:752/0 lens 488/448 e 0 to 0 dl 1786562537 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.202620:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720f100 with x1873345652684544 ext(3244032->4128767) 00010000:00010000:1.0:1786562526.202635:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 22 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.202659:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e0be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3244032->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3d3 expref: 22 pid: 28861 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.203435:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88720f100 00000100:00100000:0.0:1786562526.206497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.206536:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.206563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.206647:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652685440 00000100:00100000:3.0:1786562526.206659:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652685440 00000100:00100000:3.0:1786562526.206734:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652685568 00000100:00100000:3.0:1786562526.206737:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652685568 00000100:00100000:3.0:1786562526.206769:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17365 00000100:00100000:3.0:1786562526.206780:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+23:2351:x1873345652685440:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562526.206811:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.206839:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689e0e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3f6 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.206932:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654816256:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562526.207096:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562526.207123:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17366 00000100:00100000:3.0:1786562526.207132:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652685568:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562526.207140:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.207151:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689e0e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc3fd expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.207182:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654816384:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562526.207208:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00002000:00010000:1.0:1786562526.220278:0:29967:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562514 -> 1786562525 00002000:00010000:1.0:1786562526.220290:0:29967:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562513 -> 1786562525 00002000:00010000:1.0:1786562526.220293:0:29967:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562514 -> 1786562525 00000100:00100000:1.0:1786562526.220328:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654816256:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562526.220382:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689e0e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3f6 expref: 26 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.220413:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689e0e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3f6 expref: 26 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.220429:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176f200, rc 0) 00000100:00100000:1.0:1786562526.220525:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652685440:12345-192.168.204.29@tcp:101:cat.0 Request processed in 13746us (14054us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562526.220536:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17365 00000100:00100000:1.0:1786562526.229659:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.231613:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654816512:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562526.231647:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.231692:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652685696:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23291us (25126us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.231706:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8463 00000100:00100000:1.0:1786562526.245946:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.246121:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652685952 00000100:00100000:0.0:1786562526.246136:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652685952 00000100:00100000:0.0:1786562526.246214:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17367 00000100:00100000:0.0:1786562526.246227:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:63972:x1873345652685952:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562526.246254:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562526.246279:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc404 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.246322:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 20 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.246333:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.246343:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=1s v=(2 1) 00010000:00010000:0.0:1786562526.246349:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1786562526.246355:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 5/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.246400:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.246416:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 15 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.246442:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654816640:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.246581:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 20 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.246593:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 20 pid: 29964 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.246604:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654816768:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.246633:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562526.248453:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652685824:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 17870us (18795us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.248470:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11334 00002000:00100000:3.0:1786562526.248496:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88b7e8000 x1873345652685824/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/440 e 0 to 0 dl 1786562537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562526.248509:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7e8000 with x1873345652685824 ext(3145728->4194303) 00002000:00010000:3.0:1786562526.248517:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7e8000 00000100:00100000:1.0:1786562526.260385:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652686336 00000100:00100000:1.0:1786562526.260401:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652686336 00000100:00100000:1.0:1786562526.260499:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6230 00000100:00100000:1.0:1786562526.260514:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+516:63968:x1873345652686336:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1786562526.260895:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+517:63968:x1873345652686336:12345-192.168.204.29@tcp:35:cat.0 Request processed in 383us (703us total) trans 8589950551 rc 0/0 00000100:00100000:1.0:1786562526.260905:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6230 00000100:00100000:3.0:1786562526.261592:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652686080 00000100:00100000:3.0:1786562526.261602:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652686080 00010000:00010000:3.0:1786562526.261641:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 14 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.261693:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8464 00000100:00100000:3.0:1786562526.261702:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652686080:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562526.261717:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.261861:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 14 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.261880:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 14 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.261914:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562526.261965:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652686080:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 264us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.261973:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8464 00010000:00010000:0.0:1786562526.262236:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689dfad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc332 expref: 13 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.262255:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654816640:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.262269:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654816768:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.262304:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 12 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.262318:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0000, rc 0) 00000100:00100000:0.0:1786562526.262342:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63972:x1873345652685952:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 16119us (16413us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.262350:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17367 00000100:00100000:0.0:1786562526.264721:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652686592 00000100:00100000:0.0:1786562526.264734:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652686592 00010000:00010000:0.0:1786562526.264796:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 21 pid: 29964 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.264850:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8465 00000100:00100000:0.0:1786562526.264938:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:2351:x1873345652686592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.264959:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.264988:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 21 pid: 29964 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.265042:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 21 pid: 29964 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.265073:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b09a548d/0x5c655bf66689df21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2de expref: 21 pid: 29964 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.265094:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1786562526.265099:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1786562526.265108:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.265119:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.265167:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.265188:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654816896:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562526.265280:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562526.266178:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652686464 00000100:00100000:1.0:1786562526.266191:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652686464 00000100:00100000:1.0:1786562526.266250:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17368 00000100:00100000:1.0:1786562526.266261:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652686464:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562526.266281:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562526.266298:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070041611/0x5c655bf66689e0f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc40b expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.266357:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654817024:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562526.266587:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.281491:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654816896:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562526.281524:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.281603:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345652686592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 16670us (16972us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.281618:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8465 00000100:00100000:3.0:1786562526.281967:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652686720 00000100:00100000:3.0:1786562526.281977:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652686720 00002000:00100000:3.0:1786562526.282065:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72f:0x0] (1253376->1257471) req@ffff90e88720d500 x1873345652686720/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/0 e 0 to 0 dl 1786562537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562526.282086:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720d500 with x1873345652686720 ext(1253376->1257471) 00002000:00010000:3.0:1786562526.282093:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88720d500 00000100:00100000:3.0:1786562526.282122:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11335 00000100:00100000:3.0:1786562526.282133:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652686720:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562526.282368:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652686720:12345-192.168.204.29@tcp:3:cat.0 Request processed in 236us (1221us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562526.282376:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11335 00002000:00100000:3.0:1786562526.282383:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72f:0x0] (1253376->1257471) req@ffff90e88720d500 x1873345652686720/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/4536 e 0 to 0 dl 1786562537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562526.282392:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720d500 with x1873345652686720 ext(1253376->1257471) 00002000:00010000:3.0:1786562526.282396:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88720d500 00002000:00010000:1.0:1786562526.287313:0:37002:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562523 -> 1786562525 00002000:00010000:1.0:1786562526.287326:0:37002:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562522 -> 1786562525 00002000:00010000:1.0:1786562526.287329:0:37002:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562523 -> 1786562525 00000100:00100000:1.0:1786562526.287363:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654817024:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562526.287411:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070041611/0x5c655bf66689e0f6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc40b expref: 13 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.287439:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070041611/0x5c655bf66689e0f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc40b expref: 13 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.287453:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647c00, rc 0) 00000100:00100000:1.0:1786562526.287535:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652686464:12345-192.168.204.29@tcp:101:cat.0 Request processed in 21274us (22969us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562526.287546:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17368 00000100:00100000:1.0:1786562526.301601:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652686848 00000100:00100000:1.0:1786562526.301614:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652686848 00002000:00100000:1.0:1786562526.301699:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88720ed80 x1873345652686848/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/0 e 0 to 0 dl 1786562537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.301713:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720ed80 with x1873345652686848 ext(4194304->5185535) 00002000:00010000:1.0:1786562526.301721:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720ed80 00000100:00100000:1.0:1786562526.301771:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11336 00000100:00100000:1.0:1786562526.301783:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652686848:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562526.321434:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652686848:12345-192.168.204.29@tcp:3:cat.0 Request processed in 19635us (19963us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562526.321452:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11336 00002000:00100000:1.0:1786562526.321469:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88720ed80 x1873345652686848/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/440 e 0 to 0 dl 1786562537 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.321492:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720ed80 with x1873345652686848 ext(4194304->5185535) 00002000:00010000:1.0:1786562526.321500:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720ed80 00000100:00100000:0.0:1786562526.329774:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:0.0:1786562526.331649:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562526.366412:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652687232 00000100:00100000:3.0:1786562526.366426:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652687232 00000100:00100000:3.0:1786562526.366534:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17014 00000100:00100000:3.0:1786562526.366548:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:63976:x1873345652687232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562526.366576:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.366603:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068da00/0x5c655bf66689e0fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc412 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562526.366943:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786562526.367227:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e104 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.367249:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e104 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.367271:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e104 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.367289:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e10b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.367297:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.367304:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.368528:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.368559:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.368572:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.368625:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.368645:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 22 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.369347:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654817152:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.369548:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e180 going to sleep for 11 seconds 00000100:00100000:1.0:1786562526.374211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.374332:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652687488 00000100:00100000:0.0:1786562526.374347:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652687488 00000100:00100000:0.0:1786562526.374428:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6232 00000100:00100000:0.0:1786562526.374441:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+23:62205:x1873345652687488:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786562526.374811:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+24:62205:x1873345652687488:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 372us (615us total) trans 8589950553 rc 0/0 00000100:00100000:0.0:1786562526.374820:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6232 00000100:00100000:3.0:1786562526.375714:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654817152:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.375760:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.384853:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.386837:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652687616 00000100:00100000:3.0:1786562526.386910:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652687616 00010000:00010000:3.0:1786562526.386983:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 24 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.387209:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8466 00000100:00100000:3.0:1786562526.387222:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+24:2348:x1873345652687616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562526.387246:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.387255:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 24 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.387271:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 24 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.387303:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548e00/0x5c655bf66689dc1f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc156 expref: 24 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.387331:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562526.387338:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.387351:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.387360:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.388080:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562526.388171:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+23:2348:x1873345652687616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 948us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.388182:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8466 00000100:00100000:0.0:1786562526.399613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.399652:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.399692:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.399719:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.399736:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.406633:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.408093:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654817408:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562526.408116:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a704f7bd/0x5c655bf66689e127 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc427 expref: 12 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.408131:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a704f7bd/0x5c655bf66689e127 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc427 expref: 12 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.408142:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9862d0600, rc 0) 00000100:00100000:0.0:1786562526.408168:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652688000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 7429us (8475us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562526.408175:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17371 00000100:00100000:0.0:1786562526.408195:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17374 00000100:00100000:0.0:1786562526.408206:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652688256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562526.408223:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562526.408241:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc435 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.408268:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 4) 00010000:00010000:0.0:1786562526.408272:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 4) 00010000:00010000:0.0:1786562526.408282:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 13 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.408300:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 13 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.408316:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc1c00, rc 0) 00000100:00100000:0.0:1786562526.408333:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652688256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 131us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.408339:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17374 00000100:00100000:0.0:1786562526.413628:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.413874:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652688640 00000100:00100000:1.0:1786562526.413886:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652688640 00000100:00100000:1.0:1786562526.413954:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17015 00000100:00100000:1.0:1786562526.413967:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63976:x1873345652688640:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562526.413999:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562526.414253:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647c00/0x5c655bf66689e143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc443 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.414396:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.414414:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.414423:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.414468:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.414495:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 8 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.414511:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654817536:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562526.414649:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562526.420430:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.420523:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652688768 00000100:00100000:0.0:1786562526.420534:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652688768 00010000:00010000:0.0:1786562526.420583:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 9 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.420633:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8467 00000100:00100000:0.0:1786562526.420644:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2348:x1873345652688768:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.420668:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.420687:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 9 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.420703:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 9 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.420731:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562526.420737:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.420759:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.420773:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.420795:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.421039:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2348:x1873345652688768:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 364us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.421049:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8467 00010000:00010000:1.0:1786562526.422581:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e112 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc412 expref: 8 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.422610:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654817536:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.422643:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.422654:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.422661:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562526.423864:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562526.424276:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647c00/0x5c655bf66689e143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc443 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.424302:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc443 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.424313:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562526.424317:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562526.424321:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c646e00, rc 0) 00000100:00100000:1.0:1786562526.424410:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652688640:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 10444us (10794us total) trans 8589950554 rc 0/0 00000100:00100000:1.0:1786562526.424421:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17015 00000100:00100000:3.0:1786562526.428251:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.429032:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652688896 00000100:00100000:0.0:1786562526.429046:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652688896 00000100:00100000:0.0:1786562526.429821:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17016 00000100:00100000:0.0:1786562526.429839:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652688896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562526.429889:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562526.429918:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689e158 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc44a expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.430082:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.430100:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc443 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.430113:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.430226:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc443 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.430245:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc443 expref: 9 pid: 35929 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.430263:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654817664:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562526.430365:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a07a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562526.434430:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562526.435614:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646e00/0x5c655bf66689e14a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc443 expref: 9 pid: 35929 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.435637:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654817664:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.435806:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.435819:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.435826:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562526.435886:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562526.435892:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562526.435918:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.435960:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689e158 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc44a expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.435979:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc44a expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.435990:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562526.435993:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562526.435996:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0400, rc 0) 00000100:00100000:1.0:1786562526.436335:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652688896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6500us (8098us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.436345:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17016 00000100:00100000:3.0:1786562526.439789:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.439914:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652689152 00000100:00100000:0.0:1786562526.439927:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652689152 00000100:00100000:0.0:1786562526.440001:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17375 00000100:00100000:0.0:1786562526.440048:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652689152:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562526.440072:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562526.440097:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a704f7bd/0x5c655bf66689e166 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc451 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.440170:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654817792:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562526.440272:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562526.441274:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.444326:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654817792:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562526.444370:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a704f7bd/0x5c655bf66689e166 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc451 expref: 14 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.444397:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a704f7bd/0x5c655bf66689e166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc451 expref: 14 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.444411:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9862d0600, rc 0) 00000100:00100000:0.0:1786562526.444468:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652689152:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4424us (4691us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562526.444487:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17375 00000100:00100000:3.0:1786562526.451614:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.452089:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652689536 00000100:00100000:0.0:1786562526.452103:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652689536 00000100:00100000:0.0:1786562526.452174:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17017 00000100:00100000:0.0:1786562526.452187:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652689536:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562526.452216:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562526.452245:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860afc00/0x5c655bf66689e174 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc45f expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.452390:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e17b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.452412:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e17b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.452426:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e17b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562526.452442:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562526.452623:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860afc00/0x5c655bf66689e174 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc45f expref: 11 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.452647:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e17b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc45f expref: 10 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.452656:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562526.452660:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562526.452921:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880c00, rc 0) 00000100:00100000:1.0:1786562526.453171:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652689536:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 985us (1570us total) trans 8589950555 rc 0/0 00000100:00100000:1.0:1786562526.453181:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17017 00000100:00100000:3.0:1786562526.457523:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.457566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.457689:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.458443:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652689664 00000100:00100000:0.0:1786562526.458458:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652689664 00000100:00100000:0.0:1786562526.458529:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.458562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.458584:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.458661:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652689920 00000100:00100000:0.0:1786562526.458680:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652689920 00000100:00100000:0.0:1786562526.458703:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690176 00000100:00100000:0.0:1786562526.458706:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690176 00000100:00100000:0.0:1786562526.458721:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652689792 00000100:00100000:0.0:1786562526.458724:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652689792 00000100:00100000:0.0:1786562526.458739:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690048 00000100:00100000:0.0:1786562526.458894:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690048 00000100:00100000:0.0:1786562526.458920:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690304 00000100:00100000:0.0:1786562526.458924:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690304 00000100:00100000:0.0:1786562526.458947:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17377 00000100:00100000:0.0:1786562526.458958:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652689664:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562526.459044:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689e189 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459073:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 33 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459084:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e120 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc419 expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459093:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689de56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc267 expref: 12 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459103:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562526.459108:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562526.459113:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689e189 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459160:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689de56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc267 expref: 12 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459176:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689de56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc267 expref: 12 pid: 28862 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.459195:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654818048:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.459298:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e120 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc419 expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459308:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e120 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc419 expref: 15 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.459317:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654818176:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.459345:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 33 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459354:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 33 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.459362:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654818304:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.459379:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.459403:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17378 00000100:00100000:0.0:1786562526.459410:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652689920:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562526.459433:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e190 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459446:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459454:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1786562526.459457:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(3 1) 00010000:00010000:0.0:1786562526.459461:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e190 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459493:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459503:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 11 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.459515:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654818432:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.459540:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.459560:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17379 00000100:00100000:0.0:1786562526.459568:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652690176:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562526.459588:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459601:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 33 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459609:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459622:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459629:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689df36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2f3 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459637:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f96b197/0x5c655bf66689df3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2fa expref: 33 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459646:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000854a751/0x5c655bf66689de72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc283 expref: 33 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.459653:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 3 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 4) 00010000:00010000:0.0:1786562526.459656:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 4) 00010000:00010000:0.0:1786562526.459660:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 9/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.460455:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000854a751/0x5c655bf66689de72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc283 expref: 33 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.460466:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000854a751/0x5c655bf66689de72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc283 expref: 33 pid: 29967 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.460491:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819072:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.460530:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f96b197/0x5c655bf66689df3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2fa expref: 33 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.460540:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f96b197/0x5c655bf66689df3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2fa expref: 33 pid: 37002 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.460550:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819200:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.460576:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689df36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2f3 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.460586:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689df36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2f3 expref: 12 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.460595:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819328:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.460620:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.460629:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 12 pid: 6659 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.460639:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819456:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.460796:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17382 00000100:00100000:3.0:1786562526.460808:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652690304:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562526.460834:0:12119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.460848:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e0c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3da expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.460856:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.460863:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 3) 00010000:00010000:3.0:1786562526.460868:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 3) 00010000:00010000:3.0:1786562526.460872:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 5/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.460893:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.460902:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 13 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.460912:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654819712:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.460943:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e0c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3da expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.460953:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e0c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3da expref: 11 pid: 29966 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.460964:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654819840:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.460983:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e180 going to sleep for 11 seconds 00010000:00010000:0.0:1786562526.466114:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.466152:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 15 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.466176:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819584:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.466346:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 33 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.466357:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 33 pid: 29967 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.466366:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819968:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.466387:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc1b6300 going to sleep for 11 seconds 00000100:00100000:0.0:1786562526.474883:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.474920:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.474962:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690432 00000100:00100000:0.0:1786562526.474973:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690432 00010000:00010000:0.0:1786562526.475062:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e120 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc419 expref: 16 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.475104:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690560 00000100:00100000:0.0:1786562526.475107:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690560 00010000:00010000:0.0:1786562526.475126:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 34 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.475156:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8469 00000100:00100000:0.0:1786562526.475168:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652690432:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.475186:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.475217:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e120 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc419 expref: 16 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475233:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e120 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc419 expref: 16 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475271:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.475334:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652690432:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.475343:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8469 00000100:00100000:0.0:1786562526.475403:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8470 00000100:00100000:0.0:1786562526.475410:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652690560:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.475420:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.475429:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 34 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475442:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689dde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc24b expref: 34 pid: 12119 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475458:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.475490:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652690560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 67us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.475497:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8470 00000100:00100000:0.0:1786562526.475543:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.475566:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690688 00000100:00100000:0.0:1786562526.475570:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690688 00010000:00010000:0.0:1786562526.475587:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689de56 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc267 expref: 13 pid: 28862 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.475607:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8471 00000100:00100000:0.0:1786562526.475613:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652690688:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.475621:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.475630:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689de56 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc267 expref: 13 pid: 28862 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475642:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689de56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc267 expref: 13 pid: 28862 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475657:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562526.475663:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562526.475670:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689e189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475681:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689e189 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.475705:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.475723:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652690688:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 109us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.475729:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8471 00000100:00100000:1.0:1786562526.479931:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654818560:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.479969:0:28862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.482277:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.489050:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690816 00000100:00100000:1.0:1786562526.489075:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690816 00002000:00100000:1.0:1786562526.489161:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1257471) req@ffff90e9bfb5d500 x1873345652690816/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/0 e 0 to 0 dl 1786562537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.489174:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5d500 with x1873345652690816 ext(1048576->1257471) 00010000:00010000:1.0:1786562526.489186:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 12 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.489206:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 12 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.489223:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9bfb5d500 00000100:00100000:1.0:1786562526.489256:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5900 00000100:00100000:1.0:1786562526.489268:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652690816:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562526.490871:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654818688:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.509242:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819072:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.509297:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819200:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.509336:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819328:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.509373:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819456:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.509435:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.509463:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652691584 00000100:00100000:0.0:1786562526.509472:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652691584 00010000:00010000:0.0:1786562526.509535:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 14 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.509584:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8472 00000100:00100000:0.0:1786562526.509596:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652691584:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.509617:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.509650:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 14 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.511141:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.511200:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.511241:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.511269:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.511299:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.511327:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652690944 00000100:00100000:1.0:1786562526.511337:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652690944 00002000:00100000:1.0:1786562526.511399:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1376256->2097151) req@ffff90e88b7ebb80 x1873345652690944/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/0 e 0 to 0 dl 1786562537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.511413:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ebb80 with x1873345652690944 ext(1376256->2097151) 00010000:00010000:1.0:1786562526.511424:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 14 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.511446:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 14 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.511456:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b7ebb80 00000100:00100000:1.0:1786562526.511502:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5901 00000100:00100000:1.0:1786562526.511513:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652690944:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562526.511967:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.513752:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654819712:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.513772:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654819840:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562526.514391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562526.514458:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 14 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.514528:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.514541:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.514555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.514593:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562526.514614:0:12119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.514644:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652691456 00000100:00100000:3.0:1786562526.514648:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652691456 00000100:00100000:1.0:1786562526.514660:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652691968 00000100:00100000:1.0:1786562526.514663:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652691968 00010000:00010000:1.0:1786562526.514679:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e071 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3a9 expref: 13 pid: 29963 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.514680:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689df36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc2f3 expref: 13 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.514695:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652692096 00000100:00100000:1.0:1786562526.514695:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652692224 00000100:00100000:3.0:1786562526.514698:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652692096 00000100:00100000:1.0:1786562526.514698:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652692224 00010000:00010000:3.0:1786562526.514710:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 15 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.514710:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 14 pid: 6659 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.514722:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652692352 00000100:00100000:1.0:1786562526.514724:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652692352 00000100:00100000:3.0:1786562526.514726:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8474 00000100:00100000:3.0:1786562526.514731:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652691840:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.514734:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 36 pid: 29967 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.514741:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.514760:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e12e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc42e expref: 15 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.514761:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8475 00000100:00100000:1.0:1786562526.514768:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+36:2350:x1873345652691072:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562526.514772:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e12e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc42e expref: 15 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.514775:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.515705:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689e0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e8 expref: 32 pid: 29964 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.515719:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689e0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e8 expref: 32 pid: 29964 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.515732:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689e0d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e8 expref: 32 pid: 29964 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.515754:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.515776:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652691072:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1009us (4535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.515783:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8475 00010000:00010000:3.0:1786562526.515794:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.515798:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8480 00000100:00100000:1.0:1786562526.515805:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652692096:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.515813:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786562526.515816:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652691840:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1084us (4616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.515822:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8474 00010000:00010000:1.0:1786562526.515823:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 15 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.515833:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 14 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.515837:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8481 00000100:00100000:3.0:1786562526.515845:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652692224:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.515846:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.515864:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652692096:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 60us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.515871:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8480 00000100:00100000:1.0:1786562526.515885:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8482 00000100:00100000:1.0:1786562526.515891:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652692352:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.515899:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.515909:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 30 pid: 29967 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.515920:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 30 pid: 29967 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.515932:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.515950:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652692352:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 60us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.515958:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8482 00010000:00010000:3.0:1786562526.516028:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.516040:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 12 pid: 6659 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516050:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 12 pid: 6659 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516065:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e0b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3cc expref: 12 pid: 6659 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516077:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 4) 00010000:00010000:3.0:1786562526.516082:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 4) 00010000:00010000:3.0:1786562526.516088:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516099:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516120:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562526.516150:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652692224:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 306us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.516157:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8481 00010000:00010000:1.0:1786562526.516190:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e13c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc435 expref: 13 pid: 29965 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.516201:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819584:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.516215:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689e0b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3c5 expref: 29 pid: 29967 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.516226:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654819968:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.516265:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516276:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516284:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516298:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e12e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc42e expref: 12 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.516307:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654818816:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.516313:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.516320:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654818944:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562526.516322:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516331:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516338:0:29964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516339:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562526.516344:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516354:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516366:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.516374:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.516423:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652690176:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 56857us (58735us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.516431:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17379 00010000:00010000:3.0:1786562526.516738:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516747:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516766:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516773:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516780:0:29964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516788:0:29964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3f6400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562526.516791:0:29964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516799:0:29964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516817:0:29964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.516827:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e1a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.517045:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652690048:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 56938us (58480us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.517053:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17381 00000100:00100000:1.0:1786562526.523807:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2350:x1873345652690816:12345-192.168.204.29@tcp:4:cat.0 Request processed in 34522us (41524us total) trans 21474843512 rc 0/0 00000100:00100000:1.0:1786562526.523828:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5900 00002000:00100000:1.0:1786562526.523845:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1257471) req@ffff90e9bfb5d500 x1873345652690816/t21474843512(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:752/0 lens 488/448 e 0 to 0 dl 1786562537 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562526.523858:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5d500 with x1873345652690816 ext(1048576->1257471) 00010000:00010000:1.0:1786562526.523873:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.523894:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.523903:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9bfb5d500 00010000:00010000:0.0:1786562526.525623:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc43c expref: 14 pid: 6658 timeout: 1058 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.525660:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 3) 00010000:00010000:0.0:1786562526.525675:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 3) 00010000:00010000:0.0:1786562526.525684:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.525697:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.526811:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.526907:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652691584:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 17305us (17466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.527996:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8472 00010000:00010000:0.0:1786562526.530986:0:12119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.531274:0:12119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532225:0:12119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532241:0:12119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532252:0:12119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532267:0:12119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26fc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562526.532273:0:12119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532282:0:12119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532309:0:12119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.532318:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e1ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.532525:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652690304:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 71712us (73931us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.532540:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17382 00000100:00100000:3.0:1786562526.536276:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.537542:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652692480 00000100:00100000:1.0:1786562526.537553:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652692480 00010000:00010000:1.0:1786562526.537588:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.537634:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8483 00000100:00100000:1.0:1786562526.537644:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652692480:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562526.537662:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562526.537689:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.537704:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.537732:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053df3984/0x5c655bf66689e0ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc404 expref: 15 pid: 8368 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.537753:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(3 1) 00010000:00010000:1.0:1786562526.537759:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(3 1) 00010000:00010000:1.0:1786562526.537766:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.537778:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689e190 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.537808:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562526.537847:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652692480:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 204us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.537856:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8483 00000100:00100000:1.0:1786562526.543432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.543526:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652692608 00000100:00100000:3.0:1786562526.543538:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652692608 00010000:00010000:3.0:1786562526.543590:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 14 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.543641:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8484 00000100:00100000:3.0:1786562526.543653:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652692608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562526.543857:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.543890:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 14 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.543909:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 14 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.543948:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e0cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc3e1 expref: 14 pid: 29965 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.543968:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562526.543973:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562526.543981:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.543993:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.544175:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562526.544258:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652692608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 606us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.544266:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8484 00010000:00010000:1.0:1786562526.546970:0:28862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.546998:0:28862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547312:0:28862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547323:0:28862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547333:0:28862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547341:0:28862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3f7e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562526.547346:0:28862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547357:0:28862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547382:0:28862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.547392:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e577cf/0x5c655bf66689e19e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.547587:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652689792:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 87646us (89049us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.547603:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17380 00000100:00100000:1.0:1786562526.553638:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.553886:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652692864 00000100:00100000:3.0:1786562526.553899:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652692864 00000100:00100000:3.0:1786562526.554202:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17018 00000100:00100000:3.0:1786562526.554216:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652692864:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562526.554295:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.554331:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e15f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc44a expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554353:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562526.554360:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562526.554404:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554421:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554430:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 22 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554439:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 516 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554447:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646a00/0x5c655bf66689de02 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc252 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554456:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc259 expref: 516 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554465:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554518:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc259 expref: 516 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554535:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc259 expref: 516 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.554553:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820096:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.554656:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646a00/0x5c655bf66689de02 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc252 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554667:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646a00/0x5c655bf66689de02 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc252 expref: 22 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.554691:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820224:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.554720:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 516 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554730:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 516 pid: 33115 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.554749:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820352:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.554777:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 22 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554786:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 22 pid: 35929 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.554796:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820480:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.554821:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.554830:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 22 pid: 34450 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.554846:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820608:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.554867:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e180 going to sleep for 11 seconds 00010000:00010000:3.0:1786562526.570325:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689de25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc259 expref: 516 pid: 36756 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.570357:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820096:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.570373:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c646a00/0x5c655bf66689de02 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc252 expref: 22 pid: 33114 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.570387:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820224:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.570398:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689ddc3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc228 expref: 515 pid: 33115 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.570411:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820352:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.570422:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689ddbc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc221 expref: 21 pid: 35929 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.570432:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820480:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562526.576847:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652693504 00000100:00100000:0.0:1786562526.576860:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652693504 00010000:00010000:0.0:1786562526.576928:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 21 pid: 34450 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.576978:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8489 00000100:00100000:0.0:1786562526.576991:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2351:x1873345652693504:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562526.577049:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562526.577058:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 21 pid: 34450 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.577080:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 21 pid: 34450 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.577109:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562526.577116:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.577128:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.577136:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.577158:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562526.577221:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2351:x1873345652693504:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 232us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.577230:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8489 00010000:00010000:3.0:1786562526.578404:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689ddb5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc213 expref: 20 pid: 34450 timeout: 1058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.578434:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654820608:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562526.578493:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.578505:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.578512:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562526.580519:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4352, 88 off353224 00000004:00080000:3.0:1786562526.580539:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022532734ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580636:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4331, 88 off351192 00000004:00080000:3.0:1786562526.580643:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022637541ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580686:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4332, 88 off351280 00000004:00080000:3.0:1786562526.580691:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022685304ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580707:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4353, 88 off353312 00000004:00080000:3.0:1786562526.580710:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022704749ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580725:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4354, 88 off353400 00000004:00080000:3.0:1786562526.580729:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022723126ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580743:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4333, 88 off351368 00000004:00080000:3.0:1786562526.580747:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022741521ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580761:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4334, 88 off351456 00000004:00080000:3.0:1786562526.580765:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022759696ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580781:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4335, 88 off351544 00000004:00080000:3.0:1786562526.580784:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022778652ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580798:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4355, 88 off353488 00000004:00080000:3.0:1786562526.580802:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022796059ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580815:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4336, 88 off351632 00000004:00080000:3.0:1786562526.580819:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022813062ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580833:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4356, 88 off353576 00000004:00080000:3.0:1786562526.580837:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022831126ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580852:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4337, 88 off351720 00000004:00080000:3.0:1786562526.580856:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022850576ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562526.580874:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4357, 88 off353664 00000004:00080000:3.0:1786562526.580878:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022872219ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580893:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4358, 88 off353752 00000004:00080000:3.0:1786562526.580897:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022891299ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580913:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4359, 88 off353840 00000004:00080000:3.0:1786562526.580918:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022911946ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580935:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4360, 88 off353928 00000004:00080000:3.0:1786562526.580940:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 959022934009ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562526.580956:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4338, 88 off351808 00000004:00080000:3.0:1786562526.580961:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 959022954871ns, next at 911624464511ns, rc = 0 00000001:00080000:0.0:1786562526.618581:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950555 is committed 00000001:00080000:0.0:1786562526.618618:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950553 is committed 00000001:00080000:0.0:1786562526.618624:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950550 is committed 00000001:00080000:0.0:1786562526.618643:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950551 is committed 00000001:00080000:0.0:1786562526.618694:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950556 is committed 00000004:00080000:0.0:1786562526.618701:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2847 committed 00000004:00080000:0.0:1786562526.618720:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2870 committed 00000004:00080000:0.0:1786562526.618731:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2869 committed 00000004:00080000:0.0:1786562526.618735:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2868 committed 00000004:00080000:0.0:1786562526.618747:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2867 committed 00000004:00080000:0.0:1786562526.618749:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2846 committed 00000004:00080000:0.0:1786562526.618752:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2866 committed 00000004:00080000:0.0:1786562526.618754:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2845 committed 00000004:00080000:0.0:1786562526.618756:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2865 committed 00000004:00080000:0.0:1786562526.618759:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2844 committed 00000004:00080000:0.0:1786562526.618761:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2843 committed 00000004:00080000:0.0:1786562526.618762:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2842 committed 00000004:00080000:0.0:1786562526.618765:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2864 committed 00000004:00080000:0.0:1786562526.618767:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2863 committed 00000004:00080000:0.0:1786562526.618769:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2841 committed 00000004:00080000:0.0:1786562526.618772:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2840 committed 00000004:00080000:0.0:1786562526.618774:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2862 committed 00000100:00100000:0.0:1786562526.618971:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654820736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619093:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619137:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654821248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619160:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619189:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786562526.619195:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654820864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619215:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619233:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654821376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619253:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619283:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654820992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619307:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619324:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654821504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619343:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619361:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786562526.619366:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654821120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619390:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619407:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654821632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.619425:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562526.619460:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654820736 00000100:00100000:0.0:1786562526.619469:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654820736 00000100:00100000:0.0:1786562526.619548:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821248 00000100:00100000:0.0:1786562526.619552:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821248 00000100:00100000:0.0:1786562526.619569:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654820864 00000100:00100000:0.0:1786562526.619571:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654820864 00000100:00100000:0.0:1786562526.619584:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821376 00000100:00100000:0.0:1786562526.619587:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821376 00000100:00100000:0.0:1786562526.619600:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654820992 00000100:00100000:0.0:1786562526.619603:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654820992 00000100:00100000:0.0:1786562526.619620:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821504 00000100:00100000:0.0:1786562526.619622:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821504 00000100:00100000:0.0:1786562526.619638:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821120 00000100:00100000:0.0:1786562526.619641:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821120 00000100:00100000:0.0:1786562526.619651:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821632 00000100:00100000:0.0:1786562526.619654:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821632 00000100:00100000:0.0:1786562526.619669:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17383 00000100:00100000:0.0:1786562526.619679:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654820736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.620055:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654820736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 376us (962us total) trans 17179875981 rc 0/0 00000100:00100000:0.0:1786562526.620063:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17383 00000100:00100000:0.0:1786562526.620085:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17384 00000100:00100000:0.0:1786562526.620091:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654821248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562526.620233:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562526.620238:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620240:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562526.620244:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620246:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562526.620275:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654821248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (1113us total) trans 17179875982 rc 0/0 00000100:00100000:0.0:1786562526.620282:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17384 00000100:00100000:0.0:1786562526.620295:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17385 00000100:00100000:0.0:1786562526.620301:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654820864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.620404:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654820864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1187us total) trans 17179875983 rc 0/0 00000100:00100000:0.0:1786562526.620410:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17385 00000100:00100000:0.0:1786562526.620423:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17386 00000100:00100000:0.0:1786562526.620429:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654821376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562526.620548:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562526.620551:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620554:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562526.620556:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620558:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562526.620584:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654821376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (1330us total) trans 17179875984 rc 0/0 00000100:00100000:0.0:1786562526.620591:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17386 00000100:00100000:0.0:1786562526.620603:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17387 00000100:00100000:0.0:1786562526.620609:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3291:x1873345654820992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.620711:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654820992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1402us total) trans 17179875985 rc 0/0 00000100:00100000:0.0:1786562526.620718:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17387 00000100:00100000:0.0:1786562526.620729:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17388 00000100:00100000:0.0:1786562526.620735:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3291:x1873345654821504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562526.620819:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562526.620823:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620825:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562526.620828:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620830:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562526.620854:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654821504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (1510us total) trans 17179875986 rc 0/0 00000100:00100000:0.0:1786562526.620860:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17388 00000100:00100000:0.0:1786562526.620872:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17389 00000100:00100000:0.0:1786562526.620878:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3291:x1873345654821120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562526.620965:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562526.620969:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620971:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562526.620973:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.620975:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562526.621001:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654821120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (1610us total) trans 17179875987 rc 0/0 00000100:00100000:0.0:1786562526.621034:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17389 00000100:00100000:0.0:1786562526.621046:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17390 00000100:00100000:0.0:1786562526.621052:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3291:x1873345654821632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562526.621138:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1786562526.621141:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.621144:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562526.621146:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:0.0:1786562526.621148:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562526.621175:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654821632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (1748us total) trans 17179875988 rc 0/0 00000100:00100000:0.0:1786562526.621182:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17390 00000100:00080000:0.0:1786562526.621238:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562526.621296:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875974 gen 2 00000004:00080000:0.0:1786562526.621303:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9887eca80, transno 17179875933 00000004:00080000:0.0:1786562526.621315:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c79aa00, transno 17179875934 00000004:00080000:0.0:1786562526.621318:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9887eea00, transno 17179875935 00000004:00080000:0.0:1786562526.621321:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c799f80, transno 17179875936 00000004:00080000:0.0:1786562526.621324:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c79b100, transno 17179875937 00000004:00080000:0.0:1786562526.621327:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c798700, transno 17179875938 00000004:00080000:0.0:1786562526.621330:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf07800, transno 17179875939 00000004:00080000:0.0:1786562526.621332:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9887ec380, transno 17179875940 00000004:00080000:0.0:1786562526.621335:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c79b480, transno 17179875941 00000004:00080000:0.0:1786562526.621338:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e7b80, transno 17179875942 00000004:00080000:0.0:1786562526.621341:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553d880, transno 17179875943 00000004:00080000:0.0:1786562526.621344:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e5f80, transno 17179875944 00000004:00080000:0.0:1786562526.621347:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553e300, transno 17179875945 00000004:00080000:0.0:1786562526.621349:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553ed80, transno 17179875946 00000004:00080000:0.0:1786562526.621352:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e6680, transno 17179875947 00000004:00080000:0.0:1786562526.621354:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553f100, transno 17179875948 00000004:00080000:0.0:1786562526.621357:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e7100, transno 17179875949 00000004:00080000:0.0:1786562526.621359:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553dc00, transno 17179875950 00000004:00080000:0.0:1786562526.621362:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825f800, transno 17179875953 00000004:00080000:0.0:1786562526.621364:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c799880, transno 17179875954 00000004:00080000:0.0:1786562526.621367:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825c700, transno 17179875955 00000004:00080000:0.0:1786562526.621369:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825d180, transno 17179875956 00000004:00080000:0.0:1786562526.621372:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179f80, transno 17179875957 00000004:00080000:0.0:1786562526.621375:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f57480, transno 17179875958 00000004:00080000:0.0:1786562526.621379:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88ac87b80, transno 17179875959 00000004:00080000:0.0:1786562526.621383:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179880, transno 17179875960 00000004:00080000:0.0:1786562526.621385:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825ca80, transno 17179875961 00000004:00080000:0.0:1786562526.621388:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825fb80, transno 17179875966 00000004:00080000:0.0:1786562526.621391:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fdc00, transno 17179875967 00000004:00080000:0.0:1786562526.621393:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fea00, transno 17179875968 00000004:00080000:0.0:1786562526.621396:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88317a300, transno 17179875969 00000004:00010000:3.0:1786562526.622513:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032976ef8 reply state 00000000eade5cf3 transno 8589950556 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.622533:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786562526.622658:0:33114:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1786562526.622690:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652692864:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 68472us (69063us total) trans 8589950556 rc 0/0 00000100:00100000:3.0:1786562526.622699:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17018 00010000:00010000:3.0:1786562526.622738:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.622856:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.622865:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.622877:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ee00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562526.622883:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.622892:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.622912:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562526.622915:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562526.622920:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.622926:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689e1b3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.625404:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654821760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562526.625509:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562526.625559:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654822272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562526.625581:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.625767:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821760 00000100:00100000:3.0:1786562526.625776:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821760 00000100:00100000:3.0:1786562526.625840:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654822272 00000100:00100000:3.0:1786562526.625843:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654822272 00000100:00100000:3.0:1786562526.625865:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17391 00000100:00100000:3.0:1786562526.625875:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654821760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.626222:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654821760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 347us (712us total) trans 21474843514 rc 0/0 00000100:00100000:3.0:1786562526.626231:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17391 00000100:00100000:3.0:1786562526.626249:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17392 00000100:00100000:3.0:1786562526.626256:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654822272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562526.626411:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1786562526.626415:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562526.626419:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562526.626421:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562526.626424:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562526.626453:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654822272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (870us total) trans 21474843515 rc 0/0 00000100:00100000:3.0:1786562526.626459:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17392 00000100:00100000:3.0:1786562526.627281:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.627327:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.627356:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.627376:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.627399:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786562526.627405:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.627424:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.627439:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.627457:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.627498:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654821888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.627524:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.627541:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654822400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.627559:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562526.627589:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654822144 00000100:00100000:3.0:1786562526.627595:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654822144 00000100:00100000:3.0:1786562526.627636:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654822656 00000100:00100000:3.0:1786562526.627638:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654822656 00000100:00100000:3.0:1786562526.627652:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654822016 00000100:00100000:3.0:1786562526.627654:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654822016 00000100:00100000:3.0:1786562526.627668:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654822528 00000100:00100000:3.0:1786562526.627683:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654822528 00000100:00100000:3.0:1786562526.627694:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654821888 00000100:00100000:3.0:1786562526.627696:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654821888 00000100:00100000:3.0:1786562526.627706:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654822400 00000100:00100000:3.0:1786562526.627708:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654822400 00000100:00100000:3.0:1786562526.627721:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17393 00000100:00100000:3.0:1786562526.627728:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654822144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562526.627995:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562526.628000:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562516 -> 1786562516 00002000:00010000:3.0:1786562526.628002:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562526.628025:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1786562526.628027:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562526.628067:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654822144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 339us (739us total) trans 21474843516 rc 0/0 00000100:00100000:3.0:1786562526.628075:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17393 00000100:00100000:3.0:1786562526.628093:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17394 00000100:00100000:3.0:1786562526.628100:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654822656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562526.628596:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562526.628599:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562526.628602:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562526.628605:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562518 -> 1786562518 00002000:00010000:3.0:1786562526.628607:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1786562526.628635:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654822656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 535us (1258us total) trans 21474843517 rc 0/0 00000100:00100000:3.0:1786562526.628642:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17394 00000100:00100000:3.0:1786562526.628654:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17395 00000100:00100000:3.0:1786562526.628661:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654822016:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562526.628854:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825c380, transno 17179875970 00000004:00080000:0.0:1786562526.628859:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fe300, transno 17179875971 00000004:00080000:0.0:1786562526.628863:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e884339500, transno 17179875972 00000004:00080000:0.0:1786562526.628866:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831ff100, transno 17179875973 00000004:00080000:0.0:1786562526.628868:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179c00, transno 17179875974 00000100:00100000:0.0:1786562526.628878:0:3291:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9bfb5fb80 x1873345654821120/t17179875987(17179875987) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562542 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562526.628893:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5fb80/2, rc 0, transno 17179875987 00000100:00100000:0.0:1786562526.628900:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654821120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562526.629071:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654822016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 410us (1645us total) trans 21474843518 rc 0/0 00000100:00100000:3.0:1786562526.629078:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17395 00000100:00100000:3.0:1786562526.629091:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17396 00000100:00100000:3.0:1786562526.629097:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654822528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562526.629205:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562526.629209:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562526.629211:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562526.629213:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562526.629216:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562526.629241:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654822528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (1782us total) trans 21474843519 rc 0/0 00000100:00100000:3.0:1786562526.629247:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17396 00000100:00100000:3.0:1786562526.629260:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17397 00000100:00100000:3.0:1786562526.629267:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654821888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562526.629364:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654821888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1839us total) trans 21474843520 rc 0/0 00000100:00100000:3.0:1786562526.629371:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17397 00000100:00100000:3.0:1786562526.629385:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17398 00000100:00100000:3.0:1786562526.629391:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654822400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562526.629486:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562526.629490:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562526.629492:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562526.629494:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562517 -> 1786562517 00002000:00010000:3.0:1786562526.629496:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562526.629523:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654822400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (1961us total) trans 21474843521 rc 0/0 00000100:00100000:3.0:1786562526.629530:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17398 00000100:00100000:3.0:1786562526.629573:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843504 gen 2 00000004:00080000:3.0:1786562526.629578:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313ca80, transno 21474843468 00000004:00080000:3.0:1786562526.629589:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313fb80, transno 21474843469 00000004:00080000:3.0:1786562526.629593:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313dc00, transno 21474843470 00000004:00080000:3.0:1786562526.629596:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313ed80, transno 21474843471 00000004:00080000:3.0:1786562526.629599:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8df480, transno 21474843472 00000004:00080000:3.0:1786562526.629602:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313f800, transno 21474843473 00000004:00080000:3.0:1786562526.629605:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313d500, transno 21474843474 00000004:00080000:3.0:1786562526.629607:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313ea00, transno 21474843475 00000004:00080000:3.0:1786562526.629609:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8dc380, transno 21474843476 00000004:00080000:3.0:1786562526.629612:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5e680, transno 21474843477 00000004:00080000:3.0:1786562526.629615:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5fb80, transno 21474843478 00000004:00080000:3.0:1786562526.629619:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8ddc00, transno 21474843479 00000004:00080000:3.0:1786562526.629621:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5dc00, transno 21474843480 00000004:00080000:3.0:1786562526.629624:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5f800, transno 21474843481 00000004:00080000:3.0:1786562526.629627:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5ea00, transno 21474843482 00000004:00080000:3.0:1786562526.629630:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5c000, transno 21474843483 00000004:00080000:3.0:1786562526.629632:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825f100, transno 21474843486 00000004:00080000:3.0:1786562526.629635:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825df80, transno 21474843487 00000004:00080000:3.0:1786562526.629638:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825c000, transno 21474843488 00000004:00080000:3.0:1786562526.629640:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825f480, transno 21474843489 00000004:00080000:3.0:1786562526.629643:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825e300, transno 21474843490 00000004:00080000:3.0:1786562526.629645:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825ea00, transno 21474843491 00000004:00080000:3.0:1786562526.629647:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825d880, transno 21474843492 00000004:00080000:3.0:1786562526.629650:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98825d500, transno 21474843493 00000004:00080000:3.0:1786562526.629653:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf04700, transno 21474843497 00000004:00080000:3.0:1786562526.629655:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b575180, transno 21474843498 00000004:00080000:3.0:1786562526.629659:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88317b100, transno 21474843499 00000004:00080000:3.0:1786562526.629662:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9af30b800, transno 21474843500 00000004:00080000:3.0:1786562526.629664:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88317ad80, transno 21474843501 00000004:00080000:3.0:1786562526.629667:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9af30b100, transno 21474843502 00000004:00080000:3.0:1786562526.629669:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883178700, transno 21474843503 00000004:00080000:3.0:1786562526.629671:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c798000, transno 21474843504 00000100:00100000:3.0:1786562526.629677:0:3290:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9b42f4000 x1873345654821888/t21474843520(21474843520) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562542 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786562526.629685:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4000/2, rc 0, transno 21474843520 00000100:00100000:3.0:1786562526.629689:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654821888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562526.629700:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4700/2, rc 0, transno 21474843521 00000100:00100000:3.0:1786562526.629703:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654822400:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562526.630253:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 6 in flight, 32 done 00000004:00080000:3.0:1786562526.630285:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6a00/2, rc 0, transno 21474843518 00000100:00100000:3.0:1786562526.630290:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562526.630300:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6300/2, rc 0, transno 21474843519 00000100:00100000:3.0:1786562526.630303:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562526.630313:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f7480/2, rc 0, transno 21474843516 00000100:00100000:3.0:1786562526.630317:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562526.630326:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f5f80/2, rc 0, transno 21474843517 00000100:00100000:3.0:1786562526.630329:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654822656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562526.630693:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5d880/2, rc 0, transno 17179875983 00000100:00100000:1.0:1786562526.630700:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654820864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562526.630722:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652693632 00000100:00100000:1.0:1786562526.630730:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652693632 00000100:00100000:1.0:1786562526.630892:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17019 00000100:00100000:1.0:1786562526.630902:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63976:x1873345652693632:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562526.630929:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562526.630953:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc466 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.631047:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.631065:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.631090:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562526.631093:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562526.631097:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647e00, rc 0) 00000100:00100000:1.0:1786562526.631155:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652693632:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 255us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.631163:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17019 00000004:00080000:1.0:1786562526.631209:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5ed80/2, rc 0, transno 17179875984 00000100:00100000:1.0:1786562526.631214:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654821376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562526.631225:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5d180/2, rc 0, transno 17179875981 00000100:00100000:1.0:1786562526.631228:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654820736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562526.631238:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5df80/2, rc 0, transno 17179875982 00000100:00100000:1.0:1786562526.631241:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654821248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562526.631259:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f7800/2, rc 0, transno 21474843514 00000100:00100000:1.0:1786562526.631263:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654821760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562526.631271:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6680/2, rc 0, transno 21474843515 00000100:00100000:1.0:1786562526.631275:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654822272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562526.634933:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5ce00/2, rc 0, transno 17179875988 00000100:00100000:0.0:1786562526.634956:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654821632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562526.634972:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5ca80/2, rc 0, transno 17179875985 00000100:00100000:0.0:1786562526.634976:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654820992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562526.634987:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5f800/2, rc 0, transno 17179875986 00000100:00100000:0.0:1786562526.634991:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654821504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.635407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.635550:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652693760 00000100:00100000:3.0:1786562526.635559:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652693760 00000100:00100000:3.0:1786562526.635657:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17020 00000100:00100000:3.0:1786562526.635682:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652693760:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562526.635708:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.635734:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e1c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc46d expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.635971:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e1c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.635990:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.636045:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562526.636082:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:3.0:1786562526.636088:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562526.636110:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.636141:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e1c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc46d expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.636160:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc46d expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.636171:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562526.636174:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562526.636179:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ea00, rc 0) 00000100:00100000:3.0:1786562526.636243:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63976:x1873345652693760:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 577us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.636254:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17020 00000100:00100000:0.0:1786562526.640195:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654822784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562526.640312:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1786562526.641423:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88720df80/2, rc 0, transno 17179875989 00000100:00100000:0.0:1786562526.641432:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654822784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562526.645094:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652693888 00000100:00100000:1.0:1786562526.645107:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652693888 00000100:00100000:1.0:1786562526.645175:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652694016 00000100:00100000:1.0:1786562526.645178:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652694016 00000100:00100000:1.0:1786562526.645198:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652694144 00000100:00100000:1.0:1786562526.645201:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652694144 00000100:00100000:1.0:1786562526.645214:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652694272 00000100:00100000:1.0:1786562526.645217:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652694272 00000100:00100000:1.0:1786562526.645231:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652694400 00000100:00100000:1.0:1786562526.645234:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652694400 00000100:00100000:1.0:1786562526.645247:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652694528 00000100:00100000:1.0:1786562526.645250:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652694528 00000100:00100000:1.0:1786562526.645278:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17400 00000100:00100000:1.0:1786562526.645290:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652693888:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562526.645318:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562526.645344:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc474 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.645380:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x711:0x0] initial LVB size: 1048576, mtime: 0x6a7cc7da, atime: 0x6a7cc7d0, ctime: 0x6a7cc7da, blocks: 0x807 00010000:00010000:1.0:1786562526.645406:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=959s v=(0 0) 00010000:00010000:1.0:1786562526.645411:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562526.645425:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.645466:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.645492:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c647400, rc 0) 00000100:00100000:1.0:1786562526.645561:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652693888:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 274us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.645570:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17400 00000100:00100000:1.0:1786562526.645598:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17401 00000100:00100000:1.0:1786562526.645605:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652694016:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562526.645612:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562526.645625:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc47b expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562526.645643:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72e:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7dd, atime: 0x6a7cc7d1, ctime: 0x6a7cc7dd, blocks: 0x809 00010000:00010000:1.0:1786562526.645653:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=959s v=(0 0) 00010000:00010000:1.0:1786562526.645657:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562526.645663:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.645849:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17402 00000100:00100000:3.0:1786562526.645862:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652694144:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562526.645870:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.645882:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc482 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562526.645898:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72f:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7dd, atime: 0x6a7cc7dd, ctime: 0x6a7cc7dd, blocks: 0x807 00010000:00010000:3.0:1786562526.645908:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=959s v=(0 0) 00010000:00010000:3.0:1786562526.645912:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.645918:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.645933:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.645943:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ee00, rc 0) 00000100:00100000:3.0:1786562526.645977:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652694144:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 120us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.645984:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17402 00000100:00100000:3.0:1786562526.646000:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17403 00000100:00100000:3.0:1786562526.646026:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652694272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562526.646033:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.646043:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc489 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562526.646059:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x713:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7dc, atime: 0x6a7cc7db, ctime: 0x6a7cc7db, blocks: 0x809 00010000:00010000:3.0:1786562526.646068:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=959s v=(0 0) 00010000:00010000:3.0:1786562526.646072:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.646078:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.646089:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.646097:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e800, rc 0) 00000100:00100000:3.0:1786562526.646119:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652694272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 113us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.646125:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17403 00000100:00100000:3.0:1786562526.646140:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17404 00000100:00100000:3.0:1786562526.646147:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652694400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562526.646155:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.646164:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc490 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562526.646178:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x714:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7dc, atime: 0x6a7cc7db, ctime: 0x6a7cc7d8, blocks: 0x1807 00010000:00010000:3.0:1786562526.646187:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=959s v=(0 0) 00010000:00010000:3.0:1786562526.646190:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.646196:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.646214:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.646223:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fe00, rc 0) 00000100:00100000:3.0:1786562526.646243:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652694400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 96us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.646249:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17404 00000100:00100000:3.0:1786562526.646262:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17405 00000100:00100000:3.0:1786562526.646269:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652694528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562526.646276:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562526.646285:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc497 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562526.646297:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x730:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7dd, atime: 0x6a7cc7dc, ctime: 0x6a7cc7dd, blocks: 0x1007 00010000:00010000:3.0:1786562526.646306:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=959s v=(0 0) 00010000:00010000:3.0:1786562526.646309:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.646314:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.646325:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.646333:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e200, rc 0) 00000100:00100000:3.0:1786562526.646350:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652694528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 82us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.646356:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17405 00010000:00010000:1.0:1786562526.646600:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.646611:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88c646600, rc 0) 00000100:00100000:1.0:1786562526.646635:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652694016:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1032us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.646641:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17401 00000100:00100000:0.0:1786562526.687291:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.687356:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.687834:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17406 00000100:00100000:3.0:1786562526.687851:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652694656:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562526.697606:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652695040 00000100:00100000:3.0:1786562526.697620:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652695040 00000100:00100000:3.0:1786562526.697699:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652695296 00000100:00100000:3.0:1786562526.697703:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652695296 00000100:00100000:3.0:1786562526.697722:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652694912 00000100:00100000:3.0:1786562526.697724:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652694912 00000100:00100000:3.0:1786562526.697746:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652695168 00000100:00100000:3.0:1786562526.697748:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652695168 00000100:00100000:3.0:1786562526.697773:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17408 00000100:00100000:3.0:1786562526.697785:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652695040:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562526.697884:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17409 00000100:00100000:3.0:1786562526.697891:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652695296:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562526.697934:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17410 00000100:00100000:3.0:1786562526.697941:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652694912:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562526.697975:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17411 00000100:00100000:3.0:1786562526.697982:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652695168:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:0.0:1786562526.757267:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843509 is committed 00000001:00080000:0.0:1786562526.757301:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843512 is committed 00000001:00080000:0.0:1786562526.757312:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843511 is committed 00000001:00080000:0.0:1786562526.757327:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843513 is committed 00000001:00080000:0.0:1786562526.757336:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843521 is committed 00000100:00100000:0.0:1786562526.772450:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652694784:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 84245us (85075us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.772478:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17407 00000100:00100000:1.0:1786562526.776652:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652695296:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 78744us (79436us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562526.776681:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17409 00000100:00100000:0.0:1786562526.777069:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652694912:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 79126us (79847us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.777080:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17410 00000001:00080000:1.0:1786562526.780928:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875988 is committed 00000001:00080000:1.0:1786562526.780982:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875977 is committed 00000001:00080000:1.0:1786562526.781043:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875978 is committed 00000001:00080000:1.0:1786562526.781066:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875989 is committed 00000001:00080000:1.0:1786562526.781072:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875980 is committed 00000001:00080000:1.0:1786562526.781081:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875979 is committed 00000100:00100000:3.0:1786562526.793917:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652695168:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 95916us (96587us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.793939:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17411 00000100:00100000:1.0:1786562526.797965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.798073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.798156:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.798217:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652695424 00000100:00100000:0.0:1786562526.798230:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652695424 00000100:00100000:0.0:1786562526.798300:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652695552 00000100:00100000:0.0:1786562526.798303:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652695552 00000100:00100000:0.0:1786562526.798332:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17412 00000100:00100000:0.0:1786562526.798345:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652695424:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:0.0:1786562526.798509:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652695424:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 166us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.798518:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17412 00000100:00100000:0.0:1786562526.798536:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17413 00000100:00100000:0.0:1786562526.798542:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652695552:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:0.0:1786562526.798593:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652695552:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 50us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562526.798599:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17413 00000100:00100000:1.0:1786562526.799696:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.799725:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562526.799761:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.809217:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.809262:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.809296:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.809415:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.813901:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562526.814052:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696192 00000100:00100000:3.0:1786562526.814068:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696192 00000100:00100000:3.0:1786562526.814160:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696320 00000100:00100000:3.0:1786562526.814164:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696320 00000100:00100000:3.0:1786562526.814186:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696448 00000100:00100000:3.0:1786562526.814189:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696448 00000100:00100000:3.0:1786562526.814209:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696576 00000100:00100000:3.0:1786562526.814213:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696576 00000100:00100000:3.0:1786562526.814240:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11337 00000100:00100000:3.0:1786562526.814252:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652696192:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562526.814301:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.814324:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.814329:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.814337:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.814354:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.815533:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11338 00000100:00100000:3.0:1786562526.815547:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652696320:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562526.815579:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.815594:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.815597:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.815602:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.815615:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.816828:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11339 00000100:00100000:3.0:1786562526.816845:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2350:x1873345652696448:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562526.816882:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.816900:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.816904:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.816909:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.816923:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.820391:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.820423:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.820443:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562526.820481:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696704 00000100:00100000:0.0:1786562526.820492:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696704 00000100:00100000:0.0:1786562526.820561:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696832 00000100:00100000:0.0:1786562526.820564:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696832 00000100:00100000:0.0:1786562526.820583:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652696960 00000100:00100000:0.0:1786562526.820585:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652696960 00000100:00100000:0.0:1786562526.820600:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697088 00000100:00100000:0.0:1786562526.820602:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697088 00000100:00100000:0.0:1786562526.820624:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11341 00000100:00100000:0.0:1786562526.820634:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2350:x1873345652696704:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562526.820692:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.820714:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562526.820721:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562526.820730:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.820755:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.821589:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11342 00000100:00100000:0.0:1786562526.821602:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652696832:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562526.821631:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7d5c8a0/0x5c655bf66689e21c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.821643:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562526.821646:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562526.821652:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d5c8a0/0x5c655bf66689e21c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.821661:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d5c8a0/0x5c655bf66689e21c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.822322:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11343 00000100:00100000:0.0:1786562526.822332:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652696960:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562526.822355:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.822366:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562526.822369:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562526.822374:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.822384:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.828824:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697216 00000100:00100000:3.0:1786562526.828843:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697216 00000100:00100000:3.0:1786562526.828943:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11345 00000100:00100000:3.0:1786562526.828957:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:2351:x1873345652697216:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562526.829027:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d9a03bbd/0x5c655bf66689e231 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.829050:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.829055:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562526.829064:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9a03bbd/0x5c655bf66689e231 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.829080:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9a03bbd/0x5c655bf66689e231 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847880:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847908:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847920:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847928:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562526.847935:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847945:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847970:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.847979:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000298d5fee/0x5c655bf66689e1f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.848219:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:2350:x1873345652696192:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 33960us (39009us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.848233:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11337 00010000:00010000:3.0:1786562526.867373:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.867400:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.867411:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.867419:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562526.867425:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.867436:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.867461:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.867481:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e200 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.867577:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2350:x1873345652696320:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 52026us (58306us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.867589:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11338 00010000:00010000:1.0:1786562526.897753:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.897781:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.897793:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.897801:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562526.897807:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.897818:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.897842:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.897851:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689e215 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.898121:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2350:x1873345652696704:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 77480us (84228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562526.898134:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11341 00010000:00010000:3.0:1786562526.898657:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.898726:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.898735:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.898743:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ec00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562526.898746:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.898755:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.898767:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.898775:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366281f8/0x5c655bf66689e207 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.898862:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652696448:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 82022us (89564us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.898871:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11339 00010000:00010000:3.0:1786562526.916230:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.916258:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.916268:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.916276:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562526.916283:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.916293:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.916320:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.916328:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689e223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.916458:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652696960:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 94118us (96024us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562526.916482:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11343 00010000:00010000:1.0:1786562526.919319:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.919353:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.919364:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.919373:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99261de00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562526.919379:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.919391:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.919415:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.919424:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e22a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562526.920125:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652697088:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 96750us (99671us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562526.920141:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11344 00000100:00100000:3.0:1786562526.945393:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697344 00000100:00100000:3.0:1786562526.945405:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697344 00000100:00100000:3.0:1786562526.945498:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697472 00000100:00100000:3.0:1786562526.945501:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697472 00000100:00100000:3.0:1786562526.945529:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11346 00000100:00100000:3.0:1786562526.945541:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652697344:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562526.945585:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.945611:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 14 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.945622:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72d:0x0].0x0 since=8s v=(0 0) 00010000:00010000:3.0:1786562526.945626:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562526.945632:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.945683:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 14 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.945698:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 14 pid: 29662 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.945723:0:14369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:14369:1873345654822912:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562526.945842:0:14369:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e900 going to sleep for 11 seconds 00000100:00100000:1.0:1786562526.946057:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11347 00000100:00100000:1.0:1786562526.946071:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652697472:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562526.946094:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689e23f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.946106:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562526.946110:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562526.946113:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689e23f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562526.946122:0:29459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689e23f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562526.948254:0:14369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:14369:1873345654822912:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562526.948297:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.950232:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697600 00000100:00100000:3.0:1786562526.950245:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697600 00010000:00010000:3.0:1786562526.950299:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 15 pid: 29662 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562526.950341:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8490 00000100:00100000:3.0:1786562526.950352:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652697600:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562526.950372:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562526.950401:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 15 pid: 29662 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950416:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 15 pid: 29662 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950444:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689d901 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf8f expref: 15 pid: 29662 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950477:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562526.950483:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562526.950491:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950508:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950519:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562526.950522:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562526.950526:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689e23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950534:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044e99489/0x5c655bf66689e23f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950581:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562526.950645:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652697600:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 294us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562526.950654:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8490 00010000:00010000:3.0:1786562526.950724:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562526.950734:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562526.952588:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562527.014439:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843522 is committed 00002000:00010000:3.0:1786562527.015882:0:14369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562516 -> 1786562526 00002000:00010000:3.0:1786562527.015891:0:14369:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 0 -> 1786562526 00010000:00010000:3.0:1786562527.015911:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.015933:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.015943:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.015951:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ec00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562527.015957:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.015967:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.015994:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.016002:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.016144:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652697344:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 70597us (70891us total) trans 21474843522 rc 0/0 00000100:00100000:3.0:1786562527.016157:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11346 00000100:00100000:3.0:1786562527.032067:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000001:00080000:0.0:1786562527.056174:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843523 is committed 00000100:00100000:3.0:1786562527.070534:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562527.071141:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697856 00000100:00100000:0.0:1786562527.071154:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697856 00000100:00100000:0.0:1786562527.071269:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11348 00000100:00100000:0.0:1786562527.071282:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652697856:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562527.072116:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3068f3b/0x5c655bf66689e246 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.072149:0:13965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf96 expref: 12 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.072160:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x731:0x0].0x0 since=8s v=(0 0) 00010000:00010000:0.0:1786562527.072166:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562527.072171:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3068f3b/0x5c655bf66689e246 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.072224:0:13965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf96 expref: 12 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.072250:0:13965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf96 expref: 12 pid: 12119 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562527.072269:0:13965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884116300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:13965:1873345654823040:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562527.073998:0:13965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562527.087108:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652698112 00000100:00100000:1.0:1786562527.087123:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652698112 00000100:00100000:1.0:1786562527.087231:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11349 00000100:00100000:1.0:1786562527.087244:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652698112:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562527.087295:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689e24d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.087321:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x731:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562527.087329:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562527.087335:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689e24d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.087347:0:14017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689e24d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.090274:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562527.090831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562527.090953:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652697984 00000100:00100000:1.0:1786562527.090965:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652697984 00000100:00100000:1.0:1786562527.091087:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652698240 00000100:00100000:1.0:1786562527.091091:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652698240 00000100:00100000:1.0:1786562527.091128:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11350 00000100:00100000:1.0:1786562527.091139:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652697984:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562527.091186:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.091213:0:29461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.091223:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x715:0x0].0x0 since=8s v=(0 0) 00010000:00010000:1.0:1786562527.091228:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562527.091233:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.091277:0:29461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.091291:0:29461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 14 pid: 28862 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.091310:0:29461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:29461:1873345654823168:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562527.091412:0:29461:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562527.091786:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11351 00000100:00100000:0.0:1786562527.091800:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652698240:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562527.091824:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.091837:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562527.091841:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562527.091845:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.091854:0:16006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562527.098558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562527.107611:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689d908 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf96 expref: 14 pid: 12119 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.107633:0:13965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884116300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:13965:1873345654823040:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562527.107680:0:13965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3068f3b/0x5c655bf66689e246 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.110307:0:13965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3068f3b/0x5c655bf66689e246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.110335:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3068f3b/0x5c655bf66689e246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.112380:0:14017:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689e24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.112405:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689e24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562527.144049:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652698496 00000100:00100000:0.0:1786562527.144065:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652698496 00010000:00010000:0.0:1786562527.144128:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 15 pid: 28862 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562527.144269:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8492 00000100:00100000:0.0:1786562527.144286:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652698496:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562527.144309:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562527.144348:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 15 pid: 28862 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.144365:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 15 pid: 28862 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.144696:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562527.144705:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562527.144713:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.144726:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.144747:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562527.144750:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562527.144756:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.144763:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.145042:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562527.145123:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652698496:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 839us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562527.145137:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8492 00010000:00010000:1.0:1786562527.153249:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689d90f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbf9d expref: 14 pid: 28862 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.153285:0:29461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:29461:1873345654823168:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562527.153324:0:29461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.153339:0:29461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.153347:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.164821:0:16006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.164850:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562527.297433:0:29461:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562517 -> 1786562526 00002000:00010000:0.0:1786562527.297446:0:29461:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562517 -> 1786562526 00010000:00010000:0.0:1786562527.297479:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.297496:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.297506:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.297514:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562527.297520:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.297529:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.297556:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.297564:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e254 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562527.297697:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652697984:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 206553us (207434us total) trans 17179875990 rc 0/0 00000100:00100000:0.0:1786562527.297709:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11350 00000001:00080000:0.0:1786562527.299970:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875990 is committed 00000001:00080000:0.0:1786562527.335063:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843524 is committed 00000001:00080000:1.0:1786562527.340593:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843525 is committed 00010000:00010000:3.0:1786562527.367135:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.367155:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.367166:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.367174:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9862d0600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562527.367180:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.367191:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.367222:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.367230:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e25b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.367407:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652698240:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 275603us (276569us total) trans 17179875991 rc 0/0 00000100:00100000:3.0:1786562527.367420:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11351 00000100:00100000:0.0:1786562527.375988:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562527.376061:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562527.376955:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11353 00000100:00100000:1.0:1786562527.376968:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652698624:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562527.376991:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.377023:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689d916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfa4 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.377033:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x732:0x0].0x0 since=8s v=(0 0) 00010000:00010000:1.0:1786562527.377036:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562527.377040:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.377063:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689d916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfa4 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.377072:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689d916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfa4 expref: 11 pid: 6659 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.377085:0:6663:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:6663:1873345654823424:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562527.377115:0:6663:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562527.381620:0:16203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:16203:1873345654823296:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562527.381675:0:16203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e262 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.381935:0:6663:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:6663:1873345654823424:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562527.381957:0:6663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562527.382366:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8493 00000100:00100000:0.0:1786562527.382378:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652699008:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562527.382398:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562527.382428:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689d916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfa4 expref: 12 pid: 6659 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382441:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689d916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfa4 expref: 12 pid: 6659 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382481:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689d916 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfa4 expref: 12 pid: 6659 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382500:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562527.382505:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562527.382512:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382523:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382558:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562527.382622:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652699008:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 245us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562527.382631:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8493 00000100:00100000:0.0:1786562527.382674:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8494 00000100:00100000:0.0:1786562527.382683:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652698880:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562527.382692:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562527.382709:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689d91d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfab expref: 13 pid: 8368 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382720:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689d91d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfab expref: 13 pid: 8368 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382748:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689d91d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfab expref: 13 pid: 8368 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382760:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562527.382764:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562527.382768:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382783:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e262 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382804:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562527.382827:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652698880:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 146us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562527.382835:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8494 00010000:00010000:0.0:1786562527.382969:0:16203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562527.382980:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.383342:0:6663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.383353:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562527.493816:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562517 -> 1786562526 00002000:00010000:3.0:1786562527.493831:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562517 -> 1786562526 00010000:00010000:3.0:1786562527.493850:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.493867:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.493879:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.493887:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562527.493893:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.493904:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.493929:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.493939:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689e269 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.494149:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652698624:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 117177us (118081us total) trans 21474843526 rc 0/0 00000100:00100000:3.0:1786562527.494162:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11353 00000001:00080000:1.0:1786562527.494878:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843526 is committed 00000100:00100000:0.0:1786562527.509158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562527.510444:0:16005:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99401c240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562527.517612:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562527.517718:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652699264 00000100:00100000:1.0:1786562527.517744:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652699264 00010000:00010000:1.0:1786562527.517807:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ad4024/0x5c655bf66689d924 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfb2 expref: 11 pid: 29967 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.517863:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8495 00000100:00100000:1.0:1786562527.517876:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652699264:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562527.517898:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562527.517931:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5ad4024/0x5c655bf66689d924 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfb2 expref: 11 pid: 29967 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.517947:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5ad4024/0x5c655bf66689d924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfb2 expref: 11 pid: 29967 timeout: 1059 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.517984:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562527.517990:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562527.517997:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.518051:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.518079:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562527.518147:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652699264:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 273us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562527.518158:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8495 00010000:00010000:2.0:1786562527.520309:0:16005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562527.520325:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562527.687569:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843527 is committed 00002000:00010000:1.0:1786562527.688428:0:16005:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5185536 00002000:00010000:1.0:1786562527.688438:0:16005:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562517 -> 1786562526 00002000:00010000:1.0:1786562527.688442:0:16005:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562517 -> 1786562526 00002000:00010000:1.0:1786562527.688444:0:16005:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1969 00010000:00010000:1.0:1786562527.688474:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.688488:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.688497:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.688505:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562527.688510:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.688519:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.688544:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.688551:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689e270 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.689644:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2349:x1873345652699136:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 180163us (180495us total) trans 21474843527 rc 0/0 00000100:00100000:1.0:1786562527.689657:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11354 00000100:00100000:1.0:1786562527.722989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562527.728369:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562527.734499:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652699392 00000100:00100000:2.0:1786562527.734522:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652699392 00000100:00100000:0.0:1786562527.734981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562527.735095:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562527.736597:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652699520 00000100:00100000:1.0:1786562527.736611:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652699520 00000100:00100000:1.0:1786562527.736660:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652699648 00000100:00100000:1.0:1786562527.736664:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652699648 00000100:00100000:1.0:1786562527.736690:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652699776 00000100:00100000:1.0:1786562527.736693:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652699776 00000100:00100000:1.0:1786562527.736740:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11355 00000100:00100000:1.0:1786562527.736753:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652699392:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562527.736799:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.736821:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 22 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.736831:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=9s v=(1 0) 00010000:00010000:1.0:1786562527.736836:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.736841:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.736879:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 22 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.736894:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 22 pid: 6658 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.736909:0:14369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:14369:1873345654823680:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562527.737001:0:14369:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562527.737037:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11356 00000100:00100000:1.0:1786562527.737045:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652699520:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562527.737062:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.737071:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.737075:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.737078:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.737099:0:16007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.737493:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11357 00000100:00100000:1.0:1786562527.737502:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652699648:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562527.737642:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.737653:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.737656:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.737660:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.737667:0:29461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.738171:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11358 00000100:00100000:3.0:1786562527.738184:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652699776:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562527.738205:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.738222:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562527.738225:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562527.738229:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.738237:0:29459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.746913:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562527.746975:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652699904 00000100:00100000:1.0:1786562527.746983:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652699904 00010000:00010000:1.0:1786562527.747059:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 23 pid: 6658 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.747123:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8496 00000100:00100000:1.0:1786562527.747133:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652699904:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562527.747153:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562527.747179:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 23 pid: 6658 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747194:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 23 pid: 6658 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747226:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747232:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747239:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747250:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747259:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747263:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747267:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747273:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747279:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747282:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747286:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747293:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747299:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747301:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562527.747305:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747311:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747344:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562527.747398:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652699904:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 266us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562527.747406:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8496 00010000:00010000:1.0:1786562527.747437:0:29459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747476:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747611:0:29461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747620:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747736:0:16007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.747746:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.750821:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006e9a26/0x5c655bf66689d9b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbff1 expref: 22 pid: 6658 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562527.750844:0:14369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:14369:1873345654823680:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562527.750870:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.750881:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562527.750888:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562527.888938:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875993 is committed 00002000:00010000:1.0:1786562527.896910:0:29459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562517 -> 1786562527 00002000:00010000:1.0:1786562527.896920:0:29459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562517 -> 1786562527 00010000:00010000:1.0:1786562527.896935:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.896948:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.896958:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.896971:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562527.896976:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.896985:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.897019:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562527.897027:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e28c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562527.897144:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+23:2349:x1873345652699776:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 158959us (162043us total) trans 17179875993 rc 0/0 00000100:00100000:1.0:1786562527.897155:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11358 00010000:00010000:1.0:1786562527.975927:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562528.003769:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875996 is committed 00010000:00010000:1.0:1786562528.006361:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006381:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006390:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006416:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562528.006421:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006429:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006458:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006465:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689e277 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.006570:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652699392:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 269815us (283585us total) trans 17179875995 rc 0/0 00000100:00100000:1.0:1786562528.006582:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11355 00010000:00010000:1.0:1786562528.006656:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006665:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006672:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006679:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562528.006683:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006691:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006702:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.006710:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689e27e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.006743:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652699520:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 269699us (278384us total) trans 17179875996 rc 0/0 00000100:00100000:1.0:1786562528.006751:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11356 00010000:00010000:1.0:1786562528.007440:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.007462:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.007470:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.007477:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cbc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562528.007480:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.007493:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.007505:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.007513:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044e99489/0x5c655bf66689e285 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.007576:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652699648:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 270074us (272598us total) trans 17179875994 rc 0/0 00000100:00100000:1.0:1786562528.007585:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11357 00000100:00100000:3.0:1786562528.032857:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.034229:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700032 00000100:00100000:2.0:1786562528.034243:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700032 00000100:00100000:2.0:1786562528.034339:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11359 00000100:00100000:2.0:1786562528.034352:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652700032:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562528.034390:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562528.034508:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786562528.035228:0:13965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.035241:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x718:0x0].0x0 since=9s v=(0 0) 00010000:00010000:2.0:1786562528.035246:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562528.035253:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.035304:0:13965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.035319:0:13965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 11 pid: 6660 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.035344:0:13965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:13965:1873345654823808:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562528.038369:0:13965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f540 going to sleep for 11 seconds 00000100:00100000:1.0:1786562528.052826:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.052856:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.052886:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.053039:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700416 00000100:00100000:2.0:1786562528.053048:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700416 00010000:00010000:2.0:1786562528.053106:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 12 pid: 6660 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.053155:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8497 00000100:00100000:2.0:1786562528.053166:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652700416:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562528.053189:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562528.053219:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 12 pid: 6660 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.053234:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 12 pid: 6660 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.053266:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562528.053278:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562528.053284:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.053295:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.053322:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562528.053393:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652700416:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 222us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.053400:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8497 00010000:00010000:3.0:1786562528.056284:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689d947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfc7 expref: 11 pid: 6660 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562528.056316:0:13965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:13965:1873345654823808:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562528.056344:0:13965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.056362:0:13965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.056369:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.060350:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.062174:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700160 00000100:00100000:0.0:1786562528.062188:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700160 00000100:00100000:0.0:1786562528.062269:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700288 00000100:00100000:0.0:1786562528.062273:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700288 00000100:00100000:0.0:1786562528.062306:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700544 00000100:00100000:0.0:1786562528.062310:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700544 00000100:00100000:0.0:1786562528.062343:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11360 00000100:00100000:0.0:1786562528.062354:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652700160:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562528.062392:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.062425:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562528.062430:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562528.062437:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.062461:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.062788:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11361 00000100:00100000:2.0:1786562528.062801:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652700288:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562528.062826:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.062842:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562528.062846:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562528.062851:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.062865:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.063116:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11362 00000100:00100000:0.0:1786562528.063125:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652700544:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562528.063142:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.063151:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562528.063155:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562528.063158:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.063167:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562528.151768:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179875997 is committed 00002000:00010000:3.0:1786562528.153908:0:13965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562517 -> 1786562527 00002000:00010000:3.0:1786562528.153917:0:13965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562517 -> 1786562527 00010000:00010000:3.0:1786562528.153932:0:13965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.153946:0:13965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.153955:0:13965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.153962:0:13965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068da00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562528.153967:0:13965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.153976:0:13965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.153999:0:13965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.154029:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea116e8/0x5c655bf66689e293 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562528.154138:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+22:2348:x1873345652700032:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 119785us (121285us total) trans 17179875997 rc 0/0 00000100:00100000:3.0:1786562528.154148:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11359 00010000:00010000:1.0:1786562528.292342:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.292363:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.292372:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.292386:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9864c1600 already unused, calling callback (ffffffffc1585030) 00000001:00080000:0.0:1786562528.292629:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876000 is committed 00010000:00010000:2.0:1786562528.293110:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293121:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293129:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293136:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562528.293140:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293150:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293172:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293179:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.293292:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652700288:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 230491us (240400us total) trans 17179875999 rc 0/0 00000100:00100000:2.0:1786562528.293304:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11361 00010000:00010000:2.0:1786562528.293356:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293364:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293371:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293377:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9864c1c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562528.293380:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293392:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293416:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.293423:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000799bce89/0x5c655bf66689e29a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.293466:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652700160:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 231114us (240650us total) trans 17179875998 rc 0/0 00000100:00100000:2.0:1786562528.293472:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11360 00010000:00010000:1.0:1786562528.294129:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.294143:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.294156:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.294164:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.294217:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652700544:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 231092us (233875us total) trans 17179876000 rc 0/0 00000100:00100000:1.0:1786562528.294225:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11362 00000100:00100000:1.0:1786562528.325320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.326526:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700672 00000100:00100000:0.0:1786562528.326539:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700672 00000100:00100000:0.0:1786562528.326632:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11363 00000100:00100000:0.0:1786562528.326828:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2350:x1873345652700672:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562528.326866:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.326888:0:16005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.326898:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x719:0x0].0x0 since=9s v=(0 0) 00010000:00010000:0.0:1786562528.326903:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562528.326908:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.326945:0:16005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.326960:0:16005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 10 pid: 29963 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.326974:0:16005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:16005:1873345654823936:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562528.327112:0:16005:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562528.335863:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.337051:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652700800 00000100:00100000:1.0:1786562528.337063:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652700800 00010000:00010000:1.0:1786562528.337123:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 11 pid: 29963 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.337171:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8498 00000100:00100000:1.0:1786562528.337181:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652700800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562528.337196:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562528.337220:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 11 pid: 29963 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.337234:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 11 pid: 29963 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.337260:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562528.337265:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562528.337271:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.337281:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.337301:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562528.337362:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652700800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 182us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562528.337370:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8498 00010000:00010000:2.0:1786562528.341575:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8fcb52/0x5c655bf66689d94e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfbfce expref: 10 pid: 29963 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.341601:0:16005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:16005:1873345654823936:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562528.341828:0:16005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.341842:0:16005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.341849:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562528.464042:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876001 is committed 00002000:00010000:2.0:1786562528.466333:0:16005:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5185536 00002000:00010000:2.0:1786562528.466343:0:16005:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562518 -> 1786562527 00002000:00010000:2.0:1786562528.466346:0:16005:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562518 -> 1786562527 00010000:00010000:2.0:1786562528.466361:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.466373:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.466382:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.466390:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9864c1600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562528.466394:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.466403:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.466421:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.466429:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e2af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.467977:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2350:x1873345652700672:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 139807us (141321us total) trans 17179876001 rc 0/0 00000100:00100000:2.0:1786562528.467993:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11363 00000100:00100000:2.0:1786562528.532316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.532414:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701056 00000100:00100000:1.0:1786562528.532424:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701056 00000100:00100000:1.0:1786562528.532513:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17021 00000100:00100000:1.0:1786562528.532526:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63976:x1873345652701056:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562528.532576:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562528.532611:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e1c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc46d expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.532631:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562528.532638:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562528.532951:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.532966:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.532977:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562528.533113:0:36756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950557 00000004:00010000:1.0:1786562528.533139:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000533ff82 reply state 00000000ff2a110a transno 8589950558 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.533148:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562528.533239:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63976:x1873345652701056:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 715us (931us total) trans 8589950558 rc 0/0 00000100:00100000:1.0:1786562528.533247:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17021 00000020:00080000:1.0:1786562528.533252:0:36756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786562528.533870:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562528.538787:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562528.538914:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.538925:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.538933:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.538940:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562528.538945:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.538959:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.538976:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562528.538979:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562528.538984:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.538991:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e2b6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562528.539287:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701184 00000100:00100000:3.0:1786562528.539297:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701184 00000100:00100000:3.0:1786562528.539361:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17418 00000100:00100000:3.0:1786562528.539374:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63976:x1873345652701184:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562528.539391:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562528.539411:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc49e expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562528.539444:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7de, atime: 0x0, ctime: 0x6a7cc7de, blocks: 0x1007 00010000:00010000:3.0:1786562528.539464:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=960s v=(0 0) 00010000:00010000:3.0:1786562528.539469:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562528.539478:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 10 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.539500:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 10 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.539511:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ec00, rc 0) 00000100:00100000:3.0:1786562528.539575:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652701184:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 205us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562528.539583:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17418 00000100:00080000:0.0:1786562528.539678:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562528.545192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.546804:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701312 00000100:00100000:2.0:1786562528.546818:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701312 00000100:00100000:2.0:1786562528.546889:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17419 00000100:00100000:2.0:1786562528.546899:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652701312:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.546921:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.546944:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4a5 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562528.546972:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7de, atime: 0x0, ctime: 0x6a7cc7de, blocks: 0x1007 00010000:00010000:2.0:1786562528.546999:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=960s v=(0 0) 00010000:00010000:2.0:1786562528.547045:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.547056:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 11 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.547072:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 11 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.547086:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068de00, rc 0) 00000100:00100000:2.0:1786562528.547156:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63976:x1873345652701312:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 259us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.547164:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17419 00000100:00100000:1.0:1786562528.551123:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562528.551148:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654824064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562528.551214:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562528.551327:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654824064 00000100:00100000:3.0:1786562528.551335:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654824064 00000100:00100000:3.0:1786562528.551397:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1786562528.551407:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654824064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562528.551429:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 480706560 pending 0 free 3829399552 avail 3814719488 00000100:00100000:3.0:1786562528.551488:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654824064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562528.551495:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:0.0:1786562528.551560:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562528.551838:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562528.551849:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654824192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562528.551880:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562528.551910:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654824192 00000100:00100000:0.0:1786562528.551913:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654824192 00000100:00100000:0.0:1786562528.551944:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1786562528.551951:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654824192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562528.551975:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 601554944 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1786562528.552041:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654824192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.552048:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1786562528.552064:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562528.552087:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843521 gen 2 00000004:00080000:0.0:1786562528.552094:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f7800, transno 21474843514 00000004:00080000:0.0:1786562528.552103:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6680, transno 21474843515 00000004:00080000:0.0:1786562528.552106:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f7480, transno 21474843516 00000004:00080000:0.0:1786562528.552108:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f5f80, transno 21474843517 00000004:00080000:0.0:1786562528.552111:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6a00, transno 21474843518 00000004:00080000:0.0:1786562528.552114:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6300, transno 21474843519 00000004:00080000:0.0:1786562528.552117:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4000, transno 21474843520 00000004:00080000:0.0:1786562528.552120:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4700, transno 21474843521 00000100:00100000:0.0:1786562528.552131:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654824192:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1786562528.552515:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:3.0:1786562528.552692:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654824576:0@lo:400:kworker.0 00000100:00100000:3.0:1786562528.552727:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562528.552759:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562528.552765:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654824448:0@lo:400:kworker.0 00000100:00100000:3.0:1786562528.552787:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562528.552813:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654824576 00000100:00100000:3.0:1786562528.552818:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654824576 00000100:00100000:3.0:1786562528.552851:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654824448 00000100:00100000:3.0:1786562528.552854:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654824448 00000100:00100000:3.0:1786562528.552873:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1786562528.552880:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562528.552921:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654824576:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562528.552928:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1786562528.552941:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1786562528.552947:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654824448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562528.552975:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654824448:12345-0@lo:400:kworker.0 Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562528.552981:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1786562528.553032:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654824448:0@lo:400:kworker.0 00000100:00100000:3.0:1786562528.553043:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654824576:0@lo:400:kworker.0 00000100:00100000:1.0:1786562528.557077:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875989 gen 2 00000004:00080000:1.0:1786562528.557098:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5d180, transno 17179875981 00000004:00080000:1.0:1786562528.557112:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5df80, transno 17179875982 00000004:00080000:1.0:1786562528.557115:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5d880, transno 17179875983 00000004:00080000:1.0:1786562528.557117:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5ed80, transno 17179875984 00000004:00080000:1.0:1786562528.557121:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5ca80, transno 17179875985 00000004:00080000:1.0:1786562528.557123:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5f800, transno 17179875986 00000004:00080000:1.0:1786562528.557124:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5fb80, transno 17179875987 00000004:00080000:1.0:1786562528.557127:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5ce00, transno 17179875988 00000004:00080000:1.0:1786562528.557130:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88720df80, transno 17179875989 00000100:00100000:1.0:1786562528.557149:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654824064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562528.557501:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654824704:0@lo:400:kworker.0 00000100:00100000:2.0:1786562528.557571:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562528.557646:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562528.557663:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654824320:0@lo:400:kworker.0 00000100:00100000:2.0:1786562528.557693:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562528.557731:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654824320 00000100:00100000:2.0:1786562528.557738:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654824320 00000100:00100000:2.0:1786562528.557778:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1786562528.557786:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654824320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562528.557835:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654824320:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.557843:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1786562528.557888:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654824320:0@lo:400:kworker.0 00000100:00080000:0.0:1786562528.558261:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1786562528.558814:0:33137:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1786562528.559037:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654824704 00000100:00100000:1.0:1786562528.559043:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654824704 00000100:00100000:1.0:1786562528.559101:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1786562528.559110:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654824704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562528.559178:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654824704:12345-0@lo:400:kworker.0 Request processed in 70us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562528.559185:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1786562528.559268:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654824704:0@lo:400:kworker.0 00000100:00100000:2.0:1786562528.559525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.562862:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701440 00000100:00100000:0.0:1786562528.562876:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701440 00000100:00100000:0.0:1786562528.562954:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17420 00000100:00100000:0.0:1786562528.562965:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63976:x1873345652701440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562528.562983:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562528.563045:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4ac expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562528.563073:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7de, atime: 0x0, ctime: 0x6a7cc7de, blocks: 0x1007 00010000:00010000:0.0:1786562528.563101:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=961s v=(0 0) 00010000:00010000:0.0:1786562528.563106:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.563116:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 10 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.563134:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 10 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.563146:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9864c0a00, rc 0) 00000100:00100000:0.0:1786562528.563205:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652701440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 242us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.563213:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17420 00000100:00100000:3.0:1786562528.569148:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.569298:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701568 00000100:00100000:2.0:1786562528.569308:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701568 00000100:00100000:2.0:1786562528.569370:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17421 00000100:00100000:2.0:1786562528.569381:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63976:x1873345652701568:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.569399:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.569422:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4b3 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562528.569461:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x732:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7de, atime: 0x0, ctime: 0x6a7cc7de, blocks: 0x807 00010000:00010000:2.0:1786562528.569483:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=961s v=(0 0) 00010000:00010000:2.0:1786562528.569488:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.569498:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.569517:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.569531:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068da00, rc 0) 00000100:00100000:2.0:1786562528.569594:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:63976:x1873345652701568:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 215us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.569601:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17421 00000100:00100000:1.0:1786562528.590822:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.590964:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701696 00000100:00100000:2.0:1786562528.590976:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701696 00000100:00100000:2.0:1786562528.591068:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17422 00000100:00100000:2.0:1786562528.591079:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652701696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.591098:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.591121:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4ba expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562528.591150:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x716:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7de, atime: 0x0, ctime: 0x6a7cc7de, blocks: 0x807 00010000:00010000:2.0:1786562528.591173:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=961s v=(0 0) 00010000:00010000:2.0:1786562528.591177:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.591187:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.591205:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.591219:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a068c400, rc 0) 00000100:00100000:2.0:1786562528.591279:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63976:x1873345652701696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 202us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.591286:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17422 00000100:00100000:1.0:1786562528.611198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.611409:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701824 00000100:00100000:0.0:1786562528.611419:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701824 00000100:00100000:0.0:1786562528.611498:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17423 00000100:00100000:0.0:1786562528.611509:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:63976:x1873345652701824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562528.611527:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562528.611548:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4c1 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562528.611578:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x733:0x0] initial LVB size: 5185536, mtime: 0x6a7cc7de, atime: 0x0, ctime: 0x6a7cc7de, blocks: 0x7b1 00010000:00010000:0.0:1786562528.611601:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=961s v=(0 0) 00010000:00010000:0.0:1786562528.611606:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.611615:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 13 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.611641:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 13 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.611655:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9864c1c00, rc 0) 00000100:00100000:0.0:1786562528.611733:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:63976:x1873345652701824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 226us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.611741:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17423 00000100:00100000:3.0:1786562528.620617:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.620669:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.620858:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702080 00000100:00100000:0.0:1786562528.620868:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702080 00002000:00010000:0.0:1786562528.620910:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1815 (4194304->18446744073709551615) 00002000:00100000:0.0:1786562528.620916:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ec700 with x1873345652702080 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1786562528.620929:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7ec700. 00000100:00100000:0.0:1786562528.620959:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652701952 00000100:00100000:0.0:1786562528.620963:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652701952 00002000:00010000:0.0:1786562528.620982:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1843 (5182624->18446744073709551615) 00002000:00100000:0.0:1786562528.620985:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ef100 with x1873345652701952 ext(5182624->18446744073709551615) 00002000:00010000:0.0:1786562528.620991:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7ef100. 00000100:00100000:0.0:1786562528.621044:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11364 00000100:00100000:0.0:1786562528.621054:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652702080:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562528.621367:0:29460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562528.621371:0:29460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562517 -> 1786562527 00002000:00010000:0.0:1786562528.621374:0:29460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562528.621376:0:29460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562517 -> 1786562527 00002000:00010000:0.0:1786562528.621378:0:29460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562528.621445:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652702080:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 380us (826us total) trans 17179876002 rc 0/0 00000100:00100000:0.0:1786562528.621453:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11364 00002000:00010000:0.0:1786562528.621457:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1815 (4194304->18446744073709551615) 00002000:00100000:0.0:1786562528.621460:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ec700 with x1873345652702080 ext(4194304->18446744073709551615) 00002000:00010000:0.0:1786562528.621464:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7ec700. 00000100:00100000:0.0:1786562528.621480:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11365 00000100:00100000:0.0:1786562528.621487:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652701952:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562528.621873:0:29460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5185536 -> 5182624 00002000:00010000:0.0:1786562528.621876:0:29460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562526 -> 1786562527 00002000:00010000:0.0:1786562528.621879:0:29460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562528.621881:0:29460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562526 -> 1786562527 00002000:00010000:0.0:1786562528.621883:0:29460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:0.0:1786562528.621905:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652701952:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 419us (1237us total) trans 21474843528 rc 0/0 00000100:00100000:0.0:1786562528.621912:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11365 00002000:00010000:0.0:1786562528.621916:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1843 (5182624->18446744073709551615) 00002000:00100000:0.0:1786562528.621919:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ef100 with x1873345652701952 ext(5182624->18446744073709551615) 00002000:00010000:0.0:1786562528.621923:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7ef100. 00000100:00100000:1.0:1786562528.654684:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.654849:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702208 00000100:00100000:2.0:1786562528.654860:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702208 00000100:00100000:2.0:1786562528.654922:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17022 00000100:00100000:2.0:1786562528.654932:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63976:x1873345652702208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.654959:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.654981:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4c8 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.655125:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1c00/0x5c655bf66689e2ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.655142:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1c00/0x5c655bf66689e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.655155:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1c00/0x5c655bf66689e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562528.655179:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:2.0:1786562528.655183:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562528.655209:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1c00/0x5c655bf66689e2ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.655235:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c8 expref: 12 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.655252:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1c00/0x5c655bf66689e2ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c8 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.655261:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:2.0:1786562528.655264:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562528.655268:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9862d1c00, rc 0) 00000100:00100000:2.0:1786562528.655331:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63976:x1873345652702208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 401us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.655338:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17022 00000100:00100000:1.0:1786562528.673365:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.673479:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702464 00000100:00100000:2.0:1786562528.673499:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702464 00000100:00100000:2.0:1786562528.673554:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17023 00000100:00100000:2.0:1786562528.673564:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63976:x1873345652702464:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562528.673617:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562528.673658:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1c00/0x5c655bf66689e2ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c8 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.673678:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:2.0:1786562528.673692:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562528.673921:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.673935:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.673945:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562528.673997:0:35929:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950559 00000004:00010000:2.0:1786562528.674071:0:35929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5889556 reply state 000000007a5c6e25 transno 8589950560 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.674080:0:35929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562528.674470:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:63976:x1873345652702464:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 906us (1114us total) trans 8589950560 rc 0/0 00000100:00100000:2.0:1786562528.674478:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17023 00000020:00080000:2.0:1786562528.674491:0:35929:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786562528.679272:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.679289:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.679298:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.679305:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9862d0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562528.679310:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.679322:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.679340:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562528.679344:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562528.679348:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.679355:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0600/0x5c655bf66689e2f5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.691980:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.692737:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702592 00000100:00100000:3.0:1786562528.692749:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702592 00000100:00100000:3.0:1786562528.692811:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17424 00000100:00100000:3.0:1786562528.692821:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:63976:x1873345652702592:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562528.692841:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562528.692862:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4cf expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562528.692890:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7df, atime: 0x0, ctime: 0x6a7cc7df, blocks: 0x2007 00010000:00010000:3.0:1786562528.692913:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=961s v=(0 0) 00010000:00010000:3.0:1786562528.692918:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562528.692927:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 13 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.692943:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 13 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.692961:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:3.0:1786562528.693045:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:63976:x1873345652702592:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 225us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562528.693052:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17424 00000100:00100000:0.0:1786562528.712384:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.712466:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702720 00000100:00100000:2.0:1786562528.712475:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702720 00000100:00100000:2.0:1786562528.712703:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17425 00000100:00100000:2.0:1786562528.712715:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:63976:x1873345652702720:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.712735:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.712760:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4d6 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562528.712787:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x718:0x0] initial LVB size: 8388608, mtime: 0x6a7cc7df, atime: 0x0, ctime: 0x6a7cc7df, blocks: 0x2007 00010000:00010000:2.0:1786562528.712810:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=961s v=(0 0) 00010000:00010000:2.0:1786562528.712815:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.712825:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 14 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.712842:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 14 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.712859:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9862d1c00, rc 0) 00000100:00100000:2.0:1786562528.712920:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:63976:x1873345652702720:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 208us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.712927:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17425 00000100:00100000:1.0:1786562528.725969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.726077:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702848 00000100:00100000:2.0:1786562528.726097:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702848 00000100:00100000:2.0:1786562528.726165:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17426 00000100:00100000:2.0:1786562528.726175:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:63976:x1873345652702848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.726194:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.726217:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4dd expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562528.726245:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x719:0x0] initial LVB size: 5185536, mtime: 0x6a7cc7df, atime: 0x0, ctime: 0x6a7cc7df, blocks: 0x7af 00010000:00010000:2.0:1786562528.726268:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=961s v=(0 0) 00010000:00010000:2.0:1786562528.726273:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.726283:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 15 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.726299:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 15 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.726313:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9862d0600, rc 0) 00000100:00100000:2.0:1786562528.726365:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:63976:x1873345652702848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.726377:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17426 00000100:00100000:1.0:1786562528.735261:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.735305:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.735390:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652702976 00000100:00100000:2.0:1786562528.735400:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652702976 00002000:00010000:2.0:1786562528.735454:0:14369:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1817 (5182624->18446744073709551615) 00002000:00100000:2.0:1786562528.735460:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf59f80 with x1873345652702976 ext(5182624->18446744073709551615) 00002000:00010000:2.0:1786562528.735472:0:14369:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf59f80. 00000100:00100000:2.0:1786562528.735509:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652703104 00000100:00100000:2.0:1786562528.735513:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652703104 00002000:00010000:2.0:1786562528.735526:0:14369:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1844 (4194304->18446744073709551615) 00002000:00100000:2.0:1786562528.735529:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5aa00 with x1873345652703104 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1786562528.735536:0:14369:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5aa00. 00000100:00100000:2.0:1786562528.735564:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11366 00000100:00100000:2.0:1786562528.735574:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652702976:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562528.735888:0:14369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5185536 -> 5182624 00002000:00010000:2.0:1786562528.735892:0:14369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:2.0:1786562528.735894:0:14369:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562528.735896:0:14369:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:2.0:1786562528.735898:0:14369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:2.0:1786562528.735955:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2350:x1873345652702976:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 382us (705us total) trans 17179876003 rc 0/0 00000100:00100000:2.0:1786562528.735963:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11366 00002000:00010000:2.0:1786562528.735967:0:14369:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1817 (5182624->18446744073709551615) 00002000:00100000:2.0:1786562528.735970:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf59f80 with x1873345652702976 ext(5182624->18446744073709551615) 00002000:00010000:2.0:1786562528.735975:0:14369:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf59f80. 00000100:00100000:2.0:1786562528.735994:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11367 00000100:00100000:2.0:1786562528.736002:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652703104:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562528.736619:0:14369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1786562528.736624:0:14369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562518 -> 1786562527 00002000:00010000:2.0:1786562528.736626:0:14369:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562528.736628:0:14369:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562518 -> 1786562527 00002000:00010000:2.0:1786562528.736631:0:14369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1786562528.736756:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652703104:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 753us (1449us total) trans 21474843529 rc 0/0 00000100:00100000:2.0:1786562528.736764:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11367 00002000:00010000:2.0:1786562528.736767:0:14369:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1844 (4194304->18446744073709551615) 00002000:00100000:2.0:1786562528.736770:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5aa00 with x1873345652703104 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1786562528.736775:0:14369:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5aa00. 00000100:00100000:0.0:1786562528.742942:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.743032:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652703360 00000100:00100000:1.0:1786562528.743041:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652703360 00000100:00100000:1.0:1786562528.743111:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17024 00000100:00100000:1.0:1786562528.743122:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:63976:x1873345652703360:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562528.743225:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.743244:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.743256:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562528.743390:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002848bd3 reply state 000000007f78f19f transno 8589950561 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.743405:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562528.743530:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:63976:x1873345652703360:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 409us (596us total) trans 8589950561 rc 0/0 00000100:00100000:1.0:1786562528.743537:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17024 00010000:00010000:3.0:1786562528.754880:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.754898:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.754906:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.754911:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562528.754916:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.754923:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.754940:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:3.0:1786562528.754943:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562528.754948:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562528.754954:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689e311 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.764469:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.764855:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652703488 00000100:00100000:2.0:1786562528.764868:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652703488 00000100:00100000:2.0:1786562528.764930:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17427 00000100:00100000:2.0:1786562528.764941:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:63976:x1873345652703488:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.764960:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.764980:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4e4 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.765057:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 17 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.765068:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786562528.765072:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.765077:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.765133:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 17 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.765147:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 17 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.765161:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654824832:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562528.765255:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562528.768752:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.768903:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652703616 00000100:00100000:0.0:1786562528.768912:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652703616 00010000:00010000:0.0:1786562528.768955:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 18 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.769002:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8499 00000100:00100000:0.0:1786562528.769043:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652703616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562528.769057:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562528.769079:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 18 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.769093:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 18 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.769130:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.769135:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.769142:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.769152:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.769191:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.769212:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654824960:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562528.769285:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00010000:00010000:2.0:1786562528.771900:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f200ccc0/0x5c655bf66689e1cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc474 expref: 18 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.771923:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654824832:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562528.771954:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.771968:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261c400, rc 0) 00000100:00100000:2.0:1786562528.772092:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:63976:x1873345652703488:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 7152us (7634us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.772101:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17427 00000100:00100000:0.0:1786562528.774070:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654824960:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562528.774118:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562528.774171:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652703616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5129us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.774183:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8499 00000100:00100000:3.0:1786562528.776516:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.776628:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652703744 00000100:00100000:2.0:1786562528.776637:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652703744 00000100:00100000:2.0:1786562528.776707:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17428 00000100:00100000:2.0:1786562528.776716:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:63976:x1873345652703744:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562528.776738:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562528.776758:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4eb expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.776792:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.776801:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786562528.776805:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.776811:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.776844:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.776858:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.776872:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654825088:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562528.776945:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562528.784578:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.784993:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654825088:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562528.785066:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.785099:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261de00, rc 0) 00000100:00100000:0.0:1786562528.785165:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:63976:x1873345652703744:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8450us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.785176:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17428 00000100:00100000:1.0:1786562528.785465:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652703872 00000100:00100000:1.0:1786562528.785474:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652703872 00010000:00010000:1.0:1786562528.785518:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.785555:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8500 00000100:00100000:1.0:1786562528.785565:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652703872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562528.785581:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562528.785603:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.785616:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.785854:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020fc96ec/0x5c655bf66689e1d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc47b expref: 16 pid: 29966 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.785873:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562528.785877:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562528.785886:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 15 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.785897:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 15 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.785933:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 15 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.785947:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654825216:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562528.786002:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562528.792425:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654825216:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562528.792473:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562528.792544:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652703872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6980us (7976us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.792560:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8500 00000100:00100000:2.0:1786562528.801516:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.802871:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704000 00000100:00100000:1.0:1786562528.802886:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704000 00000100:00100000:1.0:1786562528.802964:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17429 00000100:00100000:1.0:1786562528.802976:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:63976:x1873345652704000:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562528.802994:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562528.803058:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4f2 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.803094:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.803114:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786562528.803119:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562528.803125:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.803167:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.803180:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.803196:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654825344:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562528.803289:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92900 going to sleep for 11 seconds 00000100:00100000:1.0:1786562528.812273:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.813373:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654825344:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562528.813416:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.813450:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562528.813843:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:63976:x1873345652704000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 10866us (12336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.813853:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17429 00000100:00100000:0.0:1786562528.815538:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704128 00000100:00100000:0.0:1786562528.815552:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704128 00010000:00010000:0.0:1786562528.815595:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.815631:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8501 00000100:00100000:0.0:1786562528.815640:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652704128:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562528.815656:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562528.815681:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.815695:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.815721:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e1dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc482 expref: 16 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.815737:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.815741:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.815750:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.815760:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.815797:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.815811:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654825472:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562528.815898:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562528.821426:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654825472:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562528.821467:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562528.821542:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652704128:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5902us (9278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.821557:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8501 00000100:00100000:3.0:1786562528.832102:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.832339:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704256 00000100:00100000:0.0:1786562528.832348:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704256 00000100:00100000:0.0:1786562528.832399:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17430 00000100:00100000:0.0:1786562528.832409:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:63976:x1873345652704256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562528.832426:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562528.832455:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc4f9 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.832545:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.832556:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562528.832561:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.832566:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 17 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.832602:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.832616:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.832799:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654825600:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562528.832929:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562528.860847:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.861096:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654825600:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562528.861131:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 17 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.861154:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9864c1600, rc 0) 00000100:00100000:0.0:1786562528.861221:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:63976:x1873345652704256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 28812us (29127us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.861231:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17430 00000100:00100000:2.0:1786562528.861884:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704384 00000100:00100000:2.0:1786562528.861903:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704384 00010000:00010000:2.0:1786562528.861932:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.861970:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8502 00000100:00100000:2.0:1786562528.861980:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652704384:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562528.861994:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562528.862061:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.862074:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.862097:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689e1e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc489 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.862113:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.862118:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.862126:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.862136:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.862185:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.862200:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654825728:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562528.862268:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562528.870825:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.870836:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654825728:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562528.870859:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562528.870921:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652704384:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 8942us (10082us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.870933:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8502 00000100:00100000:0.0:1786562528.871041:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704512 00000100:00100000:0.0:1786562528.871048:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704512 00000100:00100000:0.0:1786562528.871099:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17431 00000100:00100000:0.0:1786562528.871108:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:63976:x1873345652704512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562528.871125:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562528.871147:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc500 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.871182:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 17 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.871200:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562528.871205:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.871212:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 17 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.871246:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 17 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.871265:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.871278:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654825856:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562528.871329:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562528.892409:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.892572:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704640 00000100:00100000:2.0:1786562528.892581:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704640 00010000:00010000:2.0:1786562528.892636:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 18 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.892686:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8503 00000100:00100000:2.0:1786562528.893049:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652704640:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562528.893067:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562528.893090:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 18 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.893105:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 18 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.893131:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.893136:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562528.893144:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.893153:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.893189:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.893316:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654825984:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562528.893397:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1786562528.895156:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689e1eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc490 expref: 18 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.895178:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654825856:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562528.895223:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 17 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.895238:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364a00, rc 0) 00000100:00100000:0.0:1786562528.895301:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:63976:x1873345652704512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 24194us (24485us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.895311:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17431 00000100:00100000:3.0:1786562528.903453:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562528.903567:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704768 00000100:00100000:0.0:1786562528.903576:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704768 00000100:00100000:0.0:1786562528.903657:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17432 00000100:00100000:0.0:1786562528.903667:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:63976:x1873345652704768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562528.903686:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562528.903716:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc507 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.903756:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.903765:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562528.903769:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562528.903774:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.903808:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.903821:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 16 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.903836:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654826112:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562528.903917:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562528.904868:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654825984:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562528.904893:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562528.904942:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652704640:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12245us (12540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562528.904958:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8503 00000100:00100000:3.0:1786562528.908415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.908509:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652704896 00000100:00100000:1.0:1786562528.908527:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652704896 00010000:00010000:1.0:1786562528.908568:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.908631:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8504 00000100:00100000:1.0:1786562528.908642:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652704896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562528.908657:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562528.908682:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.908707:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.908741:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562528.908746:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562528.908755:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 17 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.908765:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 17 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.908803:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 17 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.908817:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654826240:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562528.908899:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92240 going to sleep for 11 seconds 00010000:00010000:0.0:1786562528.910181:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689e1f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc497 expref: 17 pid: 12119 timeout: 1061 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562528.910213:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654826112:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562528.910239:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562528.910255:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:0.0:1786562528.910305:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:63976:x1873345652704768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6640us (6861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562528.910314:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17432 00000100:00100000:3.0:1786562528.915275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.915309:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.915333:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.915358:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.915377:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.915400:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562528.915437:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705024 00000100:00100000:3.0:1786562528.915447:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705024 00000100:00100000:3.0:1786562528.915489:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705152 00000100:00100000:3.0:1786562528.915493:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705152 00000100:00100000:3.0:1786562528.915508:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705280 00000100:00100000:3.0:1786562528.915510:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705280 00000100:00100000:3.0:1786562528.915539:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705408 00000100:00100000:3.0:1786562528.915543:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705408 00000100:00100000:3.0:1786562528.915558:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705664 00000100:00100000:3.0:1786562528.915561:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705664 00000100:00100000:3.0:1786562528.915574:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705536 00000100:00100000:3.0:1786562528.915576:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705536 00000100:00100000:3.0:1786562528.915604:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17433 00000100:00100000:3.0:1786562528.915621:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652705024:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562528.915848:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1786562528.915852:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562522 -> 1786562525 00002000:00010000:3.0:1786562528.915854:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562512 -> 1786562525 00002000:00010000:3.0:1786562528.915857:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562522 -> 1786562528 00002000:00010000:3.0:1786562528.915860:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562528.915916:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652705024:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 303us (650us total) trans 17179876004 rc 0/0 00000100:00100000:3.0:1786562528.915924:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17433 00000100:00100000:3.0:1786562528.915944:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17434 00000100:00100000:3.0:1786562528.915960:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652705152:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562528.916102:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562528.916105:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562528.916108:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562513 -> 1786562525 00002000:00010000:3.0:1786562528.916110:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562525 -> 1786562528 00002000:00010000:3.0:1786562528.916112:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1786562528.916134:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652705152:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 183us (824us total) trans 21474843530 rc 0/0 00000100:00100000:3.0:1786562528.916140:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17434 00000100:00100000:3.0:1786562528.916153:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17435 00000100:00100000:3.0:1786562528.916160:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652705280:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562528.916236:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562528.916240:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562528.916242:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562528.916243:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562525 -> 1786562528 00002000:00010000:3.0:1786562528.916245:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562528.916268:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652705280:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 108us (933us total) trans 21474843531 rc 0/0 00000100:00100000:3.0:1786562528.916274:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17435 00000100:00100000:3.0:1786562528.916288:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17436 00000100:00100000:3.0:1786562528.916295:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652705408:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562528.916374:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562528.916377:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562524 -> 1786562525 00002000:00010000:3.0:1786562528.916380:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562523 -> 1786562525 00002000:00010000:3.0:1786562528.916382:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562523 -> 1786562528 00002000:00010000:3.0:1786562528.916384:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1786562528.916408:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652705408:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 113us (1048us total) trans 17179876005 rc 0/0 00000100:00100000:3.0:1786562528.916414:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17436 00000100:00100000:3.0:1786562528.916443:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17437 00000100:00100000:3.0:1786562528.916450:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652705664:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562528.916524:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562528.916527:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562528.916529:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562524 -> 1786562525 00002000:00010000:3.0:1786562528.916532:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562525 -> 1786562528 00002000:00010000:3.0:1786562528.916534:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562528.916556:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652705664:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 106us (1177us total) trans 21474843532 rc 0/0 00000100:00100000:3.0:1786562528.916562:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17437 00000100:00100000:3.0:1786562528.916576:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17438 00000100:00100000:3.0:1786562528.916583:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652705536:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562528.916660:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562528.916663:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562524 -> 1786562525 00002000:00010000:3.0:1786562528.916666:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562523 -> 1786562525 00002000:00010000:3.0:1786562528.916668:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562520 -> 1786562528 00002000:00010000:3.0:1786562528.916670:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:3.0:1786562528.916692:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652705536:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 109us (1291us total) trans 17179876006 rc 0/0 00000100:00100000:3.0:1786562528.916698:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17438 00000100:00100000:1.0:1786562528.919053:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654826240:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562528.919299:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562528.919347:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652704896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10707us (10941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562528.919357:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8504 00000100:00100000:3.0:1786562528.935453:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562528.935565:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652705920 00000100:00100000:2.0:1786562528.935576:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652705920 00000100:00100000:2.0:1786562528.935982:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6233 00000100:00100000:2.0:1786562528.935994:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:63976:x1873345652705920:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1786562528.936106:0:33116:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e17b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc45f expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.936158:0:33116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.936172:0:33116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.936181:0:33116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.936228:0:33116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.936242:0:33116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 13 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.936257:0:33116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:33116:1873345654826368:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562528.936336:0:33116:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562528.941345:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562528.941447:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652706048 00000100:00100000:1.0:1786562528.941456:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652706048 00010000:00010000:1.0:1786562528.941495:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 14 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562528.941543:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8505 00000100:00100000:1.0:1786562528.941553:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652706048:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562528.941578:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562528.941594:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 14 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.941606:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 14 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.941638:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562528.941645:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.941655:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.941663:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562528.941682:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562528.941747:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652706048:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 195us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562528.941756:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8505 00010000:00010000:2.0:1786562528.942488:0:33116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88c647e00/0x5c655bf66689e1ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc466 expref: 13 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562528.942525:0:33116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:33116:1873345654826368:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562528.942547:0:33116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.942565:0:33116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562528.942571:0:33116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786562528.949498:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4361, 88 off354016 00000004:00080000:2.0:1786562528.949516:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391509866ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949595:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4339, 88 off351896 00000004:00080000:2.0:1786562528.949602:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391596021ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949645:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4340, 88 off351984 00000004:00080000:2.0:1786562528.949649:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391643632ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949667:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4362, 88 off354104 00000004:00080000:2.0:1786562528.949672:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391666569ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949688:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4363, 88 off354192 00000004:00080000:2.0:1786562528.949692:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391686658ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949710:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4341, 88 off352072 00000004:00080000:2.0:1786562528.949714:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391708408ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949729:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4342, 88 off352160 00000004:00080000:2.0:1786562528.949733:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391727401ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949772:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4344, 88 off352344 00000004:00080000:2.0:1786562528.949778:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391772072ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949798:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4364, 88 off354280 00000004:00080000:2.0:1786562528.949803:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391797128ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949816:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4345, 88 off352432 00000004:00080000:2.0:1786562528.949820:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391814767ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949835:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4365, 88 off354368 00000004:00080000:2.0:1786562528.949838:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391832777ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949852:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4346, 88 off352520 00000004:00080000:2.0:1786562528.949856:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391850273ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562528.949869:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4366, 88 off354456 00000004:00080000:2.0:1786562528.949872:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391866588ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949885:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4367, 88 off354544 00000004:00080000:2.0:1786562528.949888:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391882579ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949903:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4368, 88 off354632 00000004:00080000:2.0:1786562528.949907:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391901402ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949923:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4369, 88 off354720 00000004:00080000:2.0:1786562528.949926:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961391920782ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562528.949943:0:33116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4347, 88 off352608 00000004:00080000:2.0:1786562528.949947:0:33116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961391941206ns, next at 911624464511ns, rc = 0 00010000:00010000:1.0:1786562528.999324:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1786562529.068889:0:33116:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000134f4cd1 reply state 00000000ddbc51ed transno 8589950562 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.068910:0:33116:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562529.068922:0:33116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:0.0:1786562529.068925:0:33116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562529.068933:0:33116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e17b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc45f expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562529.069036:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950561 is committed 00000001:00080000:3.0:1786562529.069050:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950562 is committed 00000004:00080000:3.0:1786562529.069055:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2855 committed 00000004:00080000:3.0:1786562529.069070:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2879 committed 00000004:00080000:3.0:1786562529.069082:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2878 committed 00000004:00080000:3.0:1786562529.069084:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2877 committed 00000004:00080000:3.0:1786562529.069086:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2876 committed 00000004:00080000:3.0:1786562529.069088:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2854 committed 00000004:00080000:3.0:1786562529.069090:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2875 committed 00000004:00080000:3.0:1786562529.069092:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2853 committed 00000004:00080000:3.0:1786562529.069094:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2874 committed 00000004:00080000:3.0:1786562529.069096:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2852 committed 00000004:00080000:3.0:1786562529.069099:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2851 committed 00000004:00080000:3.0:1786562529.069101:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2850 committed 00000004:00080000:3.0:1786562529.069105:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2873 committed 00000004:00080000:3.0:1786562529.069108:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2872 committed 00000004:00080000:3.0:1786562529.069110:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2849 committed 00000004:00080000:3.0:1786562529.069112:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2848 committed 00000004:00080000:3.0:1786562529.069114:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2871 committed 00000100:00100000:3.0:1786562529.069283:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654826496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.069354:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.069383:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.069407:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.069442:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786562529.069448:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654826880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.069471:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.069487:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.069505:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.069546:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654826752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.069972:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.070028:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654827264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.070055:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.070078:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786562529.070083:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654826624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.070106:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.070123:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654827136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.070145:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.070177:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654826496 00000100:00100000:3.0:1786562529.070185:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654826496 00000100:00100000:0.0:1786562529.070278:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827008 00000100:00100000:0.0:1786562529.070284:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827008 00000100:00100000:0.0:1786562529.070326:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654826880 00000100:00100000:0.0:1786562529.070329:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654826880 00000100:00100000:0.0:1786562529.070344:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827392 00000100:00100000:0.0:1786562529.070347:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827392 00000100:00100000:0.0:1786562529.070360:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654826752 00000100:00100000:0.0:1786562529.070362:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654826752 00000100:00100000:0.0:1786562529.070375:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827264 00000100:00100000:0.0:1786562529.070377:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827264 00000100:00100000:0.0:1786562529.070389:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654826624 00000100:00100000:0.0:1786562529.070392:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654826624 00000100:00100000:0.0:1786562529.070405:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827136 00000100:00100000:0.0:1786562529.070408:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827136 00000100:00100000:0.0:1786562529.070432:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439 00000100:00100000:0.0:1786562529.070442:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654827008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.070988:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.070994:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.070996:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.070998:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.071000:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562529.071089:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654827008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 648us (1679us total) trans 17179876007 rc 0/0 00000100:00100000:0.0:1786562529.071111:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439 00000100:00100000:0.0:1786562529.071130:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440 00000100:00100000:0.0:1786562529.071138:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654826880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.071946:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17441 00000100:00100000:3.0:1786562529.071956:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654827392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562529.072103:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:3.0:1786562529.072107:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.072109:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.072111:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.072114:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562529.072152:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654827392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (2645us total) trans 17179876008 rc 0/0 00000100:00100000:3.0:1786562529.072160:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17441 00000100:00100000:3.0:1786562529.072174:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17442 00000100:00100000:3.0:1786562529.072181:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654826752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.072351:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562529.072355:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.072357:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.072359:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.072361:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562529.072391:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654826880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1254us (2919us total) trans 17179876009 rc 0/0 00000100:00100000:0.0:1786562529.072398:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440 00000100:00100000:0.0:1786562529.072411:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443 00000100:00100000:0.0:1786562529.072418:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654827264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.072532:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.072535:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.072537:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.072539:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.072541:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1786562529.072988:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654827648:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562529.073176:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562529.073180:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.073182:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.073184:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:3.0:1786562529.073187:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:1.0:1786562529.082261:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.082305:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654828160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.082336:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.082357:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786562529.082363:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654827776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.082381:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.082391:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654828288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.082410:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.082454:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827648 00000100:00100000:1.0:1786562529.082461:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827648 00000100:00100000:1.0:1786562529.082492:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654828160 00000100:00100000:1.0:1786562529.082496:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654828160 00000100:00100000:1.0:1786562529.082506:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827776 00000100:00100000:1.0:1786562529.082509:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827776 00000100:00100000:1.0:1786562529.082531:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654828288 00000100:00100000:1.0:1786562529.082533:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654828288 00000100:00100000:1.0:1786562529.082547:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444 00000100:00100000:1.0:1786562529.087063:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654826624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562529.087367:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562529.087371:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.087374:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.087376:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:1.0:1786562529.087378:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1786562529.087462:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3290:x1873345654826624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4903us (17350us total) trans 17179876012 rc 0/0 00000100:00100000:1.0:1786562529.087473:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444 00000100:00100000:1.0:1786562529.087506:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17445 00000100:00100000:1.0:1786562529.087518:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654827136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562529.087614:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562529.087618:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:1.0:1786562529.087959:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562529.087962:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:1.0:1786562529.087965:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1786562529.088000:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3290:x1873345654827136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 486us (17853us total) trans 17179876013 rc 0/0 00000100:00100000:1.0:1786562529.088028:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17445 00000100:00100000:1.0:1786562529.088043:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17446 00000100:00100000:1.0:1786562529.088051:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654826496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562529.088165:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1786562529.088169:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.088171:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.088173:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:1.0:1786562529.088175:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562529.088349:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3292:x1873345654826496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 300us (18995us total) trans 17179876014 rc 0/0 00000100:00100000:1.0:1786562529.088356:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17446 00000100:00100000:1.0:1786562529.088504:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447 00000100:00100000:1.0:1786562529.088525:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654827648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562529.089994:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562529.090002:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.090024:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.090027:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:1.0:1786562529.090030:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562529.090108:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654827648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1594us (7854us total) trans 21474843533 rc 0/0 00000100:00100000:1.0:1786562529.090118:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447 00000100:00100000:1.0:1786562529.090151:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448 00000100:00100000:1.0:1786562529.090161:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654828160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562529.090309:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562529.090313:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:1.0:1786562529.090315:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562529.090317:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:1.0:1786562529.090320:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562529.090349:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654828160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (8011us total) trans 21474843534 rc 0/0 00000100:00100000:1.0:1786562529.090356:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448 00000100:00100000:1.0:1786562529.090370:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17449 00000100:00100000:1.0:1786562529.090377:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654827776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562529.095032:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562529.095042:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.095045:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:1.0:1786562529.095047:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:1.0:1786562529.095049:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562529.095141:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654827776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4759us (12752us total) trans 21474843535 rc 0/0 00000100:00100000:1.0:1786562529.095153:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17449 00000100:00100000:1.0:1786562529.095188:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17450 00000100:00100000:1.0:1786562529.095200:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654828288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.096857:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654826752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 24669us (26879us total) trans 17179876011 rc 0/0 00000100:00100000:3.0:1786562529.096870:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17442 00000100:00100000:3.0:1786562529.096941:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.096984:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.097032:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654828032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097055:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786562529.097093:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6a00/2, rc 0, transno 17179876009 00000100:00100000:3.0:1786562529.097104:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654826880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.097117:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f7b80/2, rc 0, transno 17179876008 00000100:00100000:3.0:1786562529.097121:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827392:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.097131:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6680/2, rc 0, transno 17179876014 00000100:00100000:3.0:1786562529.097135:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654826496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.097145:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6300/2, rc 0, transno 17179876007 00000100:00100000:3.0:1786562529.097149:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.097162:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786562529.097168:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097212:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.097230:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654828416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097248:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.097275:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827520 00000100:00100000:3.0:1786562529.097282:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827520 00000100:00100000:3.0:1786562529.097317:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654828032 00000100:00100000:3.0:1786562529.097320:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654828032 00000100:00100000:3.0:1786562529.097331:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654827904 00000100:00100000:3.0:1786562529.097333:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654827904 00000100:00100000:3.0:1786562529.097341:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654828416 00000100:00100000:3.0:1786562529.097342:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654828416 00000100:00100000:3.0:1786562529.097353:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17451 00000100:00100000:3.0:1786562529.097359:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654827520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097377:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17452 00000100:00100000:3.0:1786562529.097382:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654828032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097394:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17453 00000100:00100000:3.0:1786562529.097399:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654827904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097411:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17454 00000100:00100000:3.0:1786562529.097416:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654828416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.097492:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654828544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.097528:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.097552:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654828544 00000100:00100000:3.0:1786562529.097556:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654828544 00000100:00100000:3.0:1786562529.097583:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17455 00000100:00100000:3.0:1786562529.097590:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654828544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562529.101214:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654827264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 28775us (31136us total) trans 17179876010 rc 0/0 00000100:00100000:0.0:1786562529.101234:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443 00002000:00010000:1.0:1786562529.101819:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:1.0:1786562529.101824:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:1.0:1786562529.101826:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562529.101828:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:1.0:1786562529.101830:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:1.0:1786562529.101897:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654828288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6701us (19485us total) trans 21474843536 rc 0/0 00000100:00100000:1.0:1786562529.101906:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17450 00000004:00080000:1.0:1786562529.101968:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf59500/2, rc 0, transno 21474843535 00000100:00100000:1.0:1786562529.101976:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654827776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562529.101988:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5a680/2, rc 0, transno 21474843536 00000100:00100000:1.0:1786562529.101991:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654828288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562529.102000:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5ad80/2, rc 0, transno 21474843533 00000100:00100000:1.0:1786562529.102026:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654827648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562529.102037:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf58e00/2, rc 0, transno 21474843534 00000100:00100000:1.0:1786562529.102040:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654828160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562529.102095:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f7480/2, rc 0, transno 17179876012 00000100:00100000:1.0:1786562529.102100:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654826624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562529.102111:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4000/2, rc 0, transno 17179876013 00000100:00100000:1.0:1786562529.102115:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654827136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562529.102127:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f5f80/2, rc 0, transno 17179876011 00000100:00100000:1.0:1786562529.102130:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654826752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562529.102139:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4700/2, rc 0, transno 17179876010 00000100:00100000:1.0:1786562529.102143:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654827264:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562529.102590:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562529.102594:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.102596:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.102598:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.102601:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562529.102876:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654828544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5284us (5346us total) trans 17179876015 rc 0/0 00000100:00100000:3.0:1786562529.102885:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17455 00000004:00080000:1.0:1786562529.103059:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf05c00/2, rc 0, transno 17179876015 00000100:00100000:1.0:1786562529.103065:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654828544:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1786562529.107998:0:33116:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1786562529.108043:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63976:x1873345652705920:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 172044us (172593us total) trans 8589950562 rc 0/0 00000100:00100000:2.0:1786562529.108058:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6233 00010000:00010000:1.0:1786562529.108841:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.108860:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.108866:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.108872:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562529.108876:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.108884:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.108902:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab500) 00010000:00010000:1.0:1786562529.108906:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562529.108910:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.108916:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e342 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562529.110209:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562529.110217:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:2.0:1786562529.110220:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:2.0:1786562529.110223:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:2.0:1786562529.110225:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1786562529.110307:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654827520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 12945us (13320us total) trans 21474843537 rc 0/0 00000100:00100000:2.0:1786562529.110319:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17451 00002000:00010000:1.0:1786562529.110552:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1786562529.110556:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:1.0:1786562529.110571:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562529.110573:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:1.0:1786562529.110575:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562529.110605:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654828032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 13222us (13549us total) trans 21474843538 rc 0/0 00000100:00100000:1.0:1786562529.110612:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17452 00000004:00080000:1.0:1786562529.110685:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5bb80/2, rc 0, transno 21474843537 00000100:00100000:1.0:1786562529.110855:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562529.110872:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5b480/2, rc 0, transno 21474843538 00000100:00100000:1.0:1786562529.110875:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654828032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.115822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.115862:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652706176 00000100:00100000:3.0:1786562529.115872:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652706176 00000100:00100000:3.0:1786562529.115927:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17025 00000100:00100000:3.0:1786562529.115938:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63976:x1873345652706176:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562529.115962:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562529.115988:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc50e expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.116084:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.116100:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.116121:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562529.116124:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562529.116129:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fa00, rc 0) 00000100:00100000:3.0:1786562529.116210:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652706176:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 258us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562529.116218:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17025 00002000:00010000:3.0:1786562529.126479:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562529.126488:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.126490:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.126493:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.126495:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1786562529.126588:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654828416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 29167us (29334us total) trans 21474843540 rc 0/0 00000100:00100000:3.0:1786562529.126600:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17454 00000004:00080000:3.0:1786562529.126675:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98553f480/2, rc 0, transno 21474843540 00000100:00100000:3.0:1786562529.126682:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654828416:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.126788:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562529.126792:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.126794:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562529.126795:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.126797:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562529.126832:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654827904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 29432us (29619us total) trans 21474843539 rc 0/0 00000100:00100000:2.0:1786562529.126840:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17453 00000004:00080000:3.0:1786562529.128146:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5b800/2, rc 0, transno 21474843539 00000100:00100000:3.0:1786562529.128157:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654827904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562529.137581:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.137714:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652706432 00000100:00100000:1.0:1786562529.137724:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652706432 00000100:00100000:1.0:1786562529.137782:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6234 00000100:00100000:1.0:1786562529.137792:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63976:x1873345652706432:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562529.138092:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63976:x1873345652706432:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 301us (520us total) trans 8589950563 rc 0/0 00000100:00100000:1.0:1786562529.138099:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6234 00000100:00100000:1.0:1786562529.258560:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.258654:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652706688 00000100:00100000:3.0:1786562529.258664:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652706688 00000100:00100000:3.0:1786562529.258754:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17026 00000100:00100000:3.0:1786562529.258767:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+501:63989:x1873345652706688:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562529.258793:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562529.258815:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc515 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.258889:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.258907:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.258919:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.258934:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.258941:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.258947:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259690:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259709:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259720:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562529.259738:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:3.0:1786562529.259860:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259875:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259882:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259890:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562529.259900:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259909:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259921:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562529.259924:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562529.259935:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259941:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259962:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259967:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259973:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259978:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562529.259987:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.259993:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.260063:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab300) 00010000:00010000:3.0:1786562529.260067:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562529.260077:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.260083:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f400/0x5c655bf66689e35e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.260132:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 504 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.260146:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 503 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.260153:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562529.260155:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562529.260158:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e200, rc 0) 00000100:00100000:3.0:1786562529.260260:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:63989:x1873345652706688:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1496us (1710us total) trans 8589950564 rc 0/0 00000100:00100000:3.0:1786562529.260275:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17026 00000100:00080000:0.0:1786562529.260643:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562529.279243:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.279579:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652706944 00000100:00100000:1.0:1786562529.279591:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652706944 00000100:00100000:1.0:1786562529.279715:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17027 00000100:00100000:1.0:1786562529.279726:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+503:63985:x1873345652706944:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562529.279754:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.279789:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc51c expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.279921:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.279945:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 504 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.279954:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.279990:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 504 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.280049:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 504 pid: 33114 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.280071:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654828672:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562529.280170:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562529.294312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.294359:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.294516:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707072 00000100:00100000:2.0:1786562529.294527:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707072 00000100:00100000:2.0:1786562529.294606:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17456 00000100:00100000:2.0:1786562529.294628:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:63989:x1873345652707072:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562529.294647:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562529.294679:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc523 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.294716:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.294726:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562529.294731:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562529.294737:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.294776:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.294789:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 18 pid: 29967 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.294804:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654828800:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562529.294878:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7fa80 going to sleep for 11 seconds 00000100:00080000:0.0:1786562529.294993:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562529.295208:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707328 00000100:00100000:1.0:1786562529.295214:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707328 00000100:00100000:1.0:1786562529.295268:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17028 00000100:00100000:1.0:1786562529.295276:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63990:x1873345652707328:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.295290:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.295304:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc52a expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.295370:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.295382:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.295393:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.295409:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.295430:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.295437:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562529.295777:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562529.295991:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296003:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296037:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562529.296048:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:1.0:1786562529.296142:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296149:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296156:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296162:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99822c000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562529.296167:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296175:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296191:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562529.296195:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562529.296199:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296205:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e38f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296220:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296226:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296233:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296238:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562529.296241:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296247:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296253:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562529.296256:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562529.296258:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296264:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e396 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296306:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296317:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.296323:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.296326:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562529.296329:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af415600, rc 0) 00000100:00100000:1.0:1786562529.296964:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63990:x1873345652707328:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1686us (2660us total) trans 8589950565 rc 0/0 00000100:00100000:1.0:1786562529.296974:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17028 00000100:00100000:0.0:1786562529.316990:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.317075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.317234:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654828672:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562529.317265:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.317352:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707456 00000100:00100000:2.0:1786562529.317360:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707456 00010000:00010000:2.0:1786562529.317404:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 505 pid: 33114 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.317448:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8506 00000100:00100000:2.0:1786562529.317459:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+505:2349:x1873345652707456:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.317475:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.317482:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 505 pid: 33114 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317496:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 505 pid: 33114 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317519:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e365 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc515 expref: 505 pid: 33114 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317541:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.317547:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317557:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317565:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317594:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.317649:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:2349:x1873345652707456:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 192us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.317658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8506 00000100:00100000:2.0:1786562529.317696:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707584 00000100:00100000:2.0:1786562529.317700:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707584 00010000:00010000:2.0:1786562529.317716:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 19 pid: 29967 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.317738:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8507 00000100:00100000:2.0:1786562529.317745:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652707584:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.317754:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.317777:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 19 pid: 29967 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317788:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 19 pid: 29967 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317807:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562529.317812:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562529.317820:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317830:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.317863:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.317876:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654828928:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562529.317927:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b240 going to sleep for 11 seconds 00010000:00010000:2.0:1786562529.317975:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689e2fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4cf expref: 19 pid: 29967 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.317987:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654828800:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562529.318042:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.318053:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0200, rc 0) 00000100:00100000:2.0:1786562529.318078:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:63989:x1873345652707072:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23465us (23719us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.318087:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17456 00010000:00010000:1.0:1786562529.318304:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.318313:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562529.318334:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:1.0:1786562529.318495:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.318512:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 504 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.318519:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.318521:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562529.318523:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:1.0:1786562529.318561:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:63985:x1873345652706944:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 38837us (39333us total) trans 8589950566 rc 0/0 00000100:00100000:1.0:1786562529.318568:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17027 00000100:00100000:2.0:1786562529.338574:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654828928:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562529.338603:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.338684:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652707584:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 20938us (21607us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.339499:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8507 00000100:00100000:0.0:1786562529.343954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.345768:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707712 00000100:00100000:3.0:1786562529.345781:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707712 00000100:00100000:3.0:1786562529.345879:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17029 00000100:00100000:3.0:1786562529.345889:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+504:63989:x1873345652707712:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562529.345919:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562529.345938:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e3b2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc531 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.346430:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc531 expref: 505 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.346447:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc531 expref: 505 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.353970:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.353980:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562529.353985:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e600, rc 0) 00000100:00100000:2.0:1786562529.354112:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+505:63989:x1873345652707712:12345-192.168.204.29@tcp:101:cat.0 Request processed in 8220us (10162us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.354122:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17029 00000100:00100000:3.0:1786562529.365158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.365219:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.365250:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.365297:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.365377:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707840 00000100:00100000:1.0:1786562529.365386:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707840 00000100:00100000:1.0:1786562529.365447:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652707968 00000100:00100000:1.0:1786562529.365451:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652707968 00000100:00100000:1.0:1786562529.365486:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17457 00000100:00100000:1.0:1786562529.365495:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:63989:x1873345652707840:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.365513:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.365531:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc538 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365562:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365572:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562529.365576:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562529.365581:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 24 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365621:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365635:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 17 pid: 29662 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.365650:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654829056:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562529.365732:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562529.365752:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17458 00000100:00100000:1.0:1786562529.365760:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:63990:x1873345652707968:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.365768:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.365776:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc53f expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365790:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562529.365796:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365807:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.365821:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:1.0:1786562529.365850:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63990:x1873345652707968:12345-192.168.204.29@tcp:101:cat.0 Request processed in 91us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.365858:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17458 00000100:00080000:1.0:1786562529.365880:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562529.366579:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652708480 00000100:00100000:2.0:1786562529.366586:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652708480 00000100:00100000:2.0:1786562529.366630:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652708224 00000100:00100000:2.0:1786562529.366634:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652708224 00000100:00100000:2.0:1786562529.366660:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17030 00000100:00100000:2.0:1786562529.366668:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63987:x1873345652708480:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562529.366692:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562529.366706:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7600/0x5c655bf66689e3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc54d expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.366773:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.366787:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.366798:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.366814:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.366823:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.366829:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367268:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367279:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367286:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562529.367296:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:2.0:1786562529.367391:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367398:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367404:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367410:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3fa800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562529.367414:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367437:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367449:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562529.367452:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562529.367456:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367462:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e3ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367475:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367480:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367485:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367490:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb38ec00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562529.367493:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367498:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367505:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d500) 00010000:00010000:2.0:1786562529.367507:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562529.367510:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367520:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e3d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367562:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7600/0x5c655bf66689e3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 11 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367575:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367582:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.367584:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786562529.367586:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb38e200, rc 0) 00000100:00100000:2.0:1786562529.367631:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:63987:x1873345652708480:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 964us (2411us total) trans 8589950567 rc 0/0 00000100:00100000:2.0:1786562529.367639:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17030 00000100:00100000:2.0:1786562529.367661:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17031 00000100:00100000:2.0:1786562529.367669:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+505:63985:x1873345652708224:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562529.367681:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562529.367683:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562529.367697:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e3b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc531 expref: 505 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367708:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.367711:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562529.367719:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e3ea lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc546 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367752:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367762:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 7 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367769:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367778:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367786:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367814:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367825:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 9 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.367838:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654829184:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562529.367898:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367907:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 9 pid: 33140 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.367918:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654829312:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562529.367952:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 7 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.367962:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 7 pid: 36756 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.367971:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654829440:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562529.367994:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562529.382407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.382473:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.382491:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.383322:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.383442:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652708608 00000100:00100000:0.0:1786562529.383452:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652708608 00010000:00010000:0.0:1786562529.383491:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.383522:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652708864 00000100:00100000:0.0:1786562529.383525:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652708864 00010000:00010000:0.0:1786562529.383539:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 8 pid: 36756 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.383555:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652708736 00000100:00100000:0.0:1786562529.383558:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652708736 00010000:00010000:0.0:1786562529.383568:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 10 pid: 33140 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.383583:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652708992 00000100:00100000:0.0:1786562529.383586:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652708992 00010000:00010000:0.0:1786562529.383594:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 11 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.383606:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8508 00000100:00100000:0.0:1786562529.383613:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652708608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562529.383627:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562529.383662:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.383808:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654829184:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562529.383821:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654829312:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562529.383831:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654829440:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562529.383859:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.383892:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8509 00000100:00100000:2.0:1786562529.383900:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:2348:x1873345652708864:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.383909:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.383915:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 8 pid: 36756 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.383926:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 8 pid: 36756 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.383953:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e349 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc50e expref: 8 pid: 36756 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.383968:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.383973:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.383982:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.383989:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.384064:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:2348:x1873345652708864:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 165us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.384073:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8509 00000100:00100000:2.0:1786562529.384092:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8510 00000100:00100000:2.0:1786562529.384099:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652708736:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.384109:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.384114:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 11 pid: 33140 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384123:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 11 pid: 33140 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384136:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e39d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc52a expref: 11 pid: 33140 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384154:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.384158:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384165:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384171:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.384189:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652708736:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 91us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.384195:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8510 00000100:00100000:2.0:1786562529.384206:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8511 00000100:00100000:2.0:1786562529.384211:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652708992:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.384219:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.384224:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 9 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384232:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 9 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384243:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e200/0x5c655bf66689e3dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc54d expref: 9 pid: 35929 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384253:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.384257:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384270:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384278:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384298:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.384316:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652708992:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 105us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.384322:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8511 00010000:00010000:2.0:1786562529.384340:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.384347:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786562529.385953:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4370, 88 off354808 00000004:00080000:2.0:1786562529.385967:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961827961043ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386051:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4348, 88 off352696 00000004:00080000:2.0:1786562529.386058:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828052467ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386084:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4349, 88 off352784 00000004:00080000:2.0:1786562529.386089:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828083326ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386106:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4371, 88 off354896 00000004:00080000:2.0:1786562529.386110:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828104011ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386126:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4372, 88 off354984 00000004:00080000:2.0:1786562529.386130:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828124163ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386146:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4350, 88 off352872 00000004:00080000:2.0:1786562529.386152:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828145443ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386166:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4351, 88 off352960 00000004:00080000:2.0:1786562529.386171:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828164468ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386186:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4352, 88 off353048 00000004:00080000:2.0:1786562529.386190:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828184701ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386206:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4373, 88 off355072 00000004:00080000:2.0:1786562529.386209:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828203491ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386224:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4353, 88 off353136 00000004:00080000:2.0:1786562529.386227:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828221689ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386242:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4374, 88 off355160 00000004:00080000:2.0:1786562529.386246:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828240689ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386261:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4354, 88 off353224 00000004:00080000:2.0:1786562529.386265:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828259417ns, next at 911624464511ns, rc = 0 00000040:00080000:2.0:1786562529.386281:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4375, 88 off355248 00000004:00080000:2.0:1786562529.386285:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828279373ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386300:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4376, 88 off355336 00000004:00080000:2.0:1786562529.386303:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828297273ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386318:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4377, 88 off355424 00000004:00080000:2.0:1786562529.386322:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828316636ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386338:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4378, 88 off355512 00000004:00080000:2.0:1786562529.386342:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 961828336252ns, next at 911624567946ns, rc = 0 00000040:00080000:2.0:1786562529.386357:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4355, 88 off353312 00000004:00080000:2.0:1786562529.386361:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 961828355436ns, next at 911624464511ns, rc = 0 00000100:00100000:1.0:1786562529.386995:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654829056:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562529.387097:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.398988:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 24 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.399033:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414600, rc 0) 00000100:00100000:1.0:1786562529.399114:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:63989:x1873345652707840:12345-192.168.204.29@tcp:101:cat.0 Request processed in 33618us (33963us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.399124:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17457 00010000:00010000:0.0:1786562529.401098:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689e318 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4e4 expref: 18 pid: 29662 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.401123:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562529.401128:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562529.401137:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 23 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.401146:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 23 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.401160:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562529.401162:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562529.401167:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.401173:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.401233:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.401248:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654829568:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562529.401329:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 23 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.401339:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654829696:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562529.401358:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562529.457024:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.457122:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.457156:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652709120 00000100:00100000:1.0:1786562529.457166:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652709120 00000100:00100000:1.0:1786562529.457234:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652709248 00000100:00100000:1.0:1786562529.457238:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652709248 00000100:00100000:1.0:1786562529.457263:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17032 00000100:00100000:1.0:1786562529.457274:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63990:x1873345652709120:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.457299:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.457320:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc554 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457378:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457390:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457410:0:33115:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457440:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457455:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.457459:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562529.457462:0:33115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457470:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:1.0:1786562529.457527:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63990:x1873345652709120:12345-192.168.204.29@tcp:101:cat.0 Request processed in 255us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.457535:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17032 00000100:00100000:1.0:1786562529.457555:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17033 00000100:00100000:1.0:1786562529.457563:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:63989:x1873345652709248:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.457571:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.457580:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc55b expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457605:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 508 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457622:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 3/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 508 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457630:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.457633:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562529.457636:0:33115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 8 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.457643:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfd5a800, rc 0) 00000100:00100000:1.0:1786562529.457664:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+508:63989:x1873345652709248:12345-192.168.204.29@tcp:101:cat.0 Request processed in 102us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.457671:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17033 00000100:00100000:1.0:1786562529.457811:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654829568:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562529.457823:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654829696:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562529.457842:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562529.457870:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652708608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 74257us (75473us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.457878:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8508 00000001:00080000:3.0:1786562529.560093:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950566 is committed 00000001:00080000:3.0:1786562529.560126:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950565 is committed 00000001:00080000:3.0:1786562529.560144:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950563 is committed 00000001:00080000:3.0:1786562529.560152:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950568 is committed 00000004:00080000:3.0:1786562529.560156:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2863 committed 00000004:00080000:3.0:1786562529.560172:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2888 committed 00000004:00080000:3.0:1786562529.560183:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2887 committed 00000004:00080000:3.0:1786562529.560186:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2886 committed 00000004:00080000:3.0:1786562529.560190:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2885 committed 00000004:00080000:3.0:1786562529.560208:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2862 committed 00000004:00080000:3.0:1786562529.560212:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2884 committed 00000004:00080000:3.0:1786562529.560214:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2861 committed 00000004:00080000:3.0:1786562529.560216:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2883 committed 00000004:00080000:3.0:1786562529.560219:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2860 committed 00000004:00080000:3.0:1786562529.560222:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2859 committed 00000004:00080000:3.0:1786562529.560224:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2858 committed 00000004:00080000:3.0:1786562529.560226:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2882 committed 00000004:00080000:3.0:1786562529.560228:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2881 committed 00000004:00080000:3.0:1786562529.560231:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2857 committed 00000004:00080000:3.0:1786562529.560233:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2856 committed 00000004:00080000:3.0:1786562529.560235:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2880 committed 00000001:00080000:3.0:1786562529.560243:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950567 is committed 00000100:00100000:3.0:1786562529.560395:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.560480:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.560514:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.560538:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.560562:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786562529.560569:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.560591:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.560625:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.560650:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.560695:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830208 00000100:00100000:3.0:1786562529.560702:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830208 00000100:00100000:3.0:1786562529.560748:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830720 00000100:00100000:3.0:1786562529.560751:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830720 00000100:00100000:3.0:1786562529.560770:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830080 00000100:00100000:3.0:1786562529.560773:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830080 00000100:00100000:3.0:1786562529.560792:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17459 00000100:00100000:3.0:1786562529.560802:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3292:x1873345654830208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562529.560998:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1786562529.561002:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:3.0:1786562529.561039:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.561042:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:3.0:1786562529.561044:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562529.561085:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1873345654830208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 284us (605us total) trans 17179876016 rc 0/0 00000100:00100000:3.0:1786562529.561092:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17459 00000100:00100000:3.0:1786562529.561108:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830592 00000100:00100000:3.0:1786562529.561111:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830592 00000100:00100000:3.0:1786562529.561130:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17460 00000100:00100000:3.0:1786562529.561136:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1873345654830720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562529.561213:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:3.0:1786562529.561216:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.561218:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.561220:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.561222:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562529.561248:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3292:x1873345654830720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (709us total) trans 17179876017 rc 0/0 00000100:00100000:3.0:1786562529.561256:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17460 00000100:00100000:3.0:1786562529.561269:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17461 00000100:00100000:3.0:1786562529.561275:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1873345654830080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562529.561353:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562529.561356:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.561358:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.561360:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:3.0:1786562529.561362:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:3.0:1786562529.561387:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3292:x1873345654830080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (795us total) trans 17179876018 rc 0/0 00000100:00100000:3.0:1786562529.561397:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17461 00000100:00100000:3.0:1786562529.561409:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17462 00000100:00100000:3.0:1786562529.561430:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1873345654830592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562529.561506:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562529.561509:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.561511:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.561513:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.561515:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562529.561540:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3292:x1873345654830592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (890us total) trans 17179876019 rc 0/0 00000100:00100000:3.0:1786562529.561547:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17462 00000004:00080000:3.0:1786562529.561588:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5df80/2, rc 0, transno 17179876018 00000100:00100000:3.0:1786562529.561600:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.561611:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5f480/2, rc 0, transno 17179876019 00000100:00100000:3.0:1786562529.561614:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.561622:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5e300/2, rc 0, transno 17179876016 00000100:00100000:3.0:1786562529.561626:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.561633:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5c700/2, rc 0, transno 17179876017 00000100:00100000:3.0:1786562529.561636:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654830720:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1786562529.562146:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 505 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562161:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562529.562165:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1786562529.562169:0:35929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 6 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562186:0:35929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 6 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562211:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 6 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562221:0:35929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562229:0:35929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562237:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.562268:0:35929:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.562281:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654830976:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562529.562375:0:35929:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 6 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.562386:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654831104:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562529.562410:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562529.564183:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654829824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.564432:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564471:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654830336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.564495:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564516:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654830848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.564538:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564555:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654831616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.564579:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564598:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654832128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.564802:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564833:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1786562529.564840:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654829952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.564860:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564876:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654830464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.564894:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564910:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654831232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.564927:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564941:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654831744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.564960:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.564992:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654831360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.565046:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.565065:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654831872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.565086:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.565123:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786562529.565129:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654831488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.565150:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562529.565160:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654832000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562529.565178:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562529.566444:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654829824 00000100:00100000:0.0:1786562529.566459:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654829824 00000100:00100000:0.0:1786562529.566504:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830336 00000100:00100000:0.0:1786562529.566507:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830336 00000100:00100000:0.0:1786562529.566522:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830848 00000100:00100000:0.0:1786562529.566526:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830848 00000100:00100000:0.0:1786562529.566537:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654831616 00000100:00100000:0.0:1786562529.566540:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654831616 00000100:00100000:0.0:1786562529.566551:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654832128 00000100:00100000:0.0:1786562529.566554:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654832128 00000100:00100000:0.0:1786562529.566564:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654829952 00000100:00100000:0.0:1786562529.566567:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654829952 00000100:00100000:0.0:1786562529.566577:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654830464 00000100:00100000:0.0:1786562529.566579:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654830464 00000100:00100000:0.0:1786562529.566589:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654831232 00000100:00100000:0.0:1786562529.566592:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654831232 00000100:00100000:0.0:1786562529.566600:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654831744 00000100:00100000:0.0:1786562529.566603:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654831744 00000100:00100000:0.0:1786562529.566624:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654831360 00000100:00100000:0.0:1786562529.566627:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654831360 00000100:00100000:0.0:1786562529.566637:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654831872 00000100:00100000:0.0:1786562529.566639:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654831872 00000100:00100000:0.0:1786562529.566650:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654831488 00000100:00100000:0.0:1786562529.566653:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654831488 00000100:00100000:0.0:1786562529.566661:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654832000 00000100:00100000:0.0:1786562529.566664:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654832000 00000100:00100000:0.0:1786562529.566675:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17463 00000100:00100000:0.0:1786562529.566692:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3289:x1873345654829824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.566909:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1786562529.566914:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.566916:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.566918:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:0.0:1786562529.566920:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562529.567029:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3289:x1873345654829824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 311us (2572us total) trans 17179876020 rc 0/0 00000100:00100000:0.0:1786562529.567039:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17463 00000100:00100000:0.0:1786562529.567059:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17464 00000100:00100000:0.0:1786562529.567066:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3289:x1873345654830336:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1786562529.567435:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5ea00/2, rc 0, transno 17179876020 00000100:00100000:2.0:1786562529.567444:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654829824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.569086:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17465 00000100:00100000:1.0:1786562529.569101:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3289:x1873345654830848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562529.569554:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17466 00000100:00100000:2.0:1786562529.569565:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3289:x1873345654831616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.569680:0:28862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562529.569683:0:28862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.569686:0:28862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562529.569688:0:28862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.569691:0:28862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562529.569768:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654831616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (5187us total) trans 21474843541 rc 0/0 00000100:00100000:2.0:1786562529.569776:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17466 00000100:00100000:2.0:1786562529.569800:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17467 00000100:00100000:2.0:1786562529.569806:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3289:x1873345654832128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.569888:0:28862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1786562529.569891:0:28862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:2.0:1786562529.569894:0:28862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562529.569896:0:28862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:2.0:1786562529.569898:0:28862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1786562529.569925:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654832128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (5122us total) trans 21474843542 rc 0/0 00000100:00100000:2.0:1786562529.569931:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17467 00000100:00100000:2.0:1786562529.569944:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17468 00000100:00100000:2.0:1786562529.569950:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3289:x1873345654829952:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.570042:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebca80/2, rc 0, transno 21474843541 00000100:00100000:3.0:1786562529.570050:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654831616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.570060:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebdc00/2, rc 0, transno 21474843542 00000100:00100000:3.0:1786562529.570063:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654832128:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.570255:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.570258:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.570261:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.570263:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.570265:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562529.570313:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3289:x1873345654830336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3248us (5817us total) trans 17179876021 rc 0/0 00000100:00100000:0.0:1786562529.570321:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17464 00000100:00100000:0.0:1786562529.570335:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17469 00000100:00100000:0.0:1786562529.570342:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3289:x1873345654830464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.570441:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.570444:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.570446:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.570448:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.570450:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562529.570480:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3289:x1873345654830464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (5585us total) trans 17179876023 rc 0/0 00000100:00100000:0.0:1786562529.570486:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17469 00000100:00100000:0.0:1786562529.570502:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17470 00000100:00100000:0.0:1786562529.570509:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3289:x1873345654831232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.570595:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562529.570598:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.570601:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.570603:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:0.0:1786562529.570605:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1786562529.570632:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654831232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (5702us total) trans 21474843543 rc 0/0 00000100:00100000:0.0:1786562529.570638:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17470 00000100:00100000:0.0:1786562529.570652:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17471 00000100:00100000:0.0:1786562529.570659:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3289:x1873345654831744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.570735:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562529.570739:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.570741:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.570743:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.570745:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562529.570772:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3289:x1873345654831744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (5811us total) trans 21474843544 rc 0/0 00000100:00100000:0.0:1786562529.570779:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17471 00000100:00100000:0.0:1786562529.570792:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17472 00000100:00100000:0.0:1786562529.570799:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1873345654831360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.570876:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562529.570880:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.570882:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.570884:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:0.0:1786562529.570886:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562529.570923:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1873345654831360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (5876us total) trans 21474843545 rc 0/0 00000100:00100000:0.0:1786562529.570928:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17472 00000100:00100000:0.0:1786562529.570943:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17473 00000100:00100000:0.0:1786562529.570949:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1873345654831872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.571046:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.571049:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.571051:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.571053:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.571055:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562529.571079:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1873345654831872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (5993us total) trans 21474843546 rc 0/0 00000100:00100000:0.0:1786562529.571085:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17473 00000100:00100000:0.0:1786562529.571097:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17474 00000100:00100000:0.0:1786562529.571102:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1873345654831488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.571173:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.571176:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.571178:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.571180:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:0.0:1786562529.571182:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562529.571207:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1873345654831488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (6056us total) trans 21474843547 rc 0/0 00000100:00100000:0.0:1786562529.571213:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17474 00000100:00100000:0.0:1786562529.571225:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17475 00000100:00100000:0.0:1786562529.571234:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1873345654832000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562529.571311:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562529.571316:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.571318:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.571320:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.571322:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:0.0:1786562529.571358:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1873345654832000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (6179us total) trans 21474843548 rc 0/0 00000100:00100000:0.0:1786562529.571364:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17475 00000004:00080000:0.0:1786562529.571471:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebce00/2, rc 0, transno 21474843547 00000100:00100000:0.0:1786562529.571478:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654831488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562529.571489:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebd500/2, rc 0, transno 21474843548 00000100:00100000:0.0:1786562529.571493:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654832000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562529.571502:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebc000/2, rc 0, transno 21474843545 00000100:00100000:0.0:1786562529.571505:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654831360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562529.571513:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebf480/2, rc 0, transno 21474843546 00000100:00100000:0.0:1786562529.571517:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654831872:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.581666:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5d180/2, rc 0, transno 17179876023 00000100:00100000:3.0:1786562529.581682:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654830464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.581698:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebed80/2, rc 0, transno 21474843543 00000100:00100000:3.0:1786562529.581703:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654831232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.581712:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebf100/2, rc 0, transno 21474843544 00000100:00100000:3.0:1786562529.581715:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654831744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.581726:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5c380/2, rc 0, transno 17179876021 00000100:00100000:3.0:1786562529.581729:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654830336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562529.584796:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:0.0:1786562529.584898:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562529.584903:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.584905:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.584907:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.584909:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:0.0:1786562529.584973:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3289:x1873345654830848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 15873us (20430us total) trans 17179876022 rc 0/0 00000100:00100000:0.0:1786562529.584987:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17465 00000100:00100000:3.0:1786562529.585493:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652709376 00000100:00100000:3.0:1786562529.585502:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652709376 00000100:00100000:3.0:1786562529.585559:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6235 00000100:00100000:3.0:1786562529.585569:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63990:x1873345652709376:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:3.0:1786562529.585696:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63990:x1873345652709376:12345-192.168.204.29@tcp:49:cat.0 Request processed in 128us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562529.585703:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6235 00000004:00080000:3.0:1786562529.585815:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88ac87b80/2, rc 0, transno 17179876022 00000100:00100000:3.0:1786562529.585823:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654830848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.586321:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654830976:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562529.586335:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654831104:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562529.586373:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e3ea lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 505 pid: 35929 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.586403:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 504 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.586437:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881e00, rc 0) 00000100:00100000:1.0:1786562529.586479:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+504:63985:x1873345652708224:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 218811us (221182us total) trans 8589950568 rc 0/0 00000100:00100000:1.0:1786562529.586486:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17031 00002000:00010000:2.0:1786562529.590841:0:28862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562529.590851:0:28862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:2.0:1786562529.590853:0:28862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:2.0:1786562529.590856:0:28862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:2.0:1786562529.590858:0:28862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1786562529.590956:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3289:x1873345654829952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 21002us (26090us total) trans 17179876024 rc 0/0 00000100:00100000:2.0:1786562529.590968:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17468 00000004:00080000:3.0:1786562529.595344:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf5c000/2, rc 0, transno 17179876024 00000100:00100000:3.0:1786562529.595360:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654829952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562529.596281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.596394:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652709504 00000100:00100000:1.0:1786562529.596404:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652709504 00000100:00100000:1.0:1786562529.596471:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6236 00000100:00100000:1.0:1786562529.596482:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+504:63989:x1873345652709504:12345-192.168.204.29@tcp:49:cat.0 00000100:00100000:1.0:1786562529.596625:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+504:63989:x1873345652709504:12345-192.168.204.29@tcp:49:cat.0 Request processed in 145us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.596634:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6236 00000100:00100000:3.0:1786562529.622977:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.623402:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652709760 00000100:00100000:1.0:1786562529.623423:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652709760 00000100:00100000:1.0:1786562529.623482:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17034 00000100:00100000:1.0:1786562529.623493:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63987:x1873345652709760:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562529.623513:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.623517:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562529.623543:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689e3f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc554 expref: 7 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.623825:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.623831:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562529.623854:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e406 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc562 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.623914:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.623933:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 503 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.623941:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 503 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.623948:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 5/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.623993:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 503 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.624109:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 503 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.624124:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654832256:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562529.624247:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 503 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.624255:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 503 pid: 35929 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.624279:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654832384:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562529.624311:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562529.629341:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.630101:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652709888 00000100:00100000:0.0:1786562529.630114:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652709888 00002000:00100000:0.0:1786562529.630163:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88ac86d80 x1873345652709888/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562529.630174:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac86d80 with x1873345652709888 ext(0->1048575) 00002000:00010000:0.0:1786562529.630179:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88ac86d80 00000100:00100000:0.0:1786562529.630217:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11368 00000100:00100000:0.0:1786562529.630227:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652709888:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562529.644624:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.644649:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.645749:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654832256:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562529.645764:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654832384:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562529.645790:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.651886:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710016 00000100:00100000:2.0:1786562529.651900:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710016 00010000:00010000:2.0:1786562529.651950:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 504 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.651994:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710144 00000100:00100000:2.0:1786562529.651998:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710144 00010000:00010000:2.0:1786562529.652045:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 505 pid: 35929 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.652071:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8512 00000100:00100000:2.0:1786562529.652081:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+505:2350:x1873345652710016:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.652097:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.652113:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652127:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652150:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689e3ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc55b expref: 505 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652169:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.652175:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652188:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652196:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.652257:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+504:2350:x1873345652710016:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 177us (7644us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.652265:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8512 00000100:00100000:2.0:1786562529.652285:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8513 00000100:00100000:2.0:1786562529.652291:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+503:2350:x1873345652710144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.652299:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.652303:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 503 pid: 35929 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652312:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 503 pid: 35929 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652325:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e3f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc546 expref: 503 pid: 35929 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652335:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.652339:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652346:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652352:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652380:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562529.652399:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+502:2350:x1873345652710144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 108us (7749us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.652406:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8513 00010000:00010000:2.0:1786562529.652550:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.652558:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562529.672042:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4379, 88 off355600 00000004:00080000:0.0:1786562529.672059:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962114053312ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.672308:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4356, 88 off353400 00000004:00080000:0.0:1786562529.672314:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962114308718ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.672350:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4357, 88 off353488 00000004:00080000:0.0:1786562529.672355:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962114349452ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.672373:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4380, 88 off355688 00000004:00080000:0.0:1786562529.672378:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962114372066ns, next at 911624567946ns, rc = 0 00000100:00100000:3.0:1786562529.678491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.678559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.678912:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710400 00000100:00100000:2.0:1786562529.678921:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710400 00000100:00100000:2.0:1786562529.678985:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17035 00000100:00100000:2.0:1786562529.678996:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:63991:x1873345652710400:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562529.679044:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562529.679066:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc569 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.679168:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.679181:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.679205:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.679222:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.679242:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.679249:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680065:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680081:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 501 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680088:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680094:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680112:0:33115:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680139:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 501 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.680152:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 501 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.680166:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654832512:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562529.681402:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b300 going to sleep for 11 seconds 00000100:00100000:1.0:1786562529.682316:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710272 00000100:00100000:1.0:1786562529.682328:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710272 00002000:00100000:1.0:1786562529.682380:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88ac84000 x1873345652710272/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562529.682391:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84000 with x1873345652710272 ext(0->1048575) 00002000:00010000:1.0:1786562529.682395:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88ac84000 00000100:00100000:1.0:1786562529.682436:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11369 00000100:00100000:1.0:1786562529.682446:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652710272:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562529.687559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.691627:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710528 00000100:00100000:1.0:1786562529.691642:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710528 00010000:00010000:1.0:1786562529.691700:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 502 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.691749:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8514 00000100:00100000:1.0:1786562529.691759:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+502:2348:x1873345652710528:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562529.691772:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562529.691779:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 502 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.691791:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 502 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.691819:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.691825:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.691834:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.691840:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.691846:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562529.691915:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+502:2348:x1873345652710528:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 157us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.691923:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8514 00010000:00010000:1.0:1786562529.691980:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e37a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc51c expref: 501 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.691999:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654832512:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562529.692060:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562529.695194:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4381, 88 off355776 00000004:00080000:0.0:1786562529.695209:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137203173ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695236:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4358, 88 off353576 00000004:00080000:0.0:1786562529.695240:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962137234749ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.695275:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4359, 88 off353664 00000004:00080000:0.0:1786562529.695280:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962137274228ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.695297:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4360, 88 off353752 00000004:00080000:0.0:1786562529.695301:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962137294916ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.695316:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4382, 88 off355864 00000004:00080000:0.0:1786562529.695320:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137313913ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695333:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4361, 88 off353840 00000004:00080000:0.0:1786562529.695337:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962137330951ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.695351:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4383, 88 off355952 00000004:00080000:0.0:1786562529.695354:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137348488ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695368:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4362, 88 off353928 00000004:00080000:0.0:1786562529.695371:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962137365732ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562529.695386:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4384, 88 off356040 00000004:00080000:0.0:1786562529.695389:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137383676ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695403:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4385, 88 off356128 00000004:00080000:0.0:1786562529.695406:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137400699ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695433:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4386, 88 off356216 00000004:00080000:0.0:1786562529.695437:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137431299ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695453:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4387, 88 off356304 00000004:00080000:0.0:1786562529.695457:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 962137450906ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562529.695471:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4363, 88 off354016 00000004:00080000:0.0:1786562529.695475:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962137469389ns, next at 911624464511ns, rc = 0 00000100:00100000:2.0:1786562529.724494:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652709888:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 94257us (95152us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562529.724508:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11368 00002000:00100000:2.0:1786562529.724522:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88ac86d80 x1873345652709888/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/440 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562529.724534:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac86d80 with x1873345652709888 ext(0->1048575) 00002000:00010000:2.0:1786562529.724541:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88ac86d80 00000100:00100000:3.0:1786562529.743687:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652710272:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 61219us (65188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562529.743708:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11369 00002000:00100000:3.0:1786562529.743721:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88ac84000 x1873345652710272/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:0/0 lens 488/440 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562529.743739:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84000 with x1873345652710272 ext(0->1048575) 00002000:00010000:3.0:1786562529.743746:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88ac84000 00000100:00100000:0.0:1786562529.770584:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.770636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.770680:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710656 00000100:00100000:0.0:1786562529.770696:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710656 00000100:00100000:0.0:1786562529.770745:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710784 00000100:00100000:0.0:1786562529.770749:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710784 00000100:00100000:0.0:1786562529.770771:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17476 00000100:00100000:0.0:1786562529.770780:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:63990:x1873345652710656:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562529.770797:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562529.770814:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc570 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.770847:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.770857:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562529.770862:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562529.770868:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.770903:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.770917:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 17 pid: 6660 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.770947:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654832640:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562529.771056:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562529.771077:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17477 00000100:00100000:0.0:1786562529.771086:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+12:63989:x1873345652710784:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562529.771095:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562529.771116:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc577 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.771132:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562529.771138:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 13 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.771149:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 13 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.771163:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:0.0:1786562529.771190:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+13:63989:x1873345652710784:12345-192.168.204.29@tcp:101:cat.0 Request processed in 106us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562529.771209:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17477 00000100:00080000:1.0:1786562529.773347:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562529.790928:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654832640:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562529.790968:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.790997:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:1.0:1786562529.791095:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63990:x1873345652710656:12345-192.168.204.29@tcp:101:cat.0 Request processed in 20315us (20518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.791981:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17476 00000100:00100000:0.0:1786562529.794831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.794894:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.795155:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652710912 00000100:00100000:2.0:1786562529.795165:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652710912 00000100:00100000:2.0:1786562529.795221:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17478 00000100:00100000:2.0:1786562529.795231:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+24:63985:x1873345652710912:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562529.795249:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562529.795267:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc57e expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.795297:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.795306:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.795313:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=1s v=(2 0) 00010000:00010000:2.0:1786562529.795317:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562529.795322:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [978944->995327] (req 978944->995327) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 25 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.795359:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.795370:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 5 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.795383:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654832768:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562529.796786:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.796806:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.796822:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654832896:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562529.796872:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f180 going to sleep for 11 seconds 00000100:00100000:2.0:1786562529.796899:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711040 00000100:00100000:2.0:1786562529.796906:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711040 00010000:00010000:2.0:1786562529.796937:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 18 pid: 6660 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.796972:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8515 00000100:00100000:2.0:1786562529.796981:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652711040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562529.796993:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562529.797040:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 18 pid: 6660 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797056:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 18 pid: 6660 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797080:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e21cfb95/0x5c655bf66689e31f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4eb expref: 18 pid: 6660 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797097:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562529.797101:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562529.797124:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797133:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797150:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562529.797153:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562529.797159:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797167:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.797224:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 12 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.797235:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654833024:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562529.797278:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562529.797288:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654833152:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562529.797310:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562529.829160:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.829187:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562529.832069:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.832087:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562529.832090:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1786562529.832094:0:33140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x40 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.832116:0:33140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.832128:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.832176:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e406 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 9 pid: 33140 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.832206:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.832243:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1000, rc 0) 00000100:00100000:0.0:1786562529.832310:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63987:x1873345652709760:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 208817us (209341us total) trans 8589950569 rc 0/0 00000100:00100000:0.0:1786562529.832321:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17034 00000100:00100000:0.0:1786562529.832352:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711296 00000100:00100000:0.0:1786562529.832361:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711296 00010000:00010000:2.0:1786562529.833385:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833397:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562529.833447:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:2.0:1786562529.833452:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562529.833484:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833497:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833508:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833515:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833522:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833532:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562529.833536:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833544:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833567:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562529.833570:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562529.833574:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833579:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689e41b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833593:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833599:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833614:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833619:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562529.833622:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833628:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833640:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d500) 00010000:00010000:2.0:1786562529.833642:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562529.833645:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833651:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689e422 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833697:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 8 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833709:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 7 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562529.833716:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562529.833718:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562529.833721:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880e00, rc 0) 00000100:00100000:2.0:1786562529.833761:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63991:x1873345652710400:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 154768us (155201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562529.833768:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17035 00000100:00100000:2.0:1786562529.833790:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711424 00000100:00100000:2.0:1786562529.833796:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711424 00000100:00100000:1.0:1786562529.834869:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17036 00000100:00100000:1.0:1786562529.834887:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+501:63989:x1873345652711296:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.834910:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.834928:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc585 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.834976:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 502 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.834988:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 502 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.835018:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.835022:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562529.835024:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557e00, rc 0) 00000100:00100000:1.0:1786562529.835058:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+502:63989:x1873345652711296:12345-192.168.204.29@tcp:101:cat.0 Request processed in 178us (5907us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.835064:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17036 00000100:00100000:1.0:1786562529.835083:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17037 00000100:00100000:1.0:1786562529.835090:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63990:x1873345652711424:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562529.835099:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562529.839226:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc58c expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.839321:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.839338:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.839370:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562529.839373:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562529.839377:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557600, rc 0) 00000100:00100000:1.0:1786562529.839450:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63990:x1873345652711424:12345-192.168.204.29@tcp:101:cat.0 Request processed in 4359us (10260us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.839460:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17037 00000100:00100000:1.0:1786562529.841861:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654833024:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562529.841876:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654833152:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562529.841902:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562529.841966:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652711040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 44985us (47070us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.841977:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8515 00000001:00080000:3.0:1786562529.842310:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950569 is committed 00000004:00080000:3.0:1786562529.842318:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2871 committed 00000004:00080000:3.0:1786562529.842331:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2897 committed 00000004:00080000:3.0:1786562529.842337:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2896 committed 00000004:00080000:3.0:1786562529.842340:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2895 committed 00000004:00080000:3.0:1786562529.842342:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2894 committed 00000004:00080000:3.0:1786562529.842344:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2870 committed 00000004:00080000:3.0:1786562529.842346:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2893 committed 00000004:00080000:3.0:1786562529.842348:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2869 committed 00000004:00080000:3.0:1786562529.842351:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2892 committed 00000004:00080000:3.0:1786562529.842352:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2868 committed 00000004:00080000:3.0:1786562529.842355:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2867 committed 00000004:00080000:3.0:1786562529.842356:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2866 committed 00000004:00080000:3.0:1786562529.842359:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2891 committed 00000004:00080000:3.0:1786562529.842361:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2890 committed 00000004:00080000:3.0:1786562529.842364:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2865 committed 00000004:00080000:3.0:1786562529.842366:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2864 committed 00000004:00080000:3.0:1786562529.842369:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2889 committed 00000100:00100000:3.0:1786562529.842589:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654833664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.842652:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843052:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654834176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843076:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843100:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786562529.843116:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654833280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843136:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843151:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654833792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843167:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843191:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654833408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843212:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843229:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654833920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843247:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843265:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786562529.843270:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654833536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843291:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843311:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.843328:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.843371:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654833664 00000100:00100000:3.0:1786562529.843376:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654833664 00000100:00100000:3.0:1786562529.843425:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834176 00000100:00100000:3.0:1786562529.843428:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834176 00000100:00100000:3.0:1786562529.843444:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654833280 00000100:00100000:3.0:1786562529.843446:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654833280 00000100:00100000:0.0:1786562529.844324:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654832768:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562529.844341:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654832896:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562529.844374:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [978944->995327] (req 978944->995327) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 25 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.844396:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:0.0:1786562529.844448:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+25:63985:x1873345652710912:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 49218us (49627us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562529.844457:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17478 00000100:00100000:0.0:1786562529.844487:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654833792 00000100:00100000:0.0:1786562529.844492:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654833792 00000100:00100000:0.0:1786562529.844520:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654833408 00000100:00100000:0.0:1786562529.844523:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654833408 00000100:00100000:0.0:1786562529.844537:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654833920 00000100:00100000:0.0:1786562529.844539:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654833920 00000100:00100000:0.0:1786562529.844558:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654833536 00000100:00100000:0.0:1786562529.844561:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654833536 00000100:00100000:0.0:1786562529.844572:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834048 00000100:00100000:0.0:1786562529.844574:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834048 00000100:00100000:0.0:1786562529.844585:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17479 00000100:00100000:0.0:1786562529.844592:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654833664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.845286:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562529.845291:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.845293:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.845295:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.845297:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562529.845346:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654833664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 753us (2694us total) trans 17179876025 rc 0/0 00000100:00100000:0.0:1786562529.845354:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17479 00000100:00100000:0.0:1786562529.845370:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17480 00000100:00100000:0.0:1786562529.845377:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3289:x1873345654834176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.845989:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17481 00000100:00100000:3.0:1786562529.846000:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654833280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562529.846884:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.846960:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:0.0:1786562529.847054:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1786562529.847058:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.847060:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.847063:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.847065:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562529.847796:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3289:x1873345654834176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2416us (4714us total) trans 17179876026 rc 0/0 00000100:00100000:0.0:1786562529.847812:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17480 00000100:00100000:0.0:1786562529.847840:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17482 00000100:00100000:0.0:1786562529.847851:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654833792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562529.847877:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17483 00000100:00100000:0.0:1786562529.847884:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654833408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562529.847898:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711168 00000100:00100000:0.0:1786562529.847905:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711168 00010000:00010000:0.0:1786562529.847935:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 6 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.847959:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711552 00000100:00100000:0.0:1786562529.847962:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711552 00010000:00010000:0.0:1786562529.847974:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.847996:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8516 00000100:00100000:0.0:1786562529.848002:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2350:x1873345652711168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562529.848031:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562529.848046:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 6 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.848058:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 6 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.848082:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e3c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc53f expref: 6 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.848099:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562529.848563:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8517 00000100:00100000:1.0:1786562529.848573:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652711552:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562529.848582:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562529.848594:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.848616:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.848632:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e3b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc538 expref: 25 pid: 28862 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.848643:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562529.848647:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562529.848655:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 24 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562529.848912:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 24 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.849127:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2350:x1873345652711168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1124us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562529.849134:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8516 00000100:00100000:0.0:1786562529.849167:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17484 00000100:00100000:0.0:1786562529.849175:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654833920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.849328:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.849332:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.849334:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.849337:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.849339:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562529.849386:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654833920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (6137us total) trans 17179876028 rc 0/0 00000100:00100000:0.0:1786562529.849393:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17484 00000100:00100000:0.0:1786562529.849416:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17485 00000100:00100000:0.0:1786562529.849424:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654833536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.850051:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:0.0:1786562529.850055:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.850057:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.850059:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:0.0:1786562529.850061:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:0.0:1786562529.850092:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654833536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 668us (6798us total) trans 17179876029 rc 0/0 00000100:00100000:0.0:1786562529.850098:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17485 00000100:00100000:0.0:1786562529.850114:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17486 00000100:00100000:0.0:1786562529.850122:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3291:x1873345654834048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.850204:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.850207:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.850209:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.850211:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562529.850214:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562529.850239:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654834048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (6909us total) trans 17179876030 rc 0/0 00000100:00100000:0.0:1786562529.850246:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17486 00000100:00100000:2.0:1786562529.851262:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654834304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562529.851309:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562529.851345:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654834816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562529.851366:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562529.851384:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786562529.851391:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654834688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562529.851421:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562529.851437:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654835200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562529.851457:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562529.851494:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834304 00000100:00100000:2.0:1786562529.851501:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834304 00000100:00100000:2.0:1786562529.851534:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834816 00000100:00100000:2.0:1786562529.851537:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834816 00000100:00100000:2.0:1786562529.851803:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834688 00000100:00100000:2.0:1786562529.851808:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834688 00000100:00100000:2.0:1786562529.851827:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654835200 00000100:00100000:2.0:1786562529.851829:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654835200 00000100:00100000:2.0:1786562529.851846:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17487 00000100:00100000:2.0:1786562529.851853:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3290:x1873345654834304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.852027:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562529.852031:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:2.0:1786562529.852033:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:2.0:1786562529.852035:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:2.0:1786562529.852038:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1786562529.852077:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3290:x1873345654834304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 224us (767us total) trans 21474843549 rc 0/0 00000100:00100000:2.0:1786562529.852084:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17487 00000100:00100000:2.0:1786562529.852099:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17488 00000100:00100000:2.0:1786562529.852105:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3290:x1873345654834816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.852176:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1786562529.852179:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.852181:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562529.852183:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.852185:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562529.852209:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3290:x1873345654834816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (842us total) trans 21474843550 rc 0/0 00000100:00100000:2.0:1786562529.852215:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17488 00000100:00100000:2.0:1786562529.852227:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17489 00000100:00100000:2.0:1786562529.852233:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3290:x1873345654834688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.852304:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562529.852308:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.852309:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562529.852311:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:2.0:1786562529.852314:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562529.853871:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3290:x1873345654834688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1632us (2442us total) trans 21474843551 rc 0/0 00000100:00100000:2.0:1786562529.853884:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17489 00000100:00100000:2.0:1786562529.853914:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17490 00000100:00100000:2.0:1786562529.853928:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3290:x1873345654835200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562529.854120:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1786562529.854124:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:2.0:1786562529.854126:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562529.854128:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:2.0:1786562529.854130:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1786562529.854176:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3290:x1873345654835200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (2717us total) trans 21474843552 rc 0/0 00000100:00100000:2.0:1786562529.854182:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17490 00000004:00080000:2.0:1786562529.854271:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11ed80/2, rc 0, transno 21474843551 00000100:00100000:2.0:1786562529.854279:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654834688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1786562529.854288:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11c700/2, rc 0, transno 21474843552 00000100:00100000:2.0:1786562529.854292:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654835200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1786562529.854301:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11dc00/2, rc 0, transno 21474843549 00000100:00100000:2.0:1786562529.854304:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654834304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1786562529.854311:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11d500/2, rc 0, transno 21474843550 00000100:00100000:2.0:1786562529.854314:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654834816:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562529.856943:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1786562529.856952:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.856954:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.856957:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:3.0:1786562529.856959:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562529.857067:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3289:x1873345654833280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 11066us (13925us total) trans 17179876027 rc 0/0 00000100:00100000:3.0:1786562529.857080:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17481 00000004:00080000:3.0:1786562529.857157:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88ac84a80/2, rc 0, transno 17179876027 00000100:00100000:3.0:1786562529.857175:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654833280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.857189:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88be21880/2, rc 0, transno 17179876025 00000100:00100000:3.0:1786562529.857193:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654833664:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.857202:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88be21c00/2, rc 0, transno 17179876026 00000100:00100000:3.0:1786562529.857205:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654834176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.857234:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.857269:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.857299:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.857321:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786562529.857365:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88be22300/2, rc 0, transno 17179876029 00000100:00100000:3.0:1786562529.857370:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654833536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.857380:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88be23100/2, rc 0, transno 17179876030 00000100:00100000:3.0:1786562529.857383:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.857392:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88be20e00/2, rc 0, transno 17179876028 00000100:00100000:3.0:1786562529.857397:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654833920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562529.857418:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786562529.857425:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.857447:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.857477:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654835072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562529.857498:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.857528:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834432 00000100:00100000:3.0:1786562529.857535:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834432 00000100:00100000:3.0:1786562529.857582:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834944 00000100:00100000:3.0:1786562529.857586:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834944 00000100:00100000:3.0:1786562529.857601:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654834560 00000100:00100000:3.0:1786562529.857617:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654834560 00000100:00100000:3.0:1786562529.857635:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654835072 00000100:00100000:3.0:1786562529.857638:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654835072 00000100:00100000:3.0:1786562529.857660:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17491 00000100:00100000:3.0:1786562529.857925:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3291:x1873345654834432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562529.858162:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562529.858165:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.858167:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.858169:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:3.0:1786562529.858171:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562529.858205:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3291:x1873345654834432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (935us total) trans 21474843553 rc 0/0 00000100:00100000:3.0:1786562529.858212:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17491 00000100:00100000:3.0:1786562529.858226:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17492 00000100:00100000:3.0:1786562529.858232:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3291:x1873345654834944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562529.858304:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562529.858308:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:3.0:1786562529.858310:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.858312:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:3.0:1786562529.858314:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562529.858336:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3291:x1873345654834944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (1014us total) trans 21474843554 rc 0/0 00000100:00100000:3.0:1786562529.858342:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17492 00000100:00100000:3.0:1786562529.858354:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17493 00000100:00100000:3.0:1786562529.858359:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3291:x1873345654834560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562529.858444:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562529.858448:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.858450:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:3.0:1786562529.858451:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:3.0:1786562529.858453:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562529.860244:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654835328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562529.860299:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562529.860931:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3291:x1873345654834560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2568us (3479us total) trans 21474843555 rc 0/0 00000100:00100000:3.0:1786562529.860942:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17493 00000100:00100000:3.0:1786562529.860968:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654835328 00000100:00100000:3.0:1786562529.860975:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654835328 00000100:00100000:3.0:1786562529.861042:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17494 00000100:00100000:3.0:1786562529.861051:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3291:x1873345654835072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562529.861247:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562529.861251:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.861253:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.861256:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.861258:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:3.0:1786562529.861292:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3291:x1873345654835072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (3793us total) trans 21474843556 rc 0/0 00000100:00100000:3.0:1786562529.861298:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17494 00000100:00100000:3.0:1786562529.861312:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17495 00000100:00100000:3.0:1786562529.861319:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3290:x1873345654835328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562529.863460:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562529.863626:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.863629:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562529.863631:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562529.863634:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562529.863816:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3289:x1873345654833792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 15964us (20643us total) trans 17179876031 rc 0/0 00000100:00100000:0.0:1786562529.863827:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17482 00002000:00010000:0.0:1786562529.863939:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562529.863942:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.863945:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562525 -> 1786562525 00002000:00010000:0.0:1786562529.863947:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562528 -> 1786562528 00002000:00010000:0.0:1786562529.863949:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1786562529.863975:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3291:x1873345654833408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 16092us (20762us total) trans 17179876032 rc 0/0 00000100:00100000:0.0:1786562529.863982:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17483 00002000:00010000:3.0:1786562529.866137:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562529.866145:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.866147:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562529.866149:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562529.866151:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562529.866212:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3290:x1873345654835328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4891us (5910us total) trans 17179876033 rc 0/0 00000100:00100000:3.0:1786562529.866222:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17495 00000004:00080000:3.0:1786562529.866276:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11d880/2, rc 0, transno 21474843555 00000100:00100000:3.0:1786562529.866283:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834560:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.866294:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11fb80/2, rc 0, transno 21474843556 00000100:00100000:3.0:1786562529.866298:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654835072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.866306:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11ca80/2, rc 0, transno 21474843553 00000100:00100000:3.0:1786562529.866309:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834432:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.866317:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11c000/2, rc 0, transno 21474843554 00000100:00100000:3.0:1786562529.866320:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654834944:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562529.866331:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88ac84380/2, rc 0, transno 17179876032 00000100:00100000:3.0:1786562529.866334:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654833408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562529.866360:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88be20700/2, rc 0, transno 17179876031 00000100:00100000:3.0:1786562529.866365:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654833792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1786562529.867242:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fed80/2, rc 0, transno 17179876033 00000100:00100000:2.0:1786562529.867251:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654835328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562529.868195:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.875184:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711680 00000100:00100000:3.0:1786562529.875200:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711680 00000100:00100000:3.0:1786562529.875281:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17038 00000100:00100000:3.0:1786562529.875291:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:63991:x1873345652711680:12345-192.168.204.29@tcp:101:mirror_io.0 00000100:00100000:2.0:1786562529.876135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.877157:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711808 00000100:00100000:0.0:1786562529.877166:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711808 00000100:00100000:0.0:1786562529.877221:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17496 00000100:00100000:0.0:1786562529.877231:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63987:x1873345652711808:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562529.877250:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562529.877269:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc59a expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.877302:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.877312:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562529.877317:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562529.877322:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3526656->4034559] (req 3526656->4034559) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 7 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.877371:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.877386:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 16 pid: 29965 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.877401:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654835456:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562529.877494:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00010000:00010000:1.0:1786562529.878316:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 24 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562529.878343:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654835584:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562529.878399:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00010000:00010000:3.0:1786562529.879046:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562529.879064:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e45a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc593 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.879142:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e45a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc593 expref: 8 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.879157:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e45a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc593 expref: 8 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.879180:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562529.879184:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562529.879188:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fa00, rc 0) 00000100:00100000:3.0:1786562529.879235:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63991:x1873345652711680:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 3946us (11045us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562529.879244:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17038 00000100:00100000:1.0:1786562529.888862:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654835584:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562529.888889:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562529.888946:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652711552:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 40374us (41984us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562529.888957:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8517 00000100:00100000:0.0:1786562529.889057:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654835456:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562529.889082:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3526656->4034559] (req 3526656->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 7 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.889100:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365a00, rc 0) 00000100:00100000:0.0:1786562529.889141:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63987:x1873345652711808:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 11912us (13009us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562529.889149:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17496 00000100:00100000:2.0:1786562529.901096:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562529.901735:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652711936 00000100:00100000:0.0:1786562529.901746:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652711936 00000100:00100000:0.0:1786562529.901807:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17497 00000100:00100000:0.0:1786562529.901818:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652711936:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562529.901836:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562529.901853:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e461 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5a1 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.901909:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654835712:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562529.901995:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562529.942179:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.942223:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.942259:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.942309:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562529.942332:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.942463:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712064 00000100:00100000:3.0:1786562529.942473:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712064 00002000:00100000:3.0:1786562529.942527:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9831fe300 x1873345652712064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562529.942539:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fe300 with x1873345652712064 ext(1048576->2097151) 00002000:00010000:3.0:1786562529.942544:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9831fe300 00000100:00100000:3.0:1786562529.942580:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712192 00000100:00100000:3.0:1786562529.942584:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712192 00002000:00100000:3.0:1786562529.942607:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (978944->983039) req@ffff90e9831ff100 x1873345652712192/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562529.942616:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff100 with x1873345652712192 ext(978944->983039) 00002000:00010000:3.0:1786562529.942620:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831ff100 00000100:00100000:3.0:1786562529.942641:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11370 00000100:00100000:3.0:1786562529.942670:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652712064:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562529.943725:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11371 00000100:00100000:3.0:1786562529.943737:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652712192:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562529.943844:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652712192:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 109us (1620us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562529.943851:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11371 00002000:00100000:3.0:1786562529.943859:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x711:0x0] (978944->983039) req@ffff90e9831ff100 x1873345652712192/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/4536 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562529.943867:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831ff100 with x1873345652712192 ext(978944->983039) 00002000:00010000:3.0:1786562529.943871:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831ff100 00000100:00100000:0.0:1786562529.944364:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712576 00000100:00100000:0.0:1786562529.944370:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712576 00000100:00100000:0.0:1786562529.944420:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712704 00000100:00100000:0.0:1786562529.944424:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712704 00000100:00100000:0.0:1786562529.944447:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17498 00000100:00100000:0.0:1786562529.944454:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652712576:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562529.944467:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562529.944485:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5a8 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944513:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562529.944518:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562529.944527:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 19 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944555:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 19 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944568:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:0.0:1786562529.944597:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2351:x1873345652712576:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 144us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562529.944615:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17498 00000100:00100000:0.0:1786562529.944630:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17499 00000100:00100000:0.0:1786562529.944637:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652712704:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562529.944644:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562529.944653:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e46f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5af expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.944708:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654835840:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562529.944759:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562529.944782:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712320 00000100:00100000:0.0:1786562529.944786:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712320 00010000:00010000:0.0:1786562529.944803:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 20 pid: 29965 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.944835:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8518 00000100:00100000:0.0:1786562529.944842:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:2348:x1873345652712320:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562529.944854:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562529.944872:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 20 pid: 29965 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944883:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 20 pid: 29965 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944901:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562529.944904:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562529.944909:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944918:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.944942:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.944952:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654835968:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562529.944976:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224540 going to sleep for 11 seconds 00002000:00010000:0.0:1786562529.945055:0:29963:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime: 1786562525 -> 1786562529 00002000:00010000:0.0:1786562529.945059:0:29963:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime: 1786562525 -> 1786562529 00002000:00010000:0.0:1786562529.945061:0:29963:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime: 1786562528 -> 1786562529 00000100:00100000:0.0:1786562529.945072:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654835712:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562529.945096:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e461 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a1 expref: 18 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.945124:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e461 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a1 expref: 18 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.945134:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365200, rc 0) 00000100:00100000:0.0:1786562529.945155:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652711936:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 43341us (44072us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562529.945161:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17497 00000100:00100000:1.0:1786562529.975852:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562529.976071:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562529.976167:0:29967:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.29@tcp) returned -22 from glimpse AST (req@00000000f3f3665b x1873345654835840) - normal race ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 20 pid: 29965 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.976210:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e33b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc507 expref: 20 pid: 29965 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562529.976226:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654835840:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562529.976262:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e46f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5af expref: 19 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.976281:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e46f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5af expref: 19 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562529.976290:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364200, rc 0) 00000100:00100000:0.0:1786562529.976357:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652712704:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 31720us (34023us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562529.976365:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17499 00000100:00100000:3.0:1786562529.977670:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654835968:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562529.977695:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562529.977740:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652712320:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 32898us (35479us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562529.977751:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8518 00000100:00100000:3.0:1786562529.987578:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.987621:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652713088 00000100:00100000:3.0:1786562529.987630:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652713088 00000100:00100000:3.0:1786562529.987695:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17039 00000100:00100000:3.0:1786562529.987705:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63991:x1873345652713088:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562529.987727:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562529.987747:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5b6 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.987849:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.987864:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.987874:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.987909:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562529.987923:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 9 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562529.987936:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654836096:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562529.988041:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562529.995586:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562529.995769:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652712064:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 53118us (53597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562529.995781:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11370 00002000:00100000:3.0:1786562529.995795:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9831fe300 x1873345652712064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:0/0 lens 488/440 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562529.995804:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fe300 with x1873345652712064 ext(1048576->2097151) 00002000:00010000:3.0:1786562529.995811:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9831fe300 00000100:00100000:2.0:1786562530.001671:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712448 00000100:00100000:2.0:1786562530.001688:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712448 00002000:00100000:2.0:1786562530.001755:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88b7efb80 x1873345652712448/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.001767:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7efb80 with x1873345652712448 ext(1048576->2097151) 00002000:00010000:2.0:1786562530.001773:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7efb80 00000100:00100000:2.0:1786562530.001818:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652712832 00000100:00100000:2.0:1786562530.001822:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652712832 00002000:00100000:2.0:1786562530.001839:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (3526656->3530751) req@ffff90e88bf07800 x1873345652712832/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.001848:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07800 with x1873345652712832 ext(3526656->3530751) 00002000:00010000:2.0:1786562530.001851:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf07800 00000100:00100000:2.0:1786562530.001871:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11372 00000100:00100000:2.0:1786562530.001880:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+13:2349:x1873345652712448:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562530.002577:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11373 00000100:00100000:2.0:1786562530.002586:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652712832:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562530.002955:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652712832:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 369us (26884us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562530.002963:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11373 00002000:00100000:2.0:1786562530.002970:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3526656->3530751) req@ffff90e88bf07800 x1873345652712832/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:0/0 lens 488/4536 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.002979:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07800 with x1873345652712832 ext(3526656->3530751) 00002000:00010000:2.0:1786562530.002983:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf07800 00000100:00100000:1.0:1786562530.009343:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652713216 00000100:00100000:1.0:1786562530.009357:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652713216 00002000:00100000:1.0:1786562530.009428:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x711:0x0] (991232->995327) req@ffff90e88bf06a00 x1873345652713216/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/0 e 0 to 0 dl 1786562540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.009441:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf06a00 with x1873345652713216 ext(991232->995327) 00002000:00010000:1.0:1786562530.009448:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf06a00 00000100:00100000:1.0:1786562530.009496:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11374 00000100:00100000:1.0:1786562530.009508:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652713216:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562530.009922:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652713216:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 415us (14343us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562530.009930:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11374 00002000:00100000:1.0:1786562530.009938:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x711:0x0] (991232->995327) req@ffff90e88bf06a00 x1873345652713216/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/4536 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.009946:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf06a00 with x1873345652713216 ext(991232->995327) 00002000:00010000:1.0:1786562530.009949:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf06a00 00000100:00100000:1.0:1786562530.010092:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.010141:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652713344 00000100:00100000:1.0:1786562530.010145:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652713344 00010000:00010000:1.0:1786562530.010176:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 10 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.010304:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8519 00000100:00100000:1.0:1786562530.010315:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652713344:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562530.010327:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562530.010334:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 10 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.010347:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 10 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.010369:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.010374:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.010383:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.010390:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.010417:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562530.010441:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652713344:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 130us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562530.010448:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8519 00010000:00010000:3.0:1786562530.011443:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689e429 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc569 expref: 9 pid: 33115 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.011474:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654836096:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562530.011500:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.011509:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.011514:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562530.011534:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562530.011763:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689e476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5b6 expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.011780:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5b6 expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.011787:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562530.011790:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786562530.011804:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e400, rc 0) 00000100:00080000:1.0:1786562530.012990:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562530.013367:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63991:x1873345652713088:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 25657us (25793us total) trans 8589950570 rc 0/0 00000100:00100000:3.0:1786562530.013380:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17039 00010000:00010000:1.0:1786562530.025286:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562530.029429:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+13:2349:x1873345652712448:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 27527us (53564us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562530.029442:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11372 00002000:00100000:3.0:1786562530.029455:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88b7efb80 x1873345652712448/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:0/0 lens 488/440 e 0 to 0 dl 1786562540 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.029475:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7efb80 with x1873345652712448 ext(1048576->2097151) 00002000:00010000:3.0:1786562530.029482:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b7efb80 00000100:00100000:2.0:1786562530.035943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.036757:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652713600 00000100:00100000:1.0:1786562530.036768:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652713600 00000100:00100000:1.0:1786562530.036831:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17040 00000100:00100000:1.0:1786562530.036841:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63991:x1873345652713600:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562530.036866:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.036869:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562530.036896:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e47d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5b6 expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.036915:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.036920:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562530.036932:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689e48b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5bd expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037051:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037064:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037075:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037090:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037097:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037117:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037125:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562530.037131:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037141:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037151:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.037154:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562530.037158:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037165:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e492 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037197:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689e48b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5bd expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037206:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.037209:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562530.037213:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689e48b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5bd expref: 9 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.037223:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0c00, rc 0) 00000100:00100000:1.0:1786562530.037291:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63991:x1873345652713600:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 451us (1356us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562530.037298:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17040 00000100:00100000:2.0:1786562530.041490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.041666:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652713856 00000100:00100000:3.0:1786562530.041681:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652713856 00000100:00100000:3.0:1786562530.041742:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6237 00000100:00100000:3.0:1786562530.041754:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+502:63985:x1873345652713856:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562530.042096:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+503:63985:x1873345652713856:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 344us (616us total) trans 8589950571 rc 0/0 00000100:00100000:3.0:1786562530.042964:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6237 00000100:00100000:2.0:1786562530.057808:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.058656:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652713984 00000100:00100000:0.0:1786562530.058677:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652713984 00000100:00100000:0.0:1786562530.058741:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17500 00000100:00100000:0.0:1786562530.058751:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63990:x1873345652713984:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562530.058769:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.058789:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5c4 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.058821:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.058831:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562530.058836:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562530.058843:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 8 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.058879:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.058894:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 16 pid: 6659 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.058910:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654836224:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562530.059001:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882246c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562530.060941:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.060990:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.061080:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652714240 00000100:00100000:1.0:1786562530.061088:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652714240 00000100:00100000:1.0:1786562530.061154:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6238 00000100:00100000:1.0:1786562530.061164:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:63991:x1873345652714240:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:1.0:1786562530.061472:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63991:x1873345652714240:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 297us (526us total) trans 8589950572 rc 0/0 00000100:00100000:1.0:1786562530.061480:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6238 00000100:00100000:3.0:1786562530.062047:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652714368 00000100:00100000:3.0:1786562530.062053:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652714368 00000100:00100000:3.0:1786562530.062092:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17501 00000100:00100000:3.0:1786562530.062100:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:63989:x1873345652714368:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562530.062121:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562530.062139:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5cb expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.062164:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562530.062174:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 14 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.062187:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 14 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.062210:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:3.0:1786562530.062236:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:63989:x1873345652714368:12345-192.168.204.29@tcp:101:cat.0 Request processed in 137us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562530.062243:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17501 00000100:00100000:0.0:1786562530.078963:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654836224:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562530.079045:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 8 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.079064:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364200, rc 0) 00000100:00100000:0.0:1786562530.079140:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63990:x1873345652713984:12345-192.168.204.29@tcp:101:cat.0 Request processed in 20391us (21342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.079150:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17500 00000100:00100000:0.0:1786562530.080259:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.080368:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652714496 00000100:00100000:3.0:1786562530.080376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652714496 00010000:00010000:3.0:1786562530.080437:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 17 pid: 6659 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.080493:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8520 00000100:00100000:3.0:1786562530.080504:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652714496:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562530.080520:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1786562530.080763:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786562530.080841:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 17 pid: 6659 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080856:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 17 pid: 6659 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080881:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d24a5c/0x5c655bf66689e326 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f2 expref: 17 pid: 6659 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080902:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562530.080906:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562530.080914:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 7 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080923:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 7 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080931:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562530.080934:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562530.080939:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 13 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080945:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 13 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.080982:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 13 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.080998:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654836352:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562530.081295:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 7 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.081306:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654836480:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562530.081331:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562530.096394:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654836352:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562530.096420:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654836480:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562530.096446:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562530.096508:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652714496:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 16006us (16253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562530.096519:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8520 00000100:00100000:2.0:1786562530.127385:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.127753:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.128282:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652714624 00000100:00100000:0.0:1786562530.128294:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652714624 00002000:00100000:0.0:1786562530.128348:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (4030464->4034559) req@ffff90e884339180 x1873345652714624/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.128360:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339180 with x1873345652714624 ext(4030464->4034559) 00002000:00010000:0.0:1786562530.128366:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884339180 00000100:00100000:0.0:1786562530.128397:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652714880 00000100:00100000:0.0:1786562530.128409:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652714880 00002000:00100000:0.0:1786562530.128425:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88433b100 x1873345652714880/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.128432:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433b100 with x1873345652714880 ext(1048576->2097151) 00002000:00010000:0.0:1786562530.128436:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88433b100 00000100:00100000:0.0:1786562530.128457:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11375 00000100:00100000:0.0:1786562530.128466:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652714624:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562530.129072:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652714624:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 603us (1693us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562530.129080:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11375 00002000:00100000:0.0:1786562530.129087:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (4030464->4034559) req@ffff90e884339180 x1873345652714624/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/4536 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.129095:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339180 with x1873345652714624 ext(4030464->4034559) 00002000:00010000:0.0:1786562530.129098:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884339180 00000100:00100000:3.0:1786562530.129312:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11376 00000100:00100000:3.0:1786562530.129325:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652714880:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562530.137970:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.139155:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652714752 00000100:00100000:0.0:1786562530.139166:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652714752 00002000:00100000:0.0:1786562530.139213:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88313d500 x1873345652714752/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.139224:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313d500 with x1873345652714752 ext(1048576->2097151) 00002000:00010000:0.0:1786562530.139231:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313d500 00000100:00100000:0.0:1786562530.139266:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11377 00000100:00100000:0.0:1786562530.139275:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:2348:x1873345652714752:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562530.151122:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.154761:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715136 00000100:00100000:0.0:1786562530.154778:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715136 00000100:00100000:0.0:1786562530.154848:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6239 00000100:00100000:0.0:1786562530.154861:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63987:x1873345652715136:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562530.160158:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63987:x1873345652715136:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 5279us (9040us total) trans 8589950573 rc 0/0 00000100:00100000:0.0:1786562530.160180:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6239 00000100:00100000:3.0:1786562530.197534:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652714880:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 68202us (69769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562530.197549:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11376 00002000:00100000:3.0:1786562530.197561:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88433b100 x1873345652714880/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.197571:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433b100 with x1873345652714880 ext(1048576->2097151) 00002000:00010000:3.0:1786562530.197577:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88433b100 00000100:00100000:0.0:1786562530.197877:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:2348:x1873345652714752:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 58602us (59917us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562530.197886:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11377 00002000:00100000:0.0:1786562530.197893:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88313d500 x1873345652714752/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.197903:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313d500 with x1873345652714752 ext(1048576->2097151) 00002000:00010000:0.0:1786562530.197907:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313d500 00000100:00100000:3.0:1786562530.215133:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.216299:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715264 00000100:00100000:2.0:1786562530.216312:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715264 00000100:00100000:2.0:1786562530.216367:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17502 00000100:00100000:2.0:1786562530.216378:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:63990:x1873345652715264:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562530.216395:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562530.216428:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5d2 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.216473:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.216484:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562530.216488:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562530.216493:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 6 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.216527:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 16 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.216540:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 16 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.216555:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654836608:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562530.216646:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562530.237921:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654836608:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562530.237959:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 6 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.237986:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0548c00, rc 0) 00000100:00100000:2.0:1786562530.238074:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63990:x1873345652715264:12345-192.168.204.29@tcp:101:cat.0 Request processed in 21697us (22950us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.238083:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17502 00000100:00100000:1.0:1786562530.243217:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.243264:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.243360:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715520 00000100:00100000:0.0:1786562530.243371:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715520 00010000:00010000:0.0:1786562530.243439:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 17 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.243482:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8521 00000100:00100000:0.0:1786562530.243492:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652715520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562530.243507:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562530.243530:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 17 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.243545:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 17 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.243568:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caaf091/0x5c655bf66689e32d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4f9 expref: 17 pid: 6658 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.243585:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562530.243590:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562530.243610:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 5 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.243621:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 5 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.243660:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 5 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.243674:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654836736:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562530.243761:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562530.244309:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715392 00000100:00100000:2.0:1786562530.244314:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715392 00000100:00100000:2.0:1786562530.244355:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17503 00000100:00100000:2.0:1786562530.244362:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+24:63989:x1873345652715392:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562530.244376:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562530.244389:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5d9 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.244416:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562530.244420:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562530.244427:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 25 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.244439:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 25 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.244449:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0548e00, rc 0) 00000100:00100000:2.0:1786562530.244485:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+25:63989:x1873345652715392:12345-192.168.204.29@tcp:101:cat.0 Request processed in 123us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.244492:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17503 00000100:00080000:1.0:1786562530.245162:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562530.253715:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654836736:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562530.253743:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562530.253794:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652715520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10303us (10528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.253805:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8521 00000100:00100000:1.0:1786562530.279139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.279216:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715648 00000100:00100000:3.0:1786562530.279226:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715648 00002000:00100000:3.0:1786562530.279286:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf04a80 x1873345652715648/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.279297:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04a80 with x1873345652715648 ext(1048576->2097151) 00002000:00010000:3.0:1786562530.279303:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04a80 00000100:00100000:3.0:1786562530.279335:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11378 00000100:00100000:3.0:1786562530.279345:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652715648:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562530.300202:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.300649:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715776 00000100:00100000:2.0:1786562530.300659:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715776 00002000:00100000:2.0:1786562530.300720:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf04000 x1873345652715776/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.300731:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04000 with x1873345652715776 ext(1048576->2097151) 00002000:00010000:2.0:1786562530.300737:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04000 00000100:00100000:2.0:1786562530.300772:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11379 00000100:00100000:2.0:1786562530.300783:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652715776:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562530.323713:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652715648:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 44358us (44573us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562530.323740:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11378 00002000:00100000:2.0:1786562530.323752:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf04a80 x1873345652715648/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.323763:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04a80 with x1873345652715648 ext(1048576->2097151) 00002000:00010000:2.0:1786562530.323769:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04a80 00000100:00100000:1.0:1786562530.344966:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652715776:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 44175us (44762us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562530.344982:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11379 00002000:00100000:1.0:1786562530.345031:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf04000 x1873345652715776/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.345042:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04000 with x1873345652715776 ext(1048576->2097151) 00002000:00010000:1.0:1786562530.345048:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04000 00000100:00100000:1.0:1786562530.391410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.394098:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.402922:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.407687:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716288 00000100:00100000:0.0:1786562530.407703:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716288 00000100:00100000:0.0:1786562530.407770:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17041 00000100:00100000:0.0:1786562530.407781:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+503:63996:x1873345652716288:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562530.407810:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.407832:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e4b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5ee expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.407925:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.407949:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.407960:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.407974:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.407980:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.407987:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408439:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408449:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408458:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562530.408468:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562530.408569:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408578:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408584:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408591:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562530.408595:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408602:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408613:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562530.408615:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562530.408620:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408626:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e4bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408638:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408644:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408650:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408654:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562530.408657:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408663:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408674:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562530.408676:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562530.408679:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408685:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e4c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408722:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 506 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408735:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 505 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.408743:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562530.408745:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562530.408747:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:0.0:1786562530.408811:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+505:63996:x1873345652716288:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1032us (5898us total) trans 8589950574 rc 0/0 00000100:00100000:0.0:1786562530.408818:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17041 00000100:00100000:2.0:1786562530.414822:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652715904 00000100:00100000:2.0:1786562530.414837:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652715904 00000100:00100000:3.0:1786562530.415811:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716032 00000100:00100000:3.0:1786562530.415819:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716032 00000100:00100000:3.0:1786562530.416066:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17504 00000100:00100000:3.0:1786562530.416079:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+25:63989:x1873345652715904:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562530.416099:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562530.416118:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5e0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.416152:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 15 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.416163:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786562530.416167:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562530.416174:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 26 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.416212:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 15 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.416226:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 15 pid: 29967 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.416246:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654836864:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562530.416330:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562530.423545:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17505 00000100:00100000:1.0:1786562530.423576:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:63990:x1873345652716032:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562530.423607:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.423628:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5e7 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.423673:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562530.423893:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 7 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.423909:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 7 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.423924:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb38e200, rc 0) 00000100:00100000:1.0:1786562530.424185:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63990:x1873345652716032:12345-192.168.204.29@tcp:101:cat.0 Request processed in 624us (30093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562530.424194:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17505 00000100:00100000:3.0:1786562530.433269:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.433825:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654836864:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562530.433862:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 26 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.433894:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f0c00, rc 0) 00000100:00100000:2.0:1786562530.433953:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716416 00000100:00100000:2.0:1786562530.433962:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716416 00000100:00100000:0.0:1786562530.433967:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+26:63989:x1873345652715904:12345-192.168.204.29@tcp:101:cat.0 Request processed in 17889us (42971us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.433978:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17504 00010000:00010000:2.0:1786562530.434001:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 16 pid: 29967 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.434065:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8522 00000100:00100000:2.0:1786562530.434076:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652716416:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.434091:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.434115:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 16 pid: 29967 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434129:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 16 pid: 29967 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434151:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc500 expref: 16 pid: 29967 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434164:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562530.434169:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562530.434178:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434187:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434196:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562530.434199:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562530.434204:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 6 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434212:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 6 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.434288:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 6 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.434303:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654836992:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562530.434375:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.434386:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654837120:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562530.434420:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562530.442770:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654836992:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562530.442788:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654837120:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562530.442813:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.442875:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652716416:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 8800us (9616us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.442886:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8522 00000100:00100000:3.0:1786562530.495879:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.495986:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716544 00000100:00100000:1.0:1786562530.495997:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716544 00000100:00100000:1.0:1786562530.496087:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17042 00000100:00100000:1.0:1786562530.496098:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:63997:x1873345652716544:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562530.496127:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.496148:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e4e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5f5 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496216:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496230:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496242:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496261:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496273:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496280:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496647:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496657:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496665:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562530.496699:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562530.496704:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562530.496723:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496733:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496741:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496748:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496754:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496762:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3fa800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562530.496766:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496772:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496783:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562530.496787:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562530.496790:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496796:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa800/0x5c655bf66689e4ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496809:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496816:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496822:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496826:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af415600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562530.496829:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496835:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496845:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2f00) 00010000:00010000:1.0:1786562530.496847:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562530.496849:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496855:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e4f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496882:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e4e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496894:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.496902:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.496904:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562530.496906:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:1.0:1786562530.496971:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63997:x1873345652716544:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 875us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562530.496980:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17042 00000100:00100000:3.0:1786562530.555851:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.555890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.555917:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.555940:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.555976:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.556003:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716672 00000100:00100000:3.0:1786562530.556037:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716672 00000100:00100000:3.0:1786562530.556080:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716928 00000100:00100000:3.0:1786562530.556082:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716928 00000100:00100000:3.0:1786562530.556095:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717184 00000100:00100000:3.0:1786562530.556097:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717184 00000100:00100000:3.0:1786562530.556109:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652716800 00000100:00100000:3.0:1786562530.556111:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652716800 00000100:00100000:3.0:1786562530.556121:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717056 00000100:00100000:3.0:1786562530.556123:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717056 00000100:00100000:3.0:1786562530.556139:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17506 00000100:00100000:3.0:1786562530.556147:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652716672:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562530.556164:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562530.556181:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689e502 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc5fc expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.556236:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654837248:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562530.556317:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e900 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.556462:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17507 00000100:00100000:0.0:1786562530.556472:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652716928:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562530.556479:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.556488:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc60a expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556502:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562530.556506:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562530.556515:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 19 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556530:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 19 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556541:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365200, rc 0) 00000100:00100000:0.0:1786562530.556566:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652716928:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 97us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.556573:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17507 00000100:00100000:0.0:1786562530.556602:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17508 00000100:00100000:0.0:1786562530.556608:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652717184:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562530.556614:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.556622:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e510 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc618 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.556654:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654837376:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562530.556684:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.556715:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17509 00000100:00100000:0.0:1786562530.556721:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652716800:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562530.556728:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.556735:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc603 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556746:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562530.556749:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562530.556755:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 19 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556766:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 19 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556776:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:0.0:1786562530.556791:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652716800:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 70us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.556796:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17509 00000100:00100000:0.0:1786562530.556812:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17510 00000100:00100000:0.0:1786562530.556817:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652717056:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562530.556823:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.556830:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc611 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556840:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562530.556842:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562530.556848:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 19 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556859:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 19 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.556867:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364a00, rc 0) 00000100:00100000:0.0:1786562530.556880:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652717056:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 63us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.556885:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17510 00000100:00100000:1.0:1786562530.566235:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.566273:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.566334:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.566355:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.566378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.566416:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717312 00000100:00100000:1.0:1786562530.566425:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717312 00002000:00100000:1.0:1786562530.566473:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b518a80 x1873345652717312/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.566483:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518a80 with x1873345652717312 ext(2097152->3145727) 00002000:00010000:1.0:1786562530.566489:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b518a80 00000100:00100000:1.0:1786562530.566508:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717440 00000100:00100000:1.0:1786562530.566512:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717440 00002000:00100000:1.0:1786562530.566526:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b519500 x1873345652717440/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.566534:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519500 with x1873345652717440 ext(3145728->4194303) 00002000:00010000:1.0:1786562530.566537:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519500 00000100:00100000:1.0:1786562530.566548:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717568 00000100:00100000:1.0:1786562530.566551:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717568 00002000:00100000:1.0:1786562530.566566:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88b51b800 x1873345652717568/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.566573:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b800 with x1873345652717568 ext(2097152->3145727) 00002000:00010000:1.0:1786562530.566576:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b51b800 00000100:00100000:1.0:1786562530.566601:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717696 00000100:00100000:1.0:1786562530.566604:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717696 00002000:00100000:1.0:1786562530.566621:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b519180 x1873345652717696/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.566628:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519180 with x1873345652717696 ext(2097152->3145727) 00002000:00010000:1.0:1786562530.566632:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519180 00000100:00100000:1.0:1786562530.566644:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717824 00000100:00100000:1.0:1786562530.566657:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717824 00002000:00100000:1.0:1786562530.566680:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88b51bb80 x1873345652717824/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 504/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.566693:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51bb80 with x1873345652717824 ext(0->1048575) 00002000:00010000:1.0:1786562530.566697:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51bb80 00000100:00100000:1.0:1786562530.566713:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11380 00000100:00100000:1.0:1786562530.566722:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652717312:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562530.567524:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11381 00000100:00100000:1.0:1786562530.567534:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652717440:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562530.568148:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11382 00000100:00100000:1.0:1786562530.568156:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652717568:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562530.568815:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11383 00000100:00100000:1.0:1786562530.568824:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652717696:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562530.569343:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11384 00000100:00100000:2.0:1786562530.569353:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652717824:12345-192.168.204.29@tcp:3:cat.0 00002000:00010000:0.0:1786562530.573882:0:37002:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562525 -> 1786562529 00002000:00010000:0.0:1786562530.573891:0:37002:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562525 -> 1786562529 00002000:00010000:0.0:1786562530.573894:0:37002:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562528 -> 1786562529 00000100:00100000:0.0:1786562530.573915:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654837376:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562530.573954:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e510 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc618 expref: 18 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.573978:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e510 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc618 expref: 18 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.573992:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:0.0:1786562530.574110:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652717184:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 17501us (18190us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562530.574120:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17508 00000100:00100000:0.0:1786562530.574178:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654837248:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562530.574199:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689e502 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5fc expref: 18 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.574213:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2632ca1/0x5c655bf66689e502 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5fc expref: 18 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.574222:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9883f7600, rc 0) 00000100:00100000:0.0:1786562530.574244:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652716672:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 18098us (18402us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562530.574251:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17506 00000100:00100000:3.0:1786562530.581411:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.584125:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652717952 00000100:00100000:2.0:1786562530.584140:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652717952 00002000:00100000:2.0:1786562530.584192:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88ac86a00 x1873345652717952/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 504/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.584204:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac86a00 with x1873345652717952 ext(3145728->4194303) 00002000:00010000:2.0:1786562530.584210:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88ac86a00 00000100:00100000:2.0:1786562530.584242:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11385 00000100:00100000:2.0:1786562530.584252:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652717952:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562530.612692:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652717312:12345-192.168.204.29@tcp:3:cat.0 Request processed in 45960us (46456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562530.612705:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11380 00002000:00100000:3.0:1786562530.612718:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b518a80 x1873345652717312/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.612729:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518a80 with x1873345652717312 ext(2097152->3145727) 00002000:00010000:3.0:1786562530.612735:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b518a80 00000100:00100000:3.0:1786562530.615620:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2349:x1873345652717440:12345-192.168.204.29@tcp:3:cat.0 Request processed in 48077us (49335us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562530.615633:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11381 00002000:00100000:3.0:1786562530.615658:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b519500 x1873345652717440/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.615677:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519500 with x1873345652717440 ext(3145728->4194303) 00002000:00010000:3.0:1786562530.615683:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519500 00000100:00100000:3.0:1786562530.620222:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.620659:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652718208 00000100:00100000:0.0:1786562530.620669:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652718208 00000100:00100000:0.0:1786562530.620733:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17043 00000100:00100000:0.0:1786562530.620745:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63997:x1873345652718208:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562530.620765:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.620797:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d3200/0x5c655bf66689e525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc61f expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.620900:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.620916:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 504 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.620930:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.620937:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 5/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.620970:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.620983:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 11 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.620996:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654837504:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562530.621107:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 504 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.621117:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 504 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.621126:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654837632:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562530.621148:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562530.644044:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652717568:12345-192.168.204.29@tcp:3:cat.0 Request processed in 75842us (77663us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562530.644058:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11382 00002000:00100000:1.0:1786562530.644073:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88b51b800 x1873345652717568/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.644084:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b800 with x1873345652717568 ext(2097152->3145727) 00002000:00010000:1.0:1786562530.644090:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b51b800 00000100:00100000:3.0:1786562530.651918:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.652109:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652718336 00000100:00100000:1.0:1786562530.652118:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652718336 00000100:00100000:1.0:1786562530.652178:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17511 00000100:00100000:1.0:1786562530.652188:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+14:63996:x1873345652718336:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562530.652210:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.652229:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc626 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652260:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652271:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 16 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652279:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652286:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=1s v=(2 0) 00010000:00010000:1.0:1786562530.652290:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562530.652295:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1372160->1740799] (req 1372160->1740799) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 15 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652329:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652352:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.652367:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654837760:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562530.652469:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 16 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652479:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 16 pid: 29967 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.652488:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654837888:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562530.652518:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.652527:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 9 pid: 6659 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.652536:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654838016:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.652570:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.652858:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654837504:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562530.652872:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654837632:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562530.652895:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.661087:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.661139:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.661523:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652718464 00000100:00100000:2.0:1786562530.661533:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652718464 00010000:00010000:2.0:1786562530.661585:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 12 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.661620:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652718592 00000100:00100000:2.0:1786562530.661623:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652718592 00010000:00010000:2.0:1786562530.661634:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 505 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.661671:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8523 00000100:00100000:2.0:1786562530.661680:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652718464:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.661693:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.661699:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 12 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661711:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 12 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661733:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e4fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5f5 expref: 12 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661751:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562530.661755:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661764:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661770:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.661819:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652718464:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 140us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.661826:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8523 00000100:00100000:2.0:1786562530.661844:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8524 00000100:00100000:2.0:1786562530.661850:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+505:2348:x1873345652718592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.661857:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.661862:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 505 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661871:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 505 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661884:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e4ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5ee expref: 505 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661894:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562530.661898:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661905:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661913:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661938:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.661957:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+504:2348:x1873345652718592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 107us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.661964:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8524 00010000:00010000:2.0:1786562530.661990:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.661997:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562530.662047:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562530.662189:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d3200/0x5c655bf66689e525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc61f expref: 12 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.662204:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc61f expref: 11 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.662210:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562530.662213:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786562530.662215:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b45d2000, rc 0) 00000100:00100000:2.0:1786562530.662246:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63997:x1873345652718208:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 41505us (42033us total) trans 8589950575 rc 0/0 00000100:00100000:2.0:1786562530.662253:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17043 00000100:00100000:3.0:1786562530.676457:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652717824:12345-192.168.204.29@tcp:3:cat.0 Request processed in 107095us (110066us total) trans 0 rc 1032192/1032192 00000100:00100000:3.0:1786562530.676472:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11384 00002000:00100000:3.0:1786562530.676486:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88b51bb80 x1873345652717824/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 504/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.676504:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51bb80 with x1873345652717824 ext(0->1048575) 00002000:00010000:3.0:1786562530.676510:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51bb80 00000100:00100000:1.0:1786562530.678115:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652717952:12345-192.168.204.29@tcp:3:cat.0 Request processed in 93857us (96715us total) trans 0 rc 540672/540672 00000100:00100000:1.0:1786562530.678128:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11385 00002000:00100000:1.0:1786562530.678139:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88ac86a00 x1873345652717952/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 504/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.678150:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac86a00 with x1873345652717952 ext(3145728->4194303) 00002000:00010000:1.0:1786562530.678155:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88ac86a00 00000100:00100000:0.0:1786562530.699290:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.699403:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652718848 00000100:00100000:1.0:1786562530.699413:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652718848 00000100:00100000:1.0:1786562530.699475:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17044 00000100:00100000:1.0:1786562530.699487:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:63999:x1873345652718848:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562530.699511:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.699531:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc62d expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.699608:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.699622:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.699634:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.699651:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.699676:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.699694:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700108:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700119:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700126:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562530.700140:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562530.700231:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700240:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700247:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700254:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562530.700259:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700266:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700279:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562530.700282:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562530.700286:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700292:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689e548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700305:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700311:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700322:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700327:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb38ec00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562530.700330:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700336:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700343:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2f00) 00010000:00010000:1.0:1786562530.700345:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562530.700348:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700352:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e54f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700389:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 12 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700413:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 11 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.700420:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.700422:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562530.700424:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0515200, rc 0) 00000100:00100000:1.0:1786562530.700478:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63999:x1873345652718848:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 994us (1197us total) trans 8589950576 rc 0/0 00000100:00100000:1.0:1786562530.700491:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17044 00000100:00100000:1.0:1786562530.708447:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654837760:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.708464:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654837888:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.708473:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654838016:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562530.708510:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1372160->1740799] (req 1372160->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 15 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.708533:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af415600, rc 0) 00000100:00100000:1.0:1786562530.708592:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+15:63996:x1873345652718336:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 56404us (56682us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562530.708601:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17511 00000100:00100000:2.0:1786562530.711696:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652717696:12345-192.168.204.29@tcp:3:cat.0 Request processed in 142854us (145320us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562530.711711:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11383 00002000:00100000:2.0:1786562530.711725:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b519180 x1873345652717696/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.711743:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519180 with x1873345652717696 ext(2097152->3145727) 00002000:00010000:2.0:1786562530.711749:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519180 00000100:00100000:3.0:1786562530.729629:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.729693:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.729733:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.729752:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.729784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.730140:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652718976 00000100:00100000:2.0:1786562530.730150:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652718976 00010000:00010000:2.0:1786562530.730191:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 17 pid: 29967 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.730224:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652719104 00000100:00100000:2.0:1786562530.730228:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652719104 00010000:00010000:2.0:1786562530.730241:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.730266:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8525 00000100:00100000:2.0:1786562530.730276:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652718976:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.730290:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.730313:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 17 pid: 29967 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.730327:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 17 pid: 29967 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.730352:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689e468 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5a8 expref: 17 pid: 29967 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.730370:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.730436:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652718976:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 161us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.730444:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8525 00000100:00100000:2.0:1786562530.730510:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8526 00000100:00100000:2.0:1786562530.730516:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652719104:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.730523:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.730531:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.730553:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.730566:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e437 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc577 expref: 15 pid: 29965 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.730575:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.730601:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:2349:x1873345652719104:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 85us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.730607:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8526 00000100:00100000:1.0:1786562530.731067:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652719360 00000100:00100000:1.0:1786562530.731073:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652719360 00000100:00100000:1.0:1786562530.731111:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17045 00000100:00100000:1.0:1786562530.731120:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63997:x1873345652719360:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562530.731140:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.731141:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562530.731157:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b45d2000/0x5c655bf66689e52c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc61f expref: 11 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731170:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.731174:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562530.731186:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689e564 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc634 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731276:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731289:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731297:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731308:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731314:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731319:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731324:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb38ec00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562530.731328:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731336:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731343:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.731357:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562530.731361:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731366:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ec00/0x5c655bf66689e56b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731404:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689e564 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc634 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731413:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562530.731416:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562530.731419:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689e564 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc634 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.731426:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a0514600, rc 0) 00000100:00100000:1.0:1786562530.731457:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63997:x1873345652719360:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 339us (1838us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562530.731464:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17045 00000100:00100000:0.0:1786562530.731596:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652719488 00000100:00100000:0.0:1786562530.731601:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652719488 00000100:00100000:0.0:1786562530.731636:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652719616 00000100:00100000:0.0:1786562530.731640:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652719616 00000100:00100000:1.0:1786562530.731870:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17512 00000100:00100000:1.0:1786562530.731879:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652719488:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562530.731889:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.731900:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e572 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc63b expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.731945:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654838144:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562530.731996:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562530.732161:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17513 00000100:00100000:1.0:1786562530.732168:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652719616:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562530.732177:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.732187:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e579 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc642 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.732202:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562530.732212:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e579 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc642 expref: 9 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.732227:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e579 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc642 expref: 9 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.732237:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9a00, rc 0) 00000100:00100000:1.0:1786562530.732261:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652719616:12345-192.168.204.29@tcp:101:cat.0 Request processed in 94us (2477us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562530.732268:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17513 00000100:00100000:1.0:1786562530.754474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.754518:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.754933:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654838144:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562530.754968:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e572 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc63b expref: 8 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.754990:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c6af3e3/0x5c655bf66689e572 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc63b expref: 8 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.755043:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414600, rc 0) 00000100:00100000:2.0:1786562530.755099:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652719488:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23220us (25344us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562530.755108:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17512 00000100:00100000:0.0:1786562530.755251:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652719872 00000100:00100000:0.0:1786562530.755258:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652719872 00000100:00100000:0.0:1786562530.755307:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6240 00000100:00100000:0.0:1786562530.755316:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:63997:x1873345652719872:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:0.0:1786562530.755519:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:63997:x1873345652719872:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 203us (1054us total) trans 8589950577 rc 0/0 00000100:00100000:0.0:1786562530.755526:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6240 00000100:00100000:3.0:1786562530.755972:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720000 00000100:00100000:3.0:1786562530.755977:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720000 00010000:00010000:3.0:1786562530.756002:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 8 pid: 6659 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.756065:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8527 00000100:00100000:3.0:1786562530.756073:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652720000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562530.756084:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562530.756098:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 8 pid: 6659 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.756111:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 8 pid: 6659 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.756128:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e430 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc570 expref: 8 pid: 6659 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.756140:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562530.756144:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562530.756153:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.756163:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.756196:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.756212:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654838272:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562530.756262:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562530.766536:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.766948:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654838272:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562530.766974:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562530.767065:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2350:x1873345652720000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10992us (12545us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562530.767078:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8527 00000100:00100000:1.0:1786562530.767983:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720128 00000100:00100000:1.0:1786562530.767993:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720128 00000100:00100000:1.0:1786562530.768081:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17514 00000100:00100000:1.0:1786562530.768090:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+14:63989:x1873345652720128:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562530.768109:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.768128:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc649 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.768160:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 6 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.768169:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1786562530.768174:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562530.768179:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 15 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.768210:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 6 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.768223:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 6 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.768236:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654838400:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.768292:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.774066:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654838400:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562530.774105:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 15 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.774127:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9c00, rc 0) 00000100:00100000:0.0:1786562530.774190:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+15:63989:x1873345652720128:12345-192.168.204.29@tcp:101:cat.0 Request processed in 6100us (7663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.774199:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17514 00000100:00100000:2.0:1786562530.778188:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.778221:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.778311:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720384 00000100:00100000:0.0:1786562530.778321:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720384 00002000:00100000:0.0:1786562530.778374:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72e:0x0] (1372160->1376255) req@ffff90e884338700 x1873345652720384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.778385:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338700 with x1873345652720384 ext(1372160->1376255) 00002000:00010000:0.0:1786562530.778400:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884338700 00000100:00100000:0.0:1786562530.778428:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720512 00000100:00100000:0.0:1786562530.778431:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720512 00002000:00100000:0.0:1786562530.778448:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88433bb80 x1873345652720512/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.778455:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433bb80 with x1873345652720512 ext(4194304->5185535) 00002000:00010000:0.0:1786562530.778459:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88433bb80 00000100:00100000:0.0:1786562530.778483:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11386 00000100:00100000:0.0:1786562530.778492:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652720384:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562530.778937:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11387 00000100:00100000:1.0:1786562530.778948:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652720512:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562530.780143:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652720384:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 1646us (1959us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562530.780155:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11386 00002000:00100000:0.0:1786562530.780164:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72e:0x0] (1372160->1376255) req@ffff90e884338700 x1873345652720384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/4536 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.780173:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338700 with x1873345652720384 ext(1372160->1376255) 00002000:00010000:0.0:1786562530.780177:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884338700 00000100:00100000:0.0:1786562530.788765:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.788892:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720256 00000100:00100000:3.0:1786562530.788902:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720256 00002000:00100000:3.0:1786562530.788952:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (3526656->4034559) req@ffff90e88aeb9c00 x1873345652720256/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.788963:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9c00 with x1873345652720256 ext(3526656->4034559) 00010000:00010000:3.0:1786562530.788973:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 7 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.788990:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 7 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562530.788999:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88aeb9c00 00000100:00100000:3.0:1786562530.789052:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5902 00000100:00100000:3.0:1786562530.789063:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652720256:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:2.0:1786562530.829178:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652720256:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 40106us (40410us total) trans 21474843557 rc 0/0 00000100:00100000:2.0:1786562530.829195:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5902 00002000:00100000:2.0:1786562530.829209:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (3526656->4034559) req@ffff90e88aeb9c00 x1873345652720256/t21474843557(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/448 e 0 to 0 dl 1786562541 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.829240:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9c00 with x1873345652720256 ext(3526656->4034559) 00010000:00010000:2.0:1786562530.829252:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 9 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.829273:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 9 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562530.829281:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88aeb9c00 00000100:00100000:1.0:1786562530.836479:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652720512:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 57524us (58247us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562530.836492:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11387 00002000:00100000:1.0:1786562530.836505:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88433bb80 x1873345652720512/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 991232/991232 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562530.836516:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433bb80 with x1873345652720512 ext(4194304->5185535) 00002000:00010000:1.0:1786562530.836522:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88433bb80 00000100:00100000:3.0:1786562530.850120:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.850174:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.850266:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.850414:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720640 00000100:00100000:2.0:1786562530.850431:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720640 00000100:00100000:2.0:1786562530.850488:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720768 00000100:00100000:2.0:1786562530.850492:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720768 00000100:00100000:2.0:1786562530.850510:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652720896 00000100:00100000:2.0:1786562530.850512:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652720896 00000100:00100000:2.0:1786562530.850531:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17515 00000100:00100000:2.0:1786562530.850552:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2349:x1873345652720640:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562530.850570:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562530.850598:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e587 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc650 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.850683:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654838528:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562530.850755:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.851048:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17516 00000100:00100000:0.0:1786562530.851059:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652720768:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562530.851068:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.851080:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030217f8e/0x5c655bf66689e58e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc657 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.851111:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654838656:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562530.851147:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.851164:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17517 00000100:00100000:0.0:1786562530.851171:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652720896:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562530.851204:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562530.851214:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013703de9/0x5c655bf66689e595 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc65e expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.851240:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654838784:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562530.851285:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562530.856625:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:1.0:1786562530.857156:0:6660:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime: 1786562529 -> 1786562530 00002000:00010000:1.0:1786562530.857161:0:6660:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime: 1786562529 -> 1786562530 00002000:00010000:1.0:1786562530.857163:0:6660:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime: 1786562529 -> 1786562530 00000100:00100000:1.0:1786562530.857185:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654838528:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562530.857234:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e587 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc650 expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857258:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000787707c0/0x5c655bf66689e587 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc650 expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857271:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f200, rc 0) 00000100:00100000:1.0:1786562530.857332:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2349:x1873345652720640:12345-192.168.204.29@tcp:101:cat.0 Request processed in 6792us (7220us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562530.857341:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17515 00000100:00100000:1.0:1786562530.857370:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652721024 00000100:00100000:1.0:1786562530.857375:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652721024 00000100:00100000:1.0:1786562530.857424:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17518 00000100:00100000:1.0:1786562530.857433:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:63999:x1873345652721024:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562530.857447:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562530.857462:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc665 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857484:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857494:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857501:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857514:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(2 0) 00010000:00010000:1.0:1786562530.857519:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562530.857524:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3633152->3813375] (req 3633152->3813375) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857556:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857567:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.857580:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654838912:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562530.857665:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857676:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 16 pid: 12119 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.857687:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654839040:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562530.857719:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.857728:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 25 pid: 29963 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562530.857738:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654839168:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.857760:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562530.869148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562530.869320:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654838912:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.869334:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654839040:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562530.869344:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654839168:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562530.869383:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3633152->3813375] (req 3633152->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562530.869417:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:1.0:1786562530.869485:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:63999:x1873345652721024:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 12052us (12870us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562530.869495:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17518 00000100:00100000:2.0:1786562530.870246:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652721408 00000100:00100000:2.0:1786562530.870254:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652721408 00010000:00010000:2.0:1786562530.870288:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 26 pid: 29963 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.870326:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8528 00000100:00100000:2.0:1786562530.870334:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652721408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.870348:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.870370:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 26 pid: 29963 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.870383:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 26 pid: 29963 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.870420:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4d02554/0x5c655bf66689e4d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e0 expref: 26 pid: 29963 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.870436:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.870475:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652721408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 142us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.870483:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8528 00000100:00100000:0.0:1786562530.872299:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.872371:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652721280 00000100:00100000:2.0:1786562530.872380:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652721280 00010000:00010000:2.0:1786562530.872424:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 17 pid: 12119 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.872463:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8529 00000100:00100000:2.0:1786562530.872472:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652721280:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.872484:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.872504:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 17 pid: 12119 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.872516:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 17 pid: 12119 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.872537:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689e51e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc611 expref: 17 pid: 12119 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.872564:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562530.872623:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652721280:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 152us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562530.872634:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8529 00000100:00100000:3.0:1786562530.877225:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.877357:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652721536 00000100:00100000:2.0:1786562530.877367:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652721536 00002000:00100000:2.0:1786562530.877427:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72e:0x0] (1736704->1740799) req@ffff90e9bfe90000 x1873345652721536/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.877439:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90000 with x1873345652721536 ext(1736704->1740799) 00002000:00010000:2.0:1786562530.877445:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe90000 00000100:00100000:2.0:1786562530.877482:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11388 00000100:00100000:2.0:1786562530.877492:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652721536:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562530.877772:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652721536:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 281us (557us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562530.877780:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11388 00002000:00100000:2.0:1786562530.877787:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72e:0x0] (1736704->1740799) req@ffff90e9bfe90000 x1873345652721536/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/4536 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562530.877796:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90000 with x1873345652721536 ext(1736704->1740799) 00002000:00010000:2.0:1786562530.877799:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe90000 00002000:00010000:0.0:1786562530.879315:0:29966:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562525 -> 1786562530 00002000:00010000:0.0:1786562530.879323:0:29966:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562525 -> 1786562530 00002000:00010000:0.0:1786562530.879326:0:29966:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562528 -> 1786562530 00000100:00100000:0.0:1786562530.879345:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654838656:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562530.879380:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030217f8e/0x5c655bf66689e58e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc657 expref: 12 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.879414:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030217f8e/0x5c655bf66689e58e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc657 expref: 12 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.879427:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b45d3600, rc 0) 00000100:00100000:0.0:1786562530.879484:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652720768:12345-192.168.204.29@tcp:101:cat.0 Request processed in 28427us (29309us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562530.879492:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17516 00000100:00100000:2.0:1786562530.880965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.882365:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652721152 00000100:00100000:0.0:1786562530.882376:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652721152 00010000:00010000:0.0:1786562530.882432:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 11 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.882469:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8530 00000100:00100000:0.0:1786562530.882479:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652721152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562530.882496:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562530.882514:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562529 -> 1786562530 00010000:00010000:0.0:1786562530.882521:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 11 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.882535:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 11 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.882576:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562530.882581:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562530.882599:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 14 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.882610:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 14 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562530.882661:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 14 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562530.882689:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654839296:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562530.882764:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00010000:00010000:3.0:1786562530.883308:0:37002:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.29@tcp) returned -22 from glimpse AST (req@00000000af90e250 x1873345654838784) - normal race ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 11 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.883333:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689e453 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->4034559) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc59a expref: 11 pid: 12119 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562530.883347:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654838784:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562530.883375:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013703de9/0x5c655bf66689e595 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc65e expref: 10 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.883403:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013703de9/0x5c655bf66689e595 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc65e expref: 10 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562530.883413:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b45d2200, rc 0) 00000100:00100000:3.0:1786562530.883446:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652720896:12345-192.168.204.29@tcp:101:cat.0 Request processed in 32275us (33180us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562530.883455:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17517 00000100:00100000:2.0:1786562530.911653:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.911695:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.911731:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562530.911759:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722176 00000100:00100000:2.0:1786562530.911767:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722176 00010000:00010000:2.0:1786562530.911803:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.911851:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8531 00000100:00100000:2.0:1786562530.911861:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652722176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562530.911875:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562530.911897:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.911911:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.911932:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689e4df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5e7 expref: 8 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.911949:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562530.911953:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562530.911960:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.911970:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562530.912056:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562530.912072:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654839424:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562530.912142:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562530.912514:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722048 00000100:00100000:1.0:1786562530.912520:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722048 00000100:00100000:1.0:1786562530.912556:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652721792 00000100:00100000:1.0:1786562530.912561:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652721792 00000100:00100000:1.0:1786562530.912580:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6241 00000100:00100000:1.0:1786562530.912587:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+504:63996:x1873345652722048:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562530.912865:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+505:63996:x1873345652722048:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 277us (1231us total) trans 8589950578 rc 0/0 00000100:00100000:1.0:1786562530.912872:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6241 00000100:00100000:1.0:1786562530.912891:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6242 00000100:00100000:1.0:1786562530.912898:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:63990:x1873345652721792:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1786562530.912978:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63990:x1873345652721792:12345-192.168.204.29@tcp:35:cat.0 Request processed in 80us (1283us total) trans 8589950579 rc 0/0 00000100:00100000:1.0:1786562530.912996:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6242 00000100:00100000:0.0:1786562530.913529:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654839296:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562530.913549:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562530.913581:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652721152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 31104us (32623us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.913590:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8530 00000100:00100000:0.0:1786562530.922341:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884339500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654839424:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562530.922397:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562530.922480:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2350:x1873345652722176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10618us (10746us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562530.922491:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8531 00000100:00100000:2.0:1786562530.922860:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.923373:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722304 00000100:00100000:3.0:1786562530.923381:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722304 00002000:00100000:3.0:1786562530.923435:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (3633152->3637247) req@ffff90e884339880 x1873345652722304/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.923445:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339880 with x1873345652722304 ext(3633152->3637247) 00002000:00010000:3.0:1786562530.923451:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884339880 00000100:00100000:3.0:1786562530.923476:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11389 00000100:00100000:3.0:1786562530.923485:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2350:x1873345652722304:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562530.923874:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2350:x1873345652722304:12345-192.168.204.29@tcp:3:cat.0 Request processed in 389us (1013us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562530.923882:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11389 00002000:00100000:3.0:1786562530.923888:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (3633152->3637247) req@ffff90e884339880 x1873345652722304/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/4536 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.923896:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339880 with x1873345652722304 ext(3633152->3637247) 00002000:00010000:3.0:1786562530.923899:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884339880 00000100:00100000:2.0:1786562530.929528:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562530.929854:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722432 00000100:00100000:0.0:1786562530.929865:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722432 00002000:00100000:0.0:1786562530.929916:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88433aa00 x1873345652722432/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562530.929929:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433aa00 with x1873345652722432 ext(2097152->3145727) 00002000:00010000:0.0:1786562530.929935:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88433aa00 00000100:00100000:0.0:1786562530.929969:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11390 00000100:00100000:0.0:1786562530.929979:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652722432:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562530.971485:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562530.971793:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722560 00000100:00100000:3.0:1786562530.971804:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722560 00002000:00100000:3.0:1786562530.971849:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3809280->3813375) req@ffff90e88aebb100 x1873345652722560/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/0 e 0 to 0 dl 1786562541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.971860:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aebb100 with x1873345652722560 ext(3809280->3813375) 00002000:00010000:3.0:1786562530.971866:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aebb100 00000100:00100000:3.0:1786562530.971895:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11391 00000100:00100000:3.0:1786562530.971905:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652722560:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562530.972121:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652722560:12345-192.168.204.29@tcp:3:cat.0 Request processed in 216us (644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562530.972129:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11391 00002000:00100000:3.0:1786562530.972135:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3809280->3813375) req@ffff90e88aebb100 x1873345652722560/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:1/0 lens 488/4536 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562530.972143:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aebb100 with x1873345652722560 ext(3809280->3813375) 00002000:00010000:3.0:1786562530.972146:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aebb100 00000100:00100000:2.0:1786562531.001142:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.001426:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722816 00000100:00100000:1.0:1786562531.001436:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722816 00000100:00100000:1.0:1786562531.001500:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6243 00000100:00100000:1.0:1786562531.001510:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:63999:x1873345652722816:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562531.001771:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:63999:x1873345652722816:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 262us (636us total) trans 8589950580 rc 0/0 00000100:00100000:1.0:1786562531.001779:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6243 00000100:00080000:2.0:1786562531.002108:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562531.002402:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652722432:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 72421us (72880us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562531.002412:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11390 00002000:00100000:0.0:1786562531.002424:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88433aa00 x1873345652722432/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:1/0 lens 488/440 e 0 to 0 dl 1786562541 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562531.002434:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433aa00 with x1873345652722432 ext(2097152->3145727) 00002000:00010000:0.0:1786562531.002440:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88433aa00 00010000:00010000:1.0:1786562531.045471:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562531.054866:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.054982:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652722944 00000100:00100000:1.0:1786562531.055112:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652722944 00000100:00100000:1.0:1786562531.055235:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17519 00000100:00100000:1.0:1786562531.055247:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+25:63989:x1873345652722944:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.055266:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.055285:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc66c expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.055319:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.055330:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562531.055335:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.055342:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 26 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.055376:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.055404:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 6 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.055419:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654839552:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562531.055509:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92b40 going to sleep for 11 seconds 00000100:00080000:2.0:1786562531.056726:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562531.063301:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.063479:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654839552:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.063515:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 26 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.063537:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99cd80200, rc 0) 00000100:00100000:1.0:1786562531.063610:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+26:63989:x1873345652722944:12345-192.168.204.29@tcp:101:cat.0 Request processed in 8366us (8869us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.063619:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17519 00000100:00100000:3.0:1786562531.063771:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723072 00000100:00100000:3.0:1786562531.063778:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723072 00002000:00100000:3.0:1786562531.063841:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (3633152->3813375) req@ffff90e88aeb8000 x1873345652723072/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.063851:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb8000 with x1873345652723072 ext(3633152->3813375) 00010000:00010000:3.0:1786562531.063859:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 7 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.063879:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 7 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562531.063888:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88aeb8000 00000100:00100000:3.0:1786562531.063909:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5903 00000100:00100000:3.0:1786562531.063936:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2350:x1873345652723072:12345-192.168.204.29@tcp:4:cat.0 00000100:00080000:1.0:1786562531.065035:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562531.100034:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652723072:12345-192.168.204.29@tcp:4:cat.0 Request processed in 36086us (36713us total) trans 17179876034 rc 0/0 00000100:00100000:3.0:1786562531.100050:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5903 00002000:00100000:3.0:1786562531.100067:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (3633152->3813375) req@ffff90e88aeb8000 x1873345652723072/t17179876034(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/448 e 0 to 0 dl 1786562542 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.100079:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb8000 with x1873345652723072 ext(3633152->3813375) 00010000:00010000:3.0:1786562531.100090:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 9 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.100109:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 9 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562531.100117:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88aeb8000 00000100:00100000:2.0:1786562531.113030:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.113196:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723200 00000100:00100000:1.0:1786562531.113206:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723200 00010000:00010000:1.0:1786562531.113247:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 9 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.113290:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8532 00000100:00100000:1.0:1786562531.113302:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652723200:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562531.113317:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562531.113340:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562525 -> 1786562530 00002000:00010000:1.0:1786562531.113344:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562528 -> 1786562530 00010000:00010000:1.0:1786562531.113350:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 9 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.113364:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 9 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.113400:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e59c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3813375) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc665 expref: 9 pid: 6660 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.113418:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.113423:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.113433:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 25 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.113443:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 25 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.113484:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 25 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.113499:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654839680:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562531.113597:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562531.136146:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654839680:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562531.136173:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562531.136234:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652723200:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 22933us (23252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.136247:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8532 00000100:00100000:0.0:1786562531.173498:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.173588:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.173703:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723328 00000100:00100000:1.0:1786562531.173713:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723328 00002000:00100000:1.0:1786562531.173781:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88aeba300 x1873345652723328/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.173793:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeba300 with x1873345652723328 ext(3145728->4194303) 00002000:00010000:1.0:1786562531.173800:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aeba300 00000100:00100000:1.0:1786562531.173824:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723456 00000100:00100000:1.0:1786562531.173827:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723456 00002000:00100000:1.0:1786562531.173866:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88aeb8a80 x1873345652723456/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.173875:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb8a80 with x1873345652723456 ext(3145728->4194303) 00002000:00010000:1.0:1786562531.173878:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88aeb8a80 00000100:00100000:1.0:1786562531.173896:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11392 00000100:00100000:1.0:1786562531.173904:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652723328:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562531.173930:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11393 00000100:00100000:2.0:1786562531.173943:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652723456:12345-192.168.204.29@tcp:3:multiop.0 00000100:00080000:3.0:1786562531.175582:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562531.201379:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.201494:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723584 00000100:00100000:0.0:1786562531.201505:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723584 00000100:00100000:0.0:1786562531.201684:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17046 00000100:00100000:0.0:1786562531.201697:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64006:x1873345652723584:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562531.201720:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.201749:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e5aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc673 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.201820:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.201832:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.201841:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.201857:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.201868:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.201874:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.202599:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.202612:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.202620:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562531.203393:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:0.0:1786562531.203400:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562531.203421:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203432:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203441:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203448:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203455:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203464:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562531.203468:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203475:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203488:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562531.203491:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562531.203495:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203501:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689e5b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203514:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203520:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203526:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203531:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99822c000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562531.203534:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203540:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203551:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562531.203553:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562531.203556:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203561:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c000/0x5c655bf66689e5b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203605:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e5aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203620:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 12 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.203628:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.203631:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562531.203633:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261c400, rc 0) 00000100:00100000:0.0:1786562531.204957:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64006:x1873345652723584:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3257us (3768us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.204969:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17046 00000100:00100000:0.0:1786562531.212265:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.215042:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652723328:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 41082us (41497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562531.215845:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11392 00002000:00100000:3.0:1786562531.215869:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88aeba300 x1873345652723328/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.215883:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeba300 with x1873345652723328 ext(3145728->4194303) 00002000:00010000:3.0:1786562531.215892:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aeba300 00000100:00100000:2.0:1786562531.218475:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723840 00000100:00100000:2.0:1786562531.218491:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723840 00000100:00100000:2.0:1786562531.218586:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17047 00000100:00100000:2.0:1786562531.218598:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+505:64005:x1873345652723840:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562531.218625:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562531.218652:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e5c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc67a expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.218726:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.218748:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.218768:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.218788:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.218795:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.218801:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219492:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219503:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219510:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562531.219520:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562531.219608:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219615:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219622:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219628:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26fe00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562531.219632:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219704:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219717:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562531.219721:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562531.219725:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219834:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e5cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219849:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219854:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219860:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219865:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562531.219868:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219874:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219881:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d500) 00010000:00010000:2.0:1786562531.219884:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562531.219887:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219897:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689e5d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219942:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e5c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 508 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219955:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 507 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.219963:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562531.219965:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562531.219967:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f800, rc 0) 00000100:00100000:2.0:1786562531.220262:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+507:64005:x1873345652723840:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1666us (8007us total) trans 8589950581 rc 0/0 00000100:00100000:2.0:1786562531.220270:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17047 00000100:00080000:3.0:1786562531.220389:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562531.220962:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652723456:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 47020us (47370us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562531.220972:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11393 00002000:00100000:1.0:1786562531.221076:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88aeb8a80 x1873345652723456/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.221092:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb8a80 with x1873345652723456 ext(3145728->4194303) 00002000:00010000:1.0:1786562531.221097:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88aeb8a80 00000100:00100000:0.0:1786562531.233954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.234235:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.248855:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652723968 00000100:00100000:2.0:1786562531.248869:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652723968 00000100:00100000:2.0:1786562531.248939:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652724096 00000100:00100000:2.0:1786562531.248943:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652724096 00000100:00100000:2.0:1786562531.248983:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17520 00000100:00100000:2.0:1786562531.248993:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652723968:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562531.249026:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562531.249046:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689e5e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc681 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562531.249107:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654839808:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562531.249189:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562531.249314:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.249410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.249628:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652724224 00000100:00100000:3.0:1786562531.249633:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652724224 00000100:00100000:3.0:1786562531.249671:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652724352 00000100:00100000:3.0:1786562531.249675:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652724352 00000100:00100000:3.0:1786562531.249694:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17521 00000100:00100000:3.0:1786562531.249701:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652724096:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562531.249712:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.249723:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689e5f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc688 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.249769:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654839936:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562531.250041:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17522 00000100:00100000:0.0:1786562531.250053:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652724224:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562531.250061:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.250072:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc68f expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250088:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562531.250093:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562531.250103:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 19 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250120:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 19 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250133:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99261de00, rc 0) 00000100:00100000:0.0:1786562531.250166:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652724224:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 117us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.250173:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17522 00000100:00100000:0.0:1786562531.250193:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17523 00000100:00100000:0.0:1786562531.250200:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652724352:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562531.250207:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.250216:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc696 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250228:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562531.250231:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562531.250237:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 19 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250249:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 19 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250258:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99822c000, rc 0) 00000100:00100000:0.0:1786562531.250276:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652724352:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 78us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.250283:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17523 00000100:00100000:3.0:1786562531.250417:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.250466:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.250663:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652724608 00000100:00100000:0.0:1786562531.250668:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652724608 00000100:00100000:0.0:1786562531.250710:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17048 00000100:00100000:0.0:1786562531.250717:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64008:x1873345652724608:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562531.250739:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.250759:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689e605 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc69d expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250824:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250839:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250849:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250862:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250870:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.250876:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251232:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251243:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251250:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562531.251261:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562531.251363:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251371:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251377:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251396:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3f6000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562531.251401:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251408:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251421:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562531.251424:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562531.251428:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251439:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e60c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251452:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251457:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251463:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251468:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3f7c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562531.251471:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251477:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251485:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562531.251487:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562531.251490:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251496:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7c00/0x5c655bf66689e613 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251551:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1600/0x5c655bf66689e605 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251568:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 15 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.251575:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.251578:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562531.251580:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7a00, rc 0) 00000100:00100000:0.0:1786562531.251618:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64008:x1873345652724608:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 901us (1150us total) trans 8589950582 rc 0/0 00000100:00100000:0.0:1786562531.251626:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17048 00000100:00100000:2.0:1786562531.255514:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654839808:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562531.255564:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689e5e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc681 expref: 18 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.255592:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689e5e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc681 expref: 18 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.255605:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ea00, rc 0) 00000100:00100000:2.0:1786562531.255670:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652723968:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6679us (21728us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562531.255680:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17520 00000100:00100000:3.0:1786562531.259522:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654839936:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562531.259586:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689e5f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc688 expref: 18 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.259611:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689e5f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc688 expref: 18 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.259624:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176fe00, rc 0) 00000100:00100000:3.0:1786562531.259698:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652724096:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 9996us (25462us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562531.259707:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17521 00000100:00100000:3.0:1786562531.281151:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.281285:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652724864 00000100:00100000:2.0:1786562531.281294:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652724864 00000100:00100000:2.0:1786562531.281353:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17049 00000100:00100000:2.0:1786562531.281363:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64006:x1873345652724864:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562531.281396:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562531.281421:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6a4 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281529:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281545:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281560:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 506 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281568:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 14 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281576:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 6/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281611:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 14 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.281624:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 14 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562531.282262:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654840064:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.282891:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 506 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.282905:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 506 pid: 33114 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.282917:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654840192:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.282953:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.282963:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 13 pid: 33140 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.282972:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654840320:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562531.282995:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.289413:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.291215:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652724992 00000100:00100000:2.0:1786562531.291229:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652724992 00002000:00100000:2.0:1786562531.291304:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88aebb800 x1873345652724992/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562531.291317:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aebb800 with x1873345652724992 ext(4194304->5185535) 00002000:00010000:2.0:1786562531.291323:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aebb800 00000100:00100000:2.0:1786562531.291366:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11394 00000100:00100000:2.0:1786562531.291389:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652724992:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562531.322662:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.322722:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.323074:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.323093:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.323169:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652725376 00000100:00100000:0.0:1786562531.323178:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652725376 00010000:00010000:0.0:1786562531.323219:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 15 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.323256:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652725632 00000100:00100000:0.0:1786562531.323259:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652725632 00010000:00010000:0.0:1786562531.323272:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 14 pid: 33140 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.323291:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652725504 00000100:00100000:0.0:1786562531.323294:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652725504 00010000:00010000:0.0:1786562531.323306:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 507 pid: 33114 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.323323:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8533 00000100:00100000:0.0:1786562531.323333:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652725376:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.323347:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.323355:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 15 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323368:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 15 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323404:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.323409:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323420:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323426:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562531.323474:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652725376:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 142us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.323481:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8533 00000100:00100000:0.0:1786562531.323499:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8534 00000100:00100000:0.0:1786562531.323505:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652725632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.323513:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.323518:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 14 pid: 33140 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323584:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 14 pid: 33140 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323605:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.323609:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323615:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.323621:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562531.323727:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652725248 00000100:00100000:1.0:1786562531.323740:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652725248 00000100:00100000:1.0:1786562531.323774:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17050 00000100:00100000:1.0:1786562531.323782:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64011:x1873345652725248:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.323801:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.323818:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689e636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6ab expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.323908:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.323919:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.323929:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562531.323939:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562531.324086:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689e636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.324106:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.324114:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562531.324118:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786562531.324121:0:33140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.324128:0:33140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.324134:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268400, rc 0) 00000100:00100000:2.0:1786562531.324197:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8535 00000100:00100000:2.0:1786562531.324207:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+507:2349:x1873345652725504:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562531.324216:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562531.324222:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 507 pid: 33114 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.324234:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 507 pid: 33114 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.324248:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562531.324252:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.324260:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.324267:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.324283:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562531.324370:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7a00/0x5c655bf66689e61a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc69d expref: 17 pid: 36756 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.324394:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654840064:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.324408:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689e5db lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc67a expref: 507 pid: 33114 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.324419:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654840192:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.324430:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c400/0x5c655bf66689e5bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc673 expref: 14 pid: 33140 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.324440:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654840320:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.324466:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.324475:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.324481:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562531.324498:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562531.324581:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689e628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 15 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.324594:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.324602:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562531.324605:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562531.324607:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fe00, rc 0) 00000100:00100000:0.0:1786562531.325304:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652725632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1793us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.325320:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8534 00000100:00100000:1.0:1786562531.326208:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64011:x1873345652725248:12345-192.168.204.29@tcp:101:cat.0 Request processed in 2423us (3553us total) trans 8589950583 rc 0/0 00000100:00100000:1.0:1786562531.326219:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17050 00000100:00100000:1.0:1786562531.334812:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+506:2349:x1873345652725504:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10595us (11704us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.334828:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8535 00000100:00100000:3.0:1786562531.335308:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64006:x1873345652724864:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 53943us (54166us total) trans 8589950584 rc 0/0 00000100:00100000:3.0:1786562531.335320:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17049 00000100:00100000:3.0:1786562531.340990:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.341040:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652725760 00000100:00100000:3.0:1786562531.341049:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652725760 00000100:00100000:3.0:1786562531.341097:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17524 00000100:00100000:3.0:1786562531.341105:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652725760:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562531.341123:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.341140:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689e652 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6b2 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.341209:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654840448:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562531.341273:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.341328:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.341358:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652725888 00000100:00100000:3.0:1786562531.341362:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652725888 00000100:00100000:3.0:1786562531.341407:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17525 00000100:00100000:3.0:1786562531.341413:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652725888:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562531.341421:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.341431:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e659 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6b9 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.341460:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654840576:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562531.341486:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00080000:3.0:1786562531.341498:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562531.353485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.353575:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.353644:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726016 00000100:00100000:1.0:1786562531.353654:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726016 00000100:00100000:1.0:1786562531.353705:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726144 00000100:00100000:1.0:1786562531.353708:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726144 00000100:00100000:1.0:1786562531.353734:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17526 00000100:00100000:1.0:1786562531.353743:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652726016:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.353761:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.353779:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6c0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.353805:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.353809:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.353821:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 11 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.353843:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 11 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.353855:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:1.0:1786562531.353901:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652726016:12345-192.168.204.29@tcp:101:cat.0 Request processed in 159us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.353908:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17526 00000100:00100000:1.0:1786562531.353926:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17527 00000100:00100000:1.0:1786562531.353933:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652726144:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.353940:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.353950:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6c7 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.353962:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562531.353965:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562531.353972:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 11 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.353983:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 11 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.353991:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268000, rc 0) 00000100:00100000:1.0:1786562531.354041:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652726144:12345-192.168.204.29@tcp:101:cat.0 Request processed in 109us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.354050:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17527 00000100:00100000:2.0:1786562531.356958:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652724992:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 65574us (67546us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1786562531.356971:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11394 00002000:00100000:2.0:1786562531.356985:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88aebb800 x1873345652724992/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 991232/991232 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562531.357001:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aebb800 with x1873345652724992 ext(4194304->5185535) 00002000:00010000:2.0:1786562531.357029:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aebb800 00000100:00100000:0.0:1786562531.372443:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654840448:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562531.372488:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689e652 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6b2 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.372513:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689e652 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6b2 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.372527:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:0.0:1786562531.372612:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652725760:12345-192.168.204.29@tcp:101:cat.0 Request processed in 31507us (31633us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562531.372621:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17524 00000100:00100000:3.0:1786562531.373823:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.374085:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654840576:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562531.374135:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e659 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6b9 expref: 10 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.374157:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689e659 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6b9 expref: 10 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.374167:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:1.0:1786562531.374549:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652725888:12345-192.168.204.29@tcp:101:cat.0 Request processed in 33132us (33218us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562531.374557:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17525 00000100:00100000:0.0:1786562531.374794:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726272 00000100:00100000:0.0:1786562531.374802:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726272 00000100:00100000:0.0:1786562531.374853:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17051 00000100:00100000:0.0:1786562531.374863:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64006:x1873345652726272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562531.374885:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.374904:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e66e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6ce expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.374987:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.375024:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.375034:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.375066:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.375079:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 14 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.375094:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654840704:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562531.376752:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224540 going to sleep for 11 seconds 00000100:00100000:2.0:1786562531.393162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.393274:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.393544:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726400 00000100:00100000:1.0:1786562531.393563:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726400 00000100:00100000:1.0:1786562531.393610:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726528 00000100:00100000:1.0:1786562531.393614:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726528 00000100:00100000:1.0:1786562531.393640:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17528 00000100:00100000:1.0:1786562531.393650:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+26:64005:x1873345652726400:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562531.393668:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.393688:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6d5 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393720:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 27 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393735:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 9 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393744:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 16 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393752:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.393757:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.393762:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2281472->2498559] (req 2281472->2498559) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 27 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393798:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 16 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393811:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 16 pid: 29965 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.393827:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654840832:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.393917:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 9 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393929:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 9 pid: 8368 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.393946:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654840960:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.393976:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 27 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.393987:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 27 pid: 29964 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.393996:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654841088:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562531.394049:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.394705:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17529 00000100:00100000:0.0:1786562531.394717:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64011:x1873345652726528:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562531.394727:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.394739:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6dc expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.394763:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 27 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.394770:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=1s v=(2 0) 00010000:00010000:0.0:1786562531.394773:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562531.394777:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.394797:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 27 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.394806:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 27 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.394816:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654841216:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562531.394848:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.399721:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654840704:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562531.399751:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.401901:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.402037:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.403702:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726912 00000100:00100000:3.0:1786562531.403720:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726912 00010000:00010000:3.0:1786562531.403782:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 15 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.403832:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8536 00000100:00100000:3.0:1786562531.403845:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652726912:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562531.403864:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562531.403873:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 15 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.403889:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 15 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.403924:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e62f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6a4 expref: 15 pid: 34450 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.403944:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562531.403949:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.403962:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.403971:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.404001:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562531.404108:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652726912:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 265us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562531.404117:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8536 00000100:00100000:0.0:1786562531.406487:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652726784 00000100:00100000:0.0:1786562531.406502:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652726784 00000100:00100000:0.0:1786562531.406591:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6244 00000100:00100000:0.0:1786562531.406602:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+506:63989:x1873345652726784:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1786562531.406860:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+507:63989:x1873345652726784:12345-192.168.204.29@tcp:35:cat.0 Request processed in 258us (4965us total) trans 8589950585 rc 0/0 00000100:00100000:0.0:1786562531.406869:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6244 00010000:00010000:2.0:1786562531.407361:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.407372:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562531.407411:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:2.0:1786562531.407416:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562531.407431:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.407465:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6000/0x5c655bf66689e66e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 14 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.407485:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.407494:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562531.407497:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562531.407500:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7e00, rc 0) 00000100:00100000:2.0:1786562531.407552:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64006:x1873345652726272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 32690us (33739us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562531.407559:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17051 00000100:00100000:1.0:1786562531.441772:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.441805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.441827:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.441856:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727168 00000100:00100000:1.0:1786562531.441865:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727168 00010000:00010000:1.0:1786562531.441906:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 11 pid: 8368 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.441938:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727296 00000100:00100000:1.0:1786562531.441941:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727296 00010000:00010000:1.0:1786562531.441954:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 28 pid: 29964 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.441973:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727040 00000100:00100000:1.0:1786562531.441976:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727040 00010000:00010000:1.0:1786562531.441988:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 17 pid: 29965 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.442044:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8537 00000100:00100000:1.0:1786562531.442054:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652727168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562531.442070:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562531.442093:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 11 pid: 8368 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.442234:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654840832:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562531.442247:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654840960:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562531.442256:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654841088:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.442290:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2281472->2498559] (req 2281472->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 28 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.442307:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:3.0:1786562531.442372:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:64005:x1873345652726400:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 48723us (49221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562531.442390:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17528 00000100:00100000:0.0:1786562531.442640:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8538 00000100:00100000:0.0:1786562531.442651:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652727296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.442661:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.442675:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 27 pid: 29964 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442689:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 27 pid: 29964 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442713:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b11c20f/0x5c655bf66689e5a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc66c expref: 27 pid: 29964 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442726:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562531.442746:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345652727296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 99us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.442753:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8538 00000100:00100000:0.0:1786562531.442768:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8539 00000100:00100000:0.0:1786562531.442782:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652727040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.442790:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.442800:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 17 pid: 29965 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442817:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 17 pid: 29965 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442831:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689e5f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc68f expref: 17 pid: 29965 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442843:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562531.442865:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652727040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 90us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.442872:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8539 00000100:00100000:0.0:1786562531.442908:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654841216:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562531.442936:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 11 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.442948:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7a00, rc 0) 00000100:00100000:0.0:1786562531.442980:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64011:x1873345652726528:12345-192.168.204.29@tcp:101:cat.0 Request processed in 48265us (49705us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.442994:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17529 00000100:00100000:3.0:1786562531.443001:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.443074:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727424 00000100:00100000:0.0:1786562531.443081:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727424 00000100:00100000:0.0:1786562531.443138:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17530 00000100:00100000:3.0:1786562531.443145:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.443155:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652727424:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562531.443170:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1786562531.443190:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562531.443197:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689e68a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6e3 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.443217:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727680 00000100:00100000:3.0:1786562531.443226:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727680 00000100:00100000:0.0:1786562531.443255:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654841344:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562531.443275:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17531 00000100:00100000:3.0:1786562531.443288:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652727680:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562531.443305:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1786562531.443315:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1786562531.443326:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689e691 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6ea expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.443398:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654841472:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562531.443449:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.443556:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562531.443919:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 10 pid: 8368 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.443938:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf66689e660 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c0 expref: 10 pid: 8368 timeout: 1063 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.443950:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.443954:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562531.443961:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 25 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.443971:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 25 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.444001:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 25 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.444034:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654841600:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562531.444084:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562531.444117:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727552 00000100:00100000:1.0:1786562531.444123:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727552 00002000:00100000:1.0:1786562531.444158:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x711:0x0] (978944->995327) req@ffff90e9bfe90700 x1873345652727552/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 16872/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.444167:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90700 with x1873345652727552 ext(978944->995327) 00010000:00010000:1.0:1786562531.444174:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 26 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.444721:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 26 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562531.444730:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfe90700 00000100:00100000:1.0:1786562531.444764:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5904 00000100:00100000:1.0:1786562531.444775:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652727552:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562531.446592:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652727552:12345-192.168.204.29@tcp:4:cat.0 Request processed in 1812us (3444us total) trans 17179876035 rc 0/0 00000100:00100000:1.0:1786562531.446605:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5904 00002000:00100000:1.0:1786562531.446617:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x711:0x0] (978944->995327) req@ffff90e9bfe90700 x1873345652727552/t17179876035(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 16872/448 e 0 to 0 dl 1786562542 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.446627:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90700 with x1873345652727552 ext(978944->995327) 00010000:00010000:1.0:1786562531.446635:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 28 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.446652:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 28 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562531.446660:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bfe90700 00000100:00100000:0.0:1786562531.450163:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727808 00000100:00100000:0.0:1786562531.450180:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727808 00000100:00100000:0.0:1786562531.450258:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17532 00000100:00100000:0.0:1786562531.450270:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652727808:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562531.450290:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.450312:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e698 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6f1 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.451589:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654841728:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562531.451683:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.460928:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654841344:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562531.460976:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689e68a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6e3 expref: 19 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.461034:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083451427/0x5c655bf66689e68a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6e3 expref: 19 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.461049:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7c00, rc 0) 00000100:00100000:0.0:1786562531.461115:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652727424:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 17966us (18127us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562531.461124:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17530 00000100:00100000:3.0:1786562531.461814:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654841472:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562531.461860:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689e691 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ea expref: 18 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.461884:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689e691 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ea expref: 18 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.461898:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:3.0:1786562531.461965:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652727680:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 18679us (18775us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562531.461978:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17531 00000100:00100000:1.0:1786562531.467305:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654841600:192.168.204.29@tcp:105: 00002000:00010000:0.0:1786562531.468768:0:12119:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime: 1786562525 -> 1786562530 00000100:00100000:0.0:1786562531.468810:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654841728:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562531.468861:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e698 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6f1 expref: 17 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.468888:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e698 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6f1 expref: 17 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.468903:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f6400, rc 0) 00000100:00100000:0.0:1786562531.468985:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652727808:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 18717us (25429us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562531.468998:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17532 00010000:00010000:1.0:1786562531.471665:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562531.471759:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652727168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 29699us (29990us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.471775:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8537 00000100:00100000:2.0:1786562531.478924:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.479275:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652727936 00000100:00100000:3.0:1786562531.479286:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652727936 00002000:00100000:3.0:1786562531.479347:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2281472->2285567) req@ffff90e88313dc00 x1873345652727936/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.479357:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313dc00 with x1873345652727936 ext(2281472->2285567) 00002000:00010000:3.0:1786562531.479363:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88313dc00 00000100:00100000:3.0:1786562531.479396:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11395 00000100:00100000:3.0:1786562531.479406:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652727936:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562531.479534:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.479597:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.479627:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652728320 00000100:00100000:0.0:1786562531.479635:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652728320 00010000:00010000:0.0:1786562531.479675:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 29 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.479715:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8540 00000100:00100000:0.0:1786562531.479725:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652728320:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.479741:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.479768:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 29 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.479784:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 29 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.479816:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e43e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->995327) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc57e expref: 29 pid: 29662 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.479835:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562531.479840:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562531.479851:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.479863:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.479912:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.479933:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654841856:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562531.479964:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652728192 00000100:00100000:3.0:1786562531.479972:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652728192 00000100:00100000:0.0:1786562531.480063:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.480668:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17052 00000100:00100000:3.0:1786562531.480681:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64006:x1873345652728192:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562531.480699:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.480718:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e69f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6f8 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480818:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480835:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480845:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480859:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480867:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480873:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480879:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562531.480884:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480891:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480904:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562531.480907:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562531.480912:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480918:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e6a6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480950:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e69f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6f8 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480961:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562531.480963:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562531.480967:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e69f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6f8 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.480977:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:3.0:1786562531.484877:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64006:x1873345652728192:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4186us (5339us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562531.484892:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17052 00000100:00100000:3.0:1786562531.505433:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652727936:12345-192.168.204.29@tcp:3:cat.0 Request processed in 26015us (26506us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562531.505447:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11395 00002000:00100000:3.0:1786562531.505458:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2281472->2285567) req@ffff90e88313dc00 x1873345652727936/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/4536 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.505469:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313dc00 with x1873345652727936 ext(2281472->2285567) 00002000:00010000:3.0:1786562531.505476:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88313dc00 00000100:00100000:2.0:1786562531.510067:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654841856:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562531.510096:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562531.510153:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652728320:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 30430us (30555us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562531.510166:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8540 00000100:00100000:1.0:1786562531.510356:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.510540:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652728448 00000100:00100000:3.0:1786562531.510548:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652728448 00002000:00100000:3.0:1786562531.510608:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88b51a680 x1873345652728448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.510627:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51a680 with x1873345652728448 ext(0->1048575) 00002000:00010000:3.0:1786562531.510632:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51a680 00000100:00100000:3.0:1786562531.510858:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11396 00000100:00100000:3.0:1786562531.510869:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652728448:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562531.523205:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.523263:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.523336:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652728704 00000100:00100000:2.0:1786562531.523346:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652728704 00000100:00100000:2.0:1786562531.523413:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6245 00000100:00100000:2.0:1786562531.523424:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64006:x1873345652728704:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562531.523698:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64006:x1873345652728704:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 276us (501us total) trans 8589950586 rc 0/0 00000100:00100000:2.0:1786562531.523707:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6245 00000100:00100000:3.0:1786562531.524764:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652728832 00000100:00100000:3.0:1786562531.524773:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652728832 00002000:00100000:3.0:1786562531.524810:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2494464->2498559) req@ffff90e88b518e00 x1873345652728832/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.524822:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518e00 with x1873345652728832 ext(2494464->2498559) 00002000:00010000:3.0:1786562531.524827:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b518e00 00000100:00100000:3.0:1786562531.524857:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11397 00000100:00100000:3.0:1786562531.524865:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652728832:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562531.525066:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652728832:12345-192.168.204.29@tcp:3:cat.0 Request processed in 201us (1802us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562531.525074:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11397 00002000:00100000:3.0:1786562531.525081:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2494464->2498559) req@ffff90e88b518e00 x1873345652728832/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/4536 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.525089:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518e00 with x1873345652728832 ext(2494464->2498559) 00002000:00010000:3.0:1786562531.525093:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b518e00 00000100:00100000:3.0:1786562531.543969:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652728448:12345-192.168.204.29@tcp:3:cat.0 Request processed in 33092us (33603us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562531.543982:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11396 00002000:00100000:3.0:1786562531.543993:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e88b51a680 x1873345652728448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.544040:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51a680 with x1873345652728448 ext(0->1048575) 00002000:00010000:3.0:1786562531.544047:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51a680 00000100:00100000:1.0:1786562531.545579:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.545698:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729088 00000100:00100000:3.0:1786562531.545707:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729088 00000100:00100000:3.0:1786562531.545763:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6246 00000100:00100000:3.0:1786562531.545774:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+507:64005:x1873345652729088:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:3.0:1786562531.546037:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+508:64005:x1873345652729088:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 264us (470us total) trans 8589950587 rc 0/0 00000100:00100000:3.0:1786562531.546045:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6246 00000100:00100000:2.0:1786562531.583197:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.585843:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729216 00000100:00100000:1.0:1786562531.585858:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729216 00000100:00100000:1.0:1786562531.585929:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17533 00000100:00100000:1.0:1786562531.585940:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64011:x1873345652729216:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.585958:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.585977:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc6ff expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.586045:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 14 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.586062:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=1s v=(2 0) 00010000:00010000:1.0:1786562531.586066:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562531.586072:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.586107:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 14 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.586123:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 14 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.586138:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654841984:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562531.586232:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:1.0:1786562531.605794:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654841984:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.605837:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.605858:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988266200, rc 0) 00000100:00100000:1.0:1786562531.605991:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64011:x1873345652729216:12345-192.168.204.29@tcp:101:cat.0 Request processed in 20052us (22814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.606001:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17533 00000100:00100000:2.0:1786562531.611228:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.611322:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729344 00000100:00100000:0.0:1786562531.611332:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729344 00002000:00100000:0.0:1786562531.611391:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72e:0x0] (1372160->1740799) req@ffff90e88313d180 x1873345652729344/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562531.611403:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313d180 with x1873345652729344 ext(1372160->1740799) 00010000:00010000:0.0:1786562531.611413:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 15 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.611435:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 15 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562531.611444:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88313d180 00000100:00100000:0.0:1786562531.611477:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5905 00000100:00100000:0.0:1786562531.611488:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652729344:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562531.640822:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652729344:12345-192.168.204.29@tcp:4:cat.0 Request processed in 29324us (29591us total) trans 21474843558 rc 0/0 00000100:00100000:0.0:1786562531.640838:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5905 00002000:00100000:0.0:1786562531.640852:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72e:0x0] (1372160->1740799) req@ffff90e88313d180 x1873345652729344/t21474843558(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/448 e 0 to 0 dl 1786562542 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562531.640863:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313d180 with x1873345652729344 ext(1372160->1740799) 00010000:00010000:0.0:1786562531.640873:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 17 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.640892:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 17 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562531.640901:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88313d180 00000100:00100000:1.0:1786562531.663800:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.664048:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729472 00000100:00100000:0.0:1786562531.664058:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729472 00010000:00010000:0.0:1786562531.664099:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 17 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.664150:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8541 00000100:00100000:0.0:1786562531.664160:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652729472:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.664183:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.664207:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 17 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.664221:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 17 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.664247:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000040951e5/0x5c655bf66689e533 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->1740799) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc626 expref: 17 pid: 29662 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.664263:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562531.664267:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562531.664274:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 9 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.664283:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 9 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.664321:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 9 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.664335:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654842112:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562531.664471:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.675452:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.676293:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729728 00000100:00100000:1.0:1786562531.676304:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729728 00000100:00100000:1.0:1786562531.676363:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17053 00000100:00100000:1.0:1786562531.676383:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+508:64017:x1873345652729728:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.676407:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.676430:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc706 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676506:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676521:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676534:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676551:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676557:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676564:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676951:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676961:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.676969:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562531.676980:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562531.677096:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677104:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677110:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677116:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988267e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562531.677119:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677126:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677138:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562531.677141:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562531.677145:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677151:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677165:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677170:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677629:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677688:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562531.677692:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677698:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677707:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2f00) 00010000:00010000:1.0:1786562531.677709:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562531.677712:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677717:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677760:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 511 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677773:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 510 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.677780:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562531.677782:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562531.677784:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0000, rc 0) 00000100:00100000:1.0:1786562531.677853:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+510:64017:x1873345652729728:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1482us (2412us total) trans 8589950588 rc 0/0 00000100:00100000:1.0:1786562531.677865:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17053 00000100:00100000:1.0:1786562531.688233:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654842112:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562531.688262:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562531.688310:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652729472:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 24151us (24518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.688321:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8541 00000100:00100000:0.0:1786562531.699945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.699990:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.700099:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729856 00000100:00100000:1.0:1786562531.700109:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729856 00000100:00100000:1.0:1786562531.700154:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652729984 00000100:00100000:1.0:1786562531.700157:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652729984 00000100:00100000:1.0:1786562531.700193:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17534 00000100:00100000:1.0:1786562531.700204:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652729856:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.700222:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.700240:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc70d expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.700266:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=1s v=(3 0) 00010000:00010000:1.0:1786562531.700270:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 3) 00010000:00010000:1.0:1786562531.700281:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 28 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.700299:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 28 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.700314:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc1c00, rc 0) 00000100:00100000:1.0:1786562531.700366:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652729856:12345-192.168.204.29@tcp:101:cat.0 Request processed in 164us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.700383:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17534 00000100:00100000:1.0:1786562531.700412:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17535 00000100:00100000:1.0:1786562531.700419:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652729984:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.700426:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.700436:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc714 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.700450:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562531.700453:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562531.700459:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 17 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.700472:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 17 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.700481:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0c00, rc 0) 00000100:00100000:1.0:1786562531.700501:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652729984:12345-192.168.204.29@tcp:101:cat.0 Request processed in 83us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.700507:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17535 00000100:00100000:2.0:1786562531.707907:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.707983:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730112 00000100:00100000:1.0:1786562531.707992:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730112 00002000:00100000:1.0:1786562531.708055:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88313e680 x1873345652730112/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.708068:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313e680 with x1873345652730112 ext(1048576->2097151) 00002000:00010000:1.0:1786562531.708073:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313e680 00000100:00100000:1.0:1786562531.708104:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11398 00000100:00100000:1.0:1786562531.708114:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652730112:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562531.735555:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652730112:12345-192.168.204.29@tcp:3:cat.0 Request processed in 27431us (27648us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562531.735569:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11398 00002000:00100000:1.0:1786562531.735585:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88313e680 x1873345652730112/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.735595:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313e680 with x1873345652730112 ext(1048576->2097151) 00002000:00010000:1.0:1786562531.735600:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313e680 00000100:00100000:3.0:1786562531.759842:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.761931:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730240 00000100:00100000:1.0:1786562531.761944:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730240 00000100:00100000:1.0:1786562531.762051:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17054 00000100:00100000:1.0:1786562531.762062:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64018:x1873345652730240:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562531.762090:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.762112:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc71b expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762181:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762196:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762207:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762220:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762227:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762234:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762745:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762757:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762764:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562531.762798:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562531.762802:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562531.762821:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762833:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762841:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762847:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762853:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762862:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562531.762866:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762872:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762883:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562531.762886:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562531.762890:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762895:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e6ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762909:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762915:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762920:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762925:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988267e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562531.762927:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762932:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762942:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2f00) 00010000:00010000:1.0:1786562531.762944:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562531.762946:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762952:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e6f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762983:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689e6e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc71b expref: 16 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.762996:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc71b expref: 15 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.763003:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562531.763041:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562531.763044:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d400, rc 0) 00000100:00100000:1.0:1786562531.763119:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64018:x1873345652730240:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 1059us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.763128:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17054 00000100:00100000:0.0:1786562531.788115:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.788158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.788193:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.788267:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730368 00000100:00100000:3.0:1786562531.788277:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730368 00002000:00100000:3.0:1786562531.788326:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e98873f480 x1873345652730368/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.788338:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873f480 with x1873345652730368 ext(0->1048575) 00002000:00010000:3.0:1786562531.788343:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873f480 00000100:00100000:3.0:1786562531.788381:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730496 00000100:00100000:3.0:1786562531.788384:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730496 00002000:00100000:3.0:1786562531.788414:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e98873dc00 x1873345652730496/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.788423:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873dc00 with x1873345652730496 ext(1048576->2097151) 00002000:00010000:3.0:1786562531.788428:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873dc00 00000100:00100000:3.0:1786562531.788449:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11399 00000100:00100000:3.0:1786562531.788460:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652730368:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562531.789085:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11400 00000100:00100000:3.0:1786562531.789094:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652730496:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562531.791048:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730624 00000100:00100000:1.0:1786562531.791060:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730624 00000100:00100000:1.0:1786562531.791117:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17536 00000100:00100000:1.0:1786562531.791128:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64008:x1873345652730624:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562531.791144:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.791162:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc722 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791198:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791209:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 15 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791218:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791228:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=2s v=(1 0) 00010000:00010000:1.0:1786562531.791233:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1786562531.791238:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [1372160->2097151] (req 1372160->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791272:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791286:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 29 pid: 29966 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.791300:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842240:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.791389:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 15 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791415:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 15 pid: 37002 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.791425:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842368:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.791458:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.791468:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 10 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.791477:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842496:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562531.791498:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.797328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.797383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.798829:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730752 00000100:00100000:2.0:1786562531.798841:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730752 00010000:00010000:2.0:1786562531.798890:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 30 pid: 29966 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562531.798932:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652730880 00000100:00100000:2.0:1786562531.798935:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652730880 00010000:00010000:2.0:1786562531.798949:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 16 pid: 37002 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562531.798974:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8542 00000100:00100000:2.0:1786562531.798984:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652730752:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1786562531.798996:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8543 00010000:00010000:2.0:1786562531.799000:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562531.799046:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 30 pid: 29966 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.799061:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 30 pid: 29966 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.799086:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562531.799099:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652730880:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562531.799108:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562531.799118:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 16 pid: 37002 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.799129:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 16 pid: 37002 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562531.799139:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652730752:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 156us (1820us total) trans 0 rc 0/0 00010000:00010000:3.0:1786562531.799141:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562531.799146:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8542 00000100:00100000:3.0:1786562531.799158:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652730880:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 156us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562531.799164:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8543 00010000:00010000:1.0:1786562531.799313:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da8e0dd/0x5c655bf66689e4ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d9 expref: 29 pid: 29966 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.799331:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842240:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.799345:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e509 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc60a expref: 15 pid: 37002 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.799354:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842368:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562531.812462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.812557:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731008 00000100:00100000:0.0:1786562531.812566:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731008 00000100:00100000:3.0:1786562531.812593:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.812644:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842496:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.812685:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1372160->2097151] (req 1372160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.812701:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562531.812707:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d800, rc 0) 00000100:00100000:1.0:1786562531.812767:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64008:x1873345652730624:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 21641us (24573us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.812776:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17536 00000100:00100000:1.0:1786562531.812800:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731264 00000100:00100000:1.0:1786562531.812804:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731264 00000100:00100000:1.0:1786562531.812830:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17537 00000100:00100000:1.0:1786562531.812838:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64011:x1873345652731264:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562531.812851:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.812867:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc729 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.812891:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 28 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.812901:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=1s v=(3 0) 00010000:00010000:1.0:1786562531.812905:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562531.812911:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.812942:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 28 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.812953:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 28 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.812967:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842624:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562531.813057:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.819867:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652730368:12345-192.168.204.29@tcp:3:cat.0 Request processed in 31398us (31765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562531.819881:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11399 00002000:00100000:3.0:1786562531.819894:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e98873f480 x1873345652730368/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.819904:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873f480 with x1873345652730368 ext(0->1048575) 00002000:00010000:3.0:1786562531.819910:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873f480 00000100:00100000:0.0:1786562531.820595:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731136 00000100:00100000:0.0:1786562531.820603:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731136 00010000:00010000:0.0:1786562531.823574:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 12 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.823651:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8544 00000100:00100000:0.0:1786562531.823664:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652731136:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.823680:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.823704:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 12 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.823719:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 12 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.823744:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e94df52/0x5c655bf66689e4a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5d2 expref: 12 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.823763:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562531.823768:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562531.823777:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.823788:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.823829:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.823846:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654842752:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562531.825252:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 962 00000100:00100000:1.0:1786562531.825268:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652731008:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562531.825284:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562531.825305:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf66689e6fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc71b expref: 15 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.825335:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562531.825340:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562531.825390:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652731008:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 125us (12937us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.825399:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 962 00000100:00100000:3.0:1786562531.834360:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.834395:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.835064:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.835094:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731648 00000100:00100000:3.0:1786562531.835102:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731648 00000100:00100000:3.0:1786562531.835147:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731904 00000100:00100000:3.0:1786562531.835150:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731904 00000100:00100000:3.0:1786562531.835165:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731520 00000100:00100000:3.0:1786562531.835168:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731520 00000100:00100000:3.0:1786562531.835337:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17538 00000100:00100000:3.0:1786562531.835353:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652731648:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562531.835383:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.835402:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc737 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.835494:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562531.835500:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562531.835511:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 18 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.835901:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 18 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.835917:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22000, rc 0) 00000100:00100000:3.0:1786562531.835976:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652731648:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 627us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562531.835984:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17538 00000100:00100000:3.0:1786562531.836030:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17539 00000100:00100000:3.0:1786562531.836039:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652731904:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562531.836047:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.836058:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689e716 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc745 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.836099:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654842880:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562531.836152:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.836176:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17540 00000100:00100000:3.0:1786562531.836184:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652731520:12345-192.168.204.29@tcp:101:mirror_io.0 00000100:00100000:1.0:1786562531.836676:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654842624:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562531.836700:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.836712:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365200, rc 0) 00000100:00100000:1.0:1786562531.836737:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64011:x1873345652731264:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23900us (24035us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.836743:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17537 00000100:00100000:1.0:1786562531.836798:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.836922:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731776 00000100:00100000:1.0:1786562531.836928:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731776 00000100:00100000:1.0:1786562531.836959:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17541 00000100:00100000:1.0:1786562531.836966:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652731776:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562531.836974:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.836983:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001caf612b/0x5c655bf66689e71d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc73e expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.837031:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654843008:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562531.837063:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.837516:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224f00 going to sleep for 11 seconds 00010000:00010000:3.0:1786562531.846899:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.846931:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc730 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.846963:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1786562531.846967:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1786562531.846980:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 20 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.846998:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 20 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.847028:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22400, rc 0) 00000100:00100000:3.0:1786562531.847108:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:2349:x1873345652731520:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 10923us (12042us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562531.847117:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17540 00000100:00100000:3.0:1786562531.862979:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:3.0:1786562531.863080:0:6660:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime: 1786562530 -> 1786562531 00000100:00100000:3.0:1786562531.863112:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654842880:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562531.863152:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689e716 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc745 expref: 19 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.863175:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689e716 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc745 expref: 19 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.863204:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22e00, rc 0) 00000100:00100000:3.0:1786562531.863253:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652731904:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 27216us (28857us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562531.863261:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17539 00000100:00100000:0.0:1786562531.863651:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654842752:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562531.863665:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562531.863699:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652731136:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 40039us (51105us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.863709:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8544 00002000:00010000:1.0:1786562531.864334:0:29966:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562525 -> 1786562530 00002000:00010000:1.0:1786562531.864345:0:29966:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime: 1786562525 -> 1786562531 00002000:00010000:1.0:1786562531.864348:0:29966:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562528 -> 1786562530 00000100:00100000:1.0:1786562531.864411:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654843008:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562531.864433:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001caf612b/0x5c655bf66689e71d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc73e expref: 17 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.864450:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001caf612b/0x5c655bf66689e71d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc73e expref: 17 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.864459:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:1.0:1786562531.864485:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652731776:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 27520us (27687us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562531.864492:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17541 00000100:00100000:0.0:1786562531.870473:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.876268:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652731392 00000100:00100000:1.0:1786562531.876283:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652731392 00002000:00100000:1.0:1786562531.876357:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2281472->2498559) req@ffff90e88be20a80 x1873345652731392/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.876377:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20a80 with x1873345652731392 ext(2281472->2498559) 00010000:00010000:1.0:1786562531.876387:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 27 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.876413:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 27 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562531.876423:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be20a80 00000100:00100000:1.0:1786562531.876454:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652732032 00000100:00100000:1.0:1786562531.876458:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652732032 00002000:00100000:1.0:1786562531.876476:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x713:0x0] (1372160->1376255) req@ffff90e98873d180 x1873345652732032/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562531.876484:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873d180 with x1873345652732032 ext(1372160->1376255) 00002000:00010000:1.0:1786562531.876488:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873d180 00000100:00100000:3.0:1786562531.876572:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5906 00000100:00100000:3.0:1786562531.876596:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652731392:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562531.878973:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.881716:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652730496:12345-192.168.204.29@tcp:3:cat.0 Request processed in 92614us (93549us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562531.881737:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11400 00002000:00100000:2.0:1786562531.881756:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e98873dc00 x1873345652730496/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/440 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562531.881767:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873dc00 with x1873345652730496 ext(1048576->2097151) 00002000:00010000:2.0:1786562531.881774:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873dc00 00000100:00100000:2.0:1786562531.881803:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11401 00000100:00100000:2.0:1786562531.881814:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652732032:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562531.881974:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652732032:12345-192.168.204.29@tcp:3:cat.0 Request processed in 163us (11509us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562531.881981:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11401 00002000:00100000:2.0:1786562531.881988:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x713:0x0] (1372160->1376255) req@ffff90e98873d180 x1873345652732032/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/4536 e 0 to 0 dl 1786562542 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562531.881996:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873d180 with x1873345652732032 ext(1372160->1376255) 00002000:00010000:2.0:1786562531.882000:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873d180 00000100:00100000:3.0:1786562531.884837:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652732288 00000100:00100000:3.0:1786562531.884851:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652732288 00000100:00100000:3.0:1786562531.884930:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17055 00000100:00100000:3.0:1786562531.884941:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64018:x1873345652732288:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562531.884961:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.884982:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689e72b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc74c expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885100:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885118:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885129:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 509 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885137:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885175:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 509 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885187:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 509 pid: 33140 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.885202:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654843136:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.885293:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.885304:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 15 pid: 35929 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.885313:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654843264:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562531.885336:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.895646:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562531.895744:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652732544 00000100:00100000:1.0:1786562531.895753:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652732544 00000100:00100000:1.0:1786562531.895811:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17056 00000100:00100000:1.0:1786562531.895821:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+510:64020:x1873345652732544:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562531.895848:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562531.895869:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc753 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.895966:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.895982:0:33113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.895993:0:33113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.907084:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.907137:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654843264:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562531.907211:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652732672 00000100:00100000:0.0:1786562531.907218:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652732672 00010000:00010000:0.0:1786562531.907255:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 16 pid: 35929 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.907296:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8545 00000100:00100000:0.0:1786562531.907305:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652732672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.907322:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.907330:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 16 pid: 35929 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.907341:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 16 pid: 35929 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.907362:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7e00/0x5c655bf66689e675 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ce expref: 16 pid: 35929 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.907389:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.907395:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.907404:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.907428:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562531.907473:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652732672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 169us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.907481:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8545 00000100:00100000:0.0:1786562531.911581:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652731392:12345-192.168.204.29@tcp:4:cat.0 Request processed in 34989us (48601us total) trans 17179876036 rc 0/0 00000100:00100000:0.0:1786562531.911595:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5906 00002000:00100000:0.0:1786562531.911607:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2281472->2498559) req@ffff90e88be20a80 x1873345652731392/t17179876036(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:2/0 lens 488/448 e 0 to 0 dl 1786562542 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562531.911618:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20a80 with x1873345652731392 ext(2281472->2498559) 00010000:00010000:0.0:1786562531.911629:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 29 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.911646:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 29 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562531.911654:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be20a80 00000100:00100000:1.0:1786562531.913084:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562531.913706:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652732800 00000100:00100000:2.0:1786562531.913715:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652732800 00010000:00010000:2.0:1786562531.913753:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 512 pid: 33140 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562531.913796:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8546 00000100:00100000:2.0:1786562531.913805:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+512:2348:x1873345652732800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562531.913820:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562531.913828:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 512 pid: 33140 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913841:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 512 pid: 33140 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913863:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562531.913868:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913878:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913886:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913899:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913906:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913911:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562531.913938:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562531.913981:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+512:2348:x1873345652732800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 177us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562531.913988:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8546 00010000:00010000:3.0:1786562531.914552:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689e6c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc706 expref: 511 pid: 33140 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.914583:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654843136:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562531.914972:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.914989:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.914996:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562531.915063:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562531.915628:0:33113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.915642:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562531.915655:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562531.915741:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 512 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.915759:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 511 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.915768:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.915772:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562531.915774:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:0.0:1786562531.915824:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+511:64020:x1873345652732544:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 20005us (20188us total) trans 8589950590 rc 0/0 00000100:00100000:0.0:1786562531.915832:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17056 00010000:00010000:3.0:1786562531.916434:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689e72b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc74c expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.916454:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc74c expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.916461:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562531.916464:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562531.916467:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22600, rc 0) 00000100:00100000:3.0:1786562531.916493:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64018:x1873345652732288:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 31555us (37528us total) trans 8589950589 rc 0/0 00000100:00100000:3.0:1786562531.916501:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17055 00000100:00100000:2.0:1786562531.919285:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.919580:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652732928 00000100:00100000:3.0:1786562531.919596:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652732928 00010000:00010000:3.0:1786562531.919653:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 29 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.919693:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8547 00000100:00100000:3.0:1786562531.919702:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652732928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562531.919719:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562531.919753:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 29 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.919767:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 29 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.919789:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689e67c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2281472->2498559) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6d5 expref: 29 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.919804:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562531.919809:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:3.0:1786562531.919817:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.919828:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.919863:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.919877:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654843392:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562531.919953:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.935985:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654843392:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562531.936049:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562531.936253:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.936658:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652733056 00000100:00100000:0.0:1786562531.936666:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652733056 00000100:00100000:0.0:1786562531.936724:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17542 00000100:00100000:0.0:1786562531.936733:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:64017:x1873345652733056:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562531.936751:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562531.936769:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc75a expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.936801:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.936811:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562531.936816:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1786562531.936822:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 30 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.936851:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.936864:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 9 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.936878:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654843520:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562531.936933:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562531.937452:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652732928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 16403us (16827us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562531.937463:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8547 00000100:00100000:0.0:1786562531.946075:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654843520:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562531.946125:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 29 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.946146:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:2.0:1786562531.951737:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.951875:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652733312 00000100:00100000:3.0:1786562531.951885:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652733312 00000100:00100000:3.0:1786562531.951948:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17057 00000100:00100000:3.0:1786562531.951958:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64018:x1873345652733312:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562531.951982:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562531.951985:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562531.952034:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689e732 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc74c expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.952055:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562531.952060:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562531.952072:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689e75c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc761 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.952339:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.952353:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 510 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.952362:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.952404:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 510 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.952422:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 510 pid: 33113 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562531.952436:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654843648:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562531.952512:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562531.955700:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654843648:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562531.955734:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562531.965899:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:64017:x1873345652733056:12345-192.168.204.29@tcp:101:cat.0 Request processed in 29151us (29631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562531.965913:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17542 00000100:00100000:2.0:1786562531.971677:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562531.971818:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652733440 00000100:00100000:0.0:1786562531.971829:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652733440 00010000:00010000:0.0:1786562531.971871:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 511 pid: 33113 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562531.971914:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8548 00000100:00100000:0.0:1786562531.971934:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+511:2349:x1873345652733440:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562531.971949:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562531.971956:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 511 pid: 33113 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.971969:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 511 pid: 33113 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.971990:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689e740 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc753 expref: 511 pid: 33113 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.972050:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562531.972055:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.972066:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.972078:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562531.972115:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562531.972324:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972333:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972354:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972361:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972377:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972384:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f23600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562531.972388:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972396:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972411:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562531.972414:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562531.972417:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972423:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689e763 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972463:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689e75c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc761 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972472:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562531.972475:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562531.972479:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689e75c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc761 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562531.972488:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23c00, rc 0) 00000100:00100000:1.0:1786562531.972516:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64018:x1873345652733312:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 20559us (20788us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562531.972524:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17057 00000100:00100000:0.0:1786562531.972579:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+510:2349:x1873345652733440:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 249us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562531.972588:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8548 00000100:00100000:2.0:1786562531.995929:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562531.996414:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652733568 00000100:00100000:3.0:1786562531.996425:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652733568 00002000:00100000:3.0:1786562531.996479:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x713:0x0] (1372160->2097151) req@ffff90e88313c700 x1873345652733568/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/0 e 0 to 0 dl 1786562542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562531.996489:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313c700 with x1873345652733568 ext(1372160->2097151) 00010000:00010000:3.0:1786562531.996499:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 10 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562531.996515:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 10 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562531.996523:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313c700 00000100:00100000:3.0:1786562531.996555:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5907 00000100:00100000:3.0:1786562531.996574:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652733568:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:2.0:1786562532.003072:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.003185:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652733824 00000100:00100000:1.0:1786562532.003195:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652733824 00000100:00100000:1.0:1786562532.003264:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6247 00000100:00100000:1.0:1786562532.003274:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64018:x1873345652733824:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:1.0:1786562532.003512:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64018:x1873345652733824:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 240us (450us total) trans 8589950591 rc 0/0 00000100:00100000:1.0:1786562532.003520:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6247 00000100:00080000:2.0:1786562532.003863:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562532.031432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.031560:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652733952 00000100:00100000:3.0:1786562532.031581:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652733952 00002000:00100000:3.0:1786562532.031629:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b7ee680 x1873345652733952/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.031649:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ee680 with x1873345652733952 ext(2097152->3145727) 00002000:00010000:3.0:1786562532.031656:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7ee680 00000100:00100000:3.0:1786562532.031690:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11402 00000100:00100000:3.0:1786562532.031701:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652733952:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562532.041125:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.041312:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.042673:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734080 00000100:00100000:1.0:1786562532.042685:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734080 00002000:00100000:1.0:1786562532.042740:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88be22a00 x1873345652734080/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.042751:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22a00 with x1873345652734080 ext(3145728->4194303) 00002000:00010000:1.0:1786562532.042757:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be22a00 00000100:00100000:1.0:1786562532.042781:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734208 00000100:00100000:1.0:1786562532.042785:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734208 00002000:00100000:1.0:1786562532.042802:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88be20000 x1873345652734208/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.042809:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20000 with x1873345652734208 ext(2097152->3145727) 00002000:00010000:1.0:1786562532.042813:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be20000 00000100:00100000:1.0:1786562532.042833:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11403 00000100:00100000:1.0:1786562532.042843:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652734080:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562532.043591:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11404 00000100:00100000:1.0:1786562532.043600:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652734208:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562532.048837:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.050334:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734336 00000100:00100000:3.0:1786562532.050348:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734336 00002000:00100000:3.0:1786562532.050413:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e98873f100 x1873345652734336/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.050425:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873f100 with x1873345652734336 ext(3145728->4194303) 00002000:00010000:3.0:1786562532.050431:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873f100 00000100:00100000:3.0:1786562532.050466:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11405 00000100:00100000:3.0:1786562532.050476:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652734336:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562532.075861:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652733568:12345-192.168.204.29@tcp:4:cat.0 Request processed in 79285us (79930us total) trans 17179876037 rc 0/0 00000100:00100000:3.0:1786562532.075875:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5907 00002000:00100000:3.0:1786562532.075888:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x713:0x0] (1372160->2097151) req@ffff90e88313c700 x1873345652733568/t17179876037(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:2/0 lens 488/448 e 0 to 0 dl 1786562542 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.075899:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313c700 with x1873345652733568 ext(1372160->2097151) 00010000:00010000:3.0:1786562532.075910:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 16 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.075928:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 16 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562532.075944:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313c700 00010000:00010000:1.0:1786562532.077033:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562532.111558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.111646:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734464 00000100:00100000:1.0:1786562532.111655:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734464 00010000:00010000:1.0:1786562532.111708:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 16 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.111754:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8549 00000100:00100000:1.0:1786562532.111764:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652734464:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562532.111779:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562532.111799:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562530 -> 1786562531 00002000:00010000:1.0:1786562532.111802:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562530 -> 1786562531 00010000:00010000:1.0:1786562532.111809:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 16 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.111823:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 16 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.111845:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689e701 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc722 expref: 16 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.111862:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562532.111866:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562532.111874:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 28 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.111885:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 28 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.111921:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 28 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.111936:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654843776:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562532.112052:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:2.0:1786562532.112840:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652733952:12345-192.168.204.29@tcp:3:cat.0 Request processed in 81137us (81413us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562532.112853:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11402 00002000:00100000:2.0:1786562532.112865:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b7ee680 x1873345652733952/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.112876:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ee680 with x1873345652733952 ext(2097152->3145727) 00002000:00010000:2.0:1786562532.112881:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7ee680 00000100:00100000:1.0:1786562532.122874:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652734080:12345-192.168.204.29@tcp:3:cat.0 Request processed in 80020us (81758us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562532.122891:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11403 00002000:00100000:1.0:1786562532.122904:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88be22a00 x1873345652734080/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.122915:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22a00 with x1873345652734080 ext(3145728->4194303) 00002000:00010000:1.0:1786562532.122920:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88be22a00 00000100:00100000:1.0:1786562532.129993:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654843776:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562532.130056:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562532.130118:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652734464:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 18343us (18557us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.130131:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8549 00000100:00100000:3.0:1786562532.132123:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652734336:12345-192.168.204.29@tcp:3:cat.0 Request processed in 81641us (83288us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562532.132136:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11405 00002000:00100000:3.0:1786562532.132148:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e98873f100 x1873345652734336/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.132159:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873f100 with x1873345652734336 ext(3145728->4194303) 00002000:00010000:3.0:1786562532.132165:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873f100 00000100:00100000:2.0:1786562532.142034:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.142148:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734592 00000100:00100000:1.0:1786562532.142159:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734592 00000100:00100000:1.0:1786562532.142223:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17543 00000100:00100000:1.0:1786562532.142234:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64008:x1873345652734592:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562532.142252:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.142271:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc768 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.142304:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 12 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.142313:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562532.142317:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562532.142322:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->2220031] (req 2097152->2220031) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.142356:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 12 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.142380:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 12 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.142393:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654843904:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562532.142465:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:1.0:1786562532.142547:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652734208:12345-192.168.204.29@tcp:3:cat.0 Request processed in 98948us (101234us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562532.142555:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11404 00002000:00100000:1.0:1786562532.142577:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88be20000 x1873345652734208/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.142586:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be20000 with x1873345652734208 ext(2097152->3145727) 00002000:00010000:1.0:1786562532.142590:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be20000 00000100:00100000:1.0:1786562532.154573:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654843904:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.154608:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->2220031] (req 2097152->2220031) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.154635:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:1.0:1786562532.154701:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64008:x1873345652734592:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 12468us (12702us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.154723:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17543 00000100:00100000:0.0:1786562532.154947:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.155372:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734720 00000100:00100000:3.0:1786562532.155379:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734720 00002000:00100000:3.0:1786562532.155421:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e98873d500 x1873345652734720/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.155430:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873d500 with x1873345652734720 ext(1048576->2097151) 00002000:00010000:3.0:1786562532.155434:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873d500 00000100:00100000:3.0:1786562532.155464:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11406 00000100:00100000:3.0:1786562532.155473:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652734720:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562532.161442:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.161523:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734848 00000100:00100000:1.0:1786562532.161534:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734848 00000100:00100000:1.0:1786562532.161596:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17544 00000100:00100000:1.0:1786562532.161607:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64011:x1873345652734848:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562532.161631:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.161649:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc76f expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.161677:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562532.161682:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:1.0:1786562532.161691:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 13 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.161707:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 13 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.161729:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:1.0:1786562532.161787:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64011:x1873345652734848:12345-192.168.204.29@tcp:101:cat.0 Request processed in 181us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.161794:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17544 00000100:00100000:3.0:1786562532.171929:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.171975:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.171998:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.172059:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.172076:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.172095:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.172134:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735488 00000100:00100000:3.0:1786562532.172144:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735488 00000100:00100000:3.0:1786562532.172194:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735104 00000100:00100000:3.0:1786562532.172197:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735104 00000100:00100000:3.0:1786562532.172214:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735360 00000100:00100000:3.0:1786562532.172217:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735360 00000100:00100000:3.0:1786562532.172237:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 259 00000100:00100000:3.0:1786562532.172247:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652735488:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562532.172317:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652735488:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.172325:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 259 00000100:00100000:3.0:1786562532.172341:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 260 00000100:00100000:3.0:1786562532.172346:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+510:2348:x1873345652735104:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562532.172385:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+510:2348:x1873345652735104:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.172392:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 260 00000100:00100000:3.0:1786562532.172404:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 261 00000100:00100000:3.0:1786562532.172410:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc069850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652735360:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562532.172435:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc069850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652735360:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.172440:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 261 00000100:00100000:3.0:1786562532.173001:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.175565:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652734976 00000100:00100000:1.0:1786562532.175579:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652734976 00000100:00100000:1.0:1786562532.175639:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 240 00000100:00100000:1.0:1786562532.175649:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+16:2348:x1873345652734976:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562532.175737:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+16:2348:x1873345652734976:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.175745:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 240 00000100:00100000:1.0:1786562532.175782:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735232 00000100:00100000:1.0:1786562532.175786:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735232 00000100:00100000:1.0:1786562532.175810:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735744 00000100:00100000:1.0:1786562532.175813:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735744 00000100:00100000:1.0:1786562532.175837:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735616 00000100:00100000:1.0:1786562532.175841:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735616 00000100:00100000:1.0:1786562532.175861:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 423 00000100:00100000:1.0:1786562532.175868:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652735232:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562532.175901:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652735232:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.175908:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 423 00000100:00100000:1.0:1786562532.175920:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 424 00000100:00100000:1.0:1786562532.175926:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652735744:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562532.175949:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652735744:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.175955:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 424 00000100:00100000:1.0:1786562532.175966:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 425 00000100:00100000:1.0:1786562532.175971:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652735616:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562532.175991:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652735616:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 21us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.175997:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 425 00000100:00080000:2.0:1786562532.176800:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562532.176806:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562532.184888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.185341:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652735872 00000100:00100000:0.0:1786562532.185352:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652735872 00010000:00010000:0.0:1786562532.185403:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 13 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562532.185441:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8550 00000100:00100000:0.0:1786562532.185451:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652735872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562532.185465:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562532.185488:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 13 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.185503:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 13 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.185526:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e708 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc729 expref: 13 pid: 28862 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.185549:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562532.185554:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562532.185562:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.185573:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.185611:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562532.185625:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654844032:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562532.185720:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562532.202458:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652734720:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46976us (47501us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562532.202471:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11406 00002000:00100000:0.0:1786562532.202484:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e98873d500 x1873345652734720/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.202494:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873d500 with x1873345652734720 ext(1048576->2097151) 00002000:00010000:0.0:1786562532.202500:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873d500 00000100:00100000:3.0:1786562532.210458:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.217431:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654844032:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562532.217459:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562532.217534:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652735872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 32083us (32656us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.217545:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8550 00000100:00100000:2.0:1786562532.217948:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736000 00000100:00100000:2.0:1786562532.217957:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736000 00002000:00100000:2.0:1786562532.218002:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2215936->2220031) req@ffff90e9831fce00 x1873345652736000/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.218055:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fce00 with x1873345652736000 ext(2215936->2220031) 00002000:00010000:2.0:1786562532.218061:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831fce00 00000100:00100000:2.0:1786562532.218090:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11407 00000100:00100000:2.0:1786562532.218100:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652736000:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562532.218281:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652736000:12345-192.168.204.29@tcp:3:cat.0 Request processed in 182us (7832us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562532.218289:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11407 00002000:00100000:2.0:1786562532.218295:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2215936->2220031) req@ffff90e9831fce00 x1873345652736000/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/4536 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.218304:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fce00 with x1873345652736000 ext(2215936->2220031) 00002000:00010000:2.0:1786562532.218308:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831fce00 00000100:00100000:3.0:1786562532.238799:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.238952:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736128 00000100:00100000:2.0:1786562532.238962:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736128 00002000:00100000:2.0:1786562532.239043:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9831fd880 x1873345652736128/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.239053:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd880 with x1873345652736128 ext(3145728->4194303) 00002000:00010000:2.0:1786562532.239059:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831fd880 00000100:00100000:2.0:1786562532.239081:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11408 00000100:00100000:2.0:1786562532.239090:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652736128:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562532.252446:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.252615:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736384 00000100:00100000:2.0:1786562532.252635:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736384 00000100:00100000:2.0:1786562532.252699:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6248 00000100:00100000:2.0:1786562532.252710:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64008:x1873345652736384:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:2.0:1786562532.253044:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64008:x1873345652736384:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 297us (566us total) trans 8589950592 rc 0/0 00000100:00100000:2.0:1786562532.253053:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6248 00000100:00100000:2.0:1786562532.276916:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652736128:12345-192.168.204.29@tcp:3:cat.0 Request processed in 37814us (38114us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562532.276932:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11408 00002000:00100000:2.0:1786562532.276949:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9831fd880 x1873345652736128/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.276961:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fd880 with x1873345652736128 ext(3145728->4194303) 00002000:00010000:2.0:1786562532.276968:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9831fd880 00000100:00100000:3.0:1786562532.291251:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.291370:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736512 00000100:00100000:0.0:1786562532.291385:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736512 00000100:00100000:0.0:1786562532.291464:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17545 00000100:00100000:0.0:1786562532.291478:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:64017:x1873345652736512:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562532.291499:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562532.291518:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc776 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.291570:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.291583:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 3) 00010000:00010000:0.0:1786562532.291588:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 3) 00010000:00010000:0.0:1786562532.291595:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.291644:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.291658:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 11 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562532.291673:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654844160:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562532.291759:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562532.306651:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654844160:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562532.306693:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.306714:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:3.0:1786562532.306788:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:64017:x1873345652736512:12345-192.168.204.29@tcp:101:cat.0 Request processed in 15314us (15546us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.306798:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17545 00000100:00100000:2.0:1786562532.317473:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.317578:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736640 00000100:00100000:0.0:1786562532.317589:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736640 00002000:00100000:0.0:1786562532.317654:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2220031) req@ffff90e9a99fb800 x1873345652736640/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.317664:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fb800 with x1873345652736640 ext(2097152->2220031) 00010000:00010000:0.0:1786562532.317674:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.317691:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 12 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562532.317700:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99fb800 00000100:00100000:0.0:1786562532.317732:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5908 00000100:00100000:0.0:1786562532.317742:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652736640:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562532.340305:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.340347:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.340492:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736768 00000100:00100000:1.0:1786562532.340502:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736768 00000100:00100000:1.0:1786562532.340562:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652736896 00000100:00100000:1.0:1786562532.340566:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652736896 00000100:00100000:1.0:1786562532.340591:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17546 00000100:00100000:1.0:1786562532.340602:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652736768:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562532.340621:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.340650:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc77d expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.340678:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562532.340683:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562532.340694:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 16 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.340711:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 16 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.340725:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:1.0:1786562532.340771:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652736768:12345-192.168.204.29@tcp:101:cat.0 Request processed in 171us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.340779:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17546 00000100:00100000:1.0:1786562532.340798:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17547 00000100:00100000:1.0:1786562532.340806:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652736896:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562532.340812:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.340820:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e786 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc784 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.340841:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e786 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc784 expref: 16 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.340855:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e786 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc784 expref: 16 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.340868:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880e00, rc 0) 00000100:00100000:1.0:1786562532.340887:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652736896:12345-192.168.204.29@tcp:101:cat.0 Request processed in 82us (541us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562532.340893:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17547 00000100:00100000:1.0:1786562532.341426:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652736640:12345-192.168.204.29@tcp:4:cat.0 Request processed in 23685us (23963us total) trans 17179876038 rc 0/0 00000100:00100000:1.0:1786562532.341435:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5908 00002000:00100000:1.0:1786562532.341445:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2220031) req@ffff90e9a99fb800 x1873345652736640/t17179876038(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/448 e 0 to 0 dl 1786562543 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.341454:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fb800 with x1873345652736640 ext(2097152->2220031) 00010000:00010000:1.0:1786562532.341461:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 15 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.341475:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 15 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562532.341482:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99fb800 00000100:00100000:3.0:1786562532.344997:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.346720:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737024 00000100:00100000:1.0:1786562532.346732:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737024 00000100:00100000:1.0:1786562532.346798:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17548 00000100:00100000:1.0:1786562532.346808:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+30:64020:x1873345652737024:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562532.346830:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.346848:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc78b expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.346885:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.346893:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 3) 00010000:00010000:1.0:1786562532.346899:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:1.0:1786562532.346904:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.346939:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.346950:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.346964:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654844288:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562532.347067:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:1.0:1786562532.357729:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654844288:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.357768:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 31 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.357788:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880400, rc 0) 00000100:00100000:1.0:1786562532.357850:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+31:64020:x1873345652737024:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 11043us (12860us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.357860:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17548 00000100:00100000:3.0:1786562532.359177:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.360265:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737152 00000100:00100000:1.0:1786562532.360275:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737152 00010000:00010000:1.0:1786562532.360317:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 15 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.360354:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8551 00000100:00100000:1.0:1786562532.360374:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652737152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562532.360387:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562532.360406:0:35896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562530 -> 1786562531 00002000:00010000:1.0:1786562532.360410:0:35896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562530 -> 1786562531 00010000:00010000:1.0:1786562532.360415:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 15 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.360428:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 15 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.360454:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689e76a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2220031) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc768 expref: 15 pid: 37002 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.360470:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:1.0:1786562532.360475:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:1.0:1786562532.360484:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.360493:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.360529:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.360543:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654844416:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562532.360930:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562532.364125:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.364338:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654844416:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562532.364371:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562532.364418:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2348:x1873345652737152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4044us (5246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.364429:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8551 00000100:00100000:2.0:1786562532.365136:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737280 00000100:00100000:2.0:1786562532.365144:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737280 00002000:00100000:2.0:1786562532.365187:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88b7ed880 x1873345652737280/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.365207:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ed880 with x1873345652737280 ext(4194304->5185535) 00010000:00010000:2.0:1786562532.365216:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.365232:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562532.365240:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b7ed880 00000100:00100000:2.0:1786562532.365269:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5909 00000100:00100000:2.0:1786562532.365279:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2348:x1873345652737280:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562532.382834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.383119:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737408 00000100:00100000:1.0:1786562532.383128:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737408 00002000:00100000:1.0:1786562532.383172:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b11f800 x1873345652737408/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.383188:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11f800 with x1873345652737408 ext(2097152->3145727) 00002000:00010000:1.0:1786562532.383205:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11f800 00000100:00100000:1.0:1786562532.383233:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11409 00000100:00100000:1.0:1786562532.383244:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652737408:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562532.385823:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2348:x1873345652737280:12345-192.168.204.29@tcp:3:cat.0 Request processed in 20536us (21698us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1786562532.385836:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5909 00002000:00100000:2.0:1786562532.385850:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88b7ed880 x1873345652737280/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:H/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.385860:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ed880 with x1873345652737280 ext(4194304->5185535) 00010000:00010000:2.0:1786562532.385871:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.385891:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 14 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562532.385901:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b7ed880 00000100:00100000:1.0:1786562532.409334:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652737408:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 26081us (26497us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562532.409349:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11409 00002000:00100000:1.0:1786562532.409374:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88b11f800 x1873345652737408/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.409385:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11f800 with x1873345652737408 ext(2097152->3145727) 00002000:00010000:1.0:1786562532.409391:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11f800 00000100:00100000:3.0:1786562532.409571:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.409902:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.410152:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737536 00000100:00100000:1.0:1786562532.410161:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737536 00000100:00100000:1.0:1786562532.410209:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17549 00000100:00100000:1.0:1786562532.410218:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:64011:x1873345652737536:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562532.410234:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.410252:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc792 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.410279:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:1.0:1786562532.410284:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:1.0:1786562532.410293:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.410314:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.410329:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880e00, rc 0) 00000100:00100000:1.0:1786562532.410355:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64011:x1873345652737536:12345-192.168.204.29@tcp:101:cat.0 Request processed in 139us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.410373:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17549 00000100:00100000:2.0:1786562532.410826:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737664 00000100:00100000:2.0:1786562532.410832:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737664 00010000:00010000:2.0:1786562532.410854:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 15 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.410892:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8552 00000100:00100000:2.0:1786562532.410899:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652737664:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562532.410909:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562532.410930:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 15 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.410942:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 15 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.410960:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689e771 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc76f expref: 15 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.410973:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:2.0:1786562532.410976:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:2.0:1786562532.410982:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 30 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.410991:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 30 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.411064:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 30 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.411078:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654844544:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562532.411133:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562532.415317:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654844544:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562532.415345:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.415408:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652737664:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4508us (5504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.415419:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8552 00000100:00100000:3.0:1786562532.422201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.422263:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.422372:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737792 00000100:00100000:1.0:1786562532.422383:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737792 00000100:00100000:1.0:1786562532.422442:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17550 00000100:00100000:1.0:1786562532.422452:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652737792:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562532.422470:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.422488:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689e79b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc799 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.422536:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689e79b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc799 expref: 15 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.422937:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689e79b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc799 expref: 15 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.422954:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880600, rc 0) 00000100:00100000:1.0:1786562532.423059:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652737792:12345-192.168.204.29@tcp:101:cat.0 Request processed in 608us (867us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562532.423070:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17550 00000100:00100000:0.0:1786562532.423148:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652737920 00000100:00100000:0.0:1786562532.423154:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652737920 00002000:00100000:0.0:1786562532.423186:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (4104192->4108287) req@ffff90e88b11df80 x1873345652737920/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.423196:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11df80 with x1873345652737920 ext(4104192->4108287) 00002000:00010000:0.0:1786562532.423201:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11df80 00000100:00100000:0.0:1786562532.423225:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11410 00000100:00100000:0.0:1786562532.423232:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652737920:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562532.423385:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652737920:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 152us (1121us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562532.423392:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11410 00002000:00100000:0.0:1786562532.423398:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (4104192->4108287) req@ffff90e88b11df80 x1873345652737920/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/4536 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.423406:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11df80 with x1873345652737920 ext(4104192->4108287) 00002000:00010000:0.0:1786562532.423409:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b11df80 00000100:00100000:1.0:1786562532.452516:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.452574:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.452663:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.452769:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738176 00000100:00100000:2.0:1786562532.452779:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738176 00000100:00100000:2.0:1786562532.452828:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17551 00000100:00100000:2.0:1786562532.452837:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+17:64020:x1873345652738176:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562532.452856:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562532.452875:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7a0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.452907:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.452918:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 9 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.452927:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 17 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.452935:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(2 0) 00010000:00010000:2.0:1786562532.452940:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 2) 00010000:00010000:2.0:1786562532.452945:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->3719167] (req 3145728->3719167) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 18 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.452980:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 17 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.452993:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 17 pid: 29965 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.453026:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654844672:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562532.453111:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 9 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.453121:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 9 pid: 8368 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.453131:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654844800:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562532.453160:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.453169:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.453177:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654844928:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562532.453197:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562532.454047:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738048 00000100:00100000:3.0:1786562532.454055:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738048 00002000:00100000:3.0:1786562532.454096:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e88b51aa00 x1873345652738048/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.454107:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51aa00 with x1873345652738048 ext(5181440->5185535) 00002000:00010000:3.0:1786562532.454112:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51aa00 00000100:00100000:3.0:1786562532.454154:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11411 00000100:00100000:3.0:1786562532.454162:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652738048:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562532.454332:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652738048:12345-192.168.204.29@tcp:3:cat.0 Request processed in 170us (1835us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562532.454341:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11411 00002000:00100000:3.0:1786562532.454347:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e88b51aa00 x1873345652738048/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/4536 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.454368:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51aa00 with x1873345652738048 ext(5181440->5185535) 00002000:00010000:3.0:1786562532.454372:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51aa00 00000100:00100000:3.0:1786562532.455404:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738304 00000100:00100000:3.0:1786562532.455410:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738304 00000100:00100000:3.0:1786562532.455446:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17552 00000100:00100000:3.0:1786562532.455454:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+31:64017:x1873345652738304:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562532.455467:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562532.455483:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7a7 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.455509:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 32 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.455530:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 3) 00010000:00010000:3.0:1786562532.455534:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 3) 00010000:00010000:3.0:1786562532.455539:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.455577:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 32 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.455587:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 32 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.455601:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654845056:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562532.455987:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562532.460279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.460408:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654844672:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562532.460422:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654844800:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562532.460432:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654844928:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562532.460466:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->3719167] (req 3145728->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 18 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.460486:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9a00, rc 0) 00000100:00100000:2.0:1786562532.460556:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+18:64020:x1873345652738176:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 7720us (7981us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.460917:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17551 00000100:00100000:3.0:1786562532.461732:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738432 00000100:00100000:3.0:1786562532.461742:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738432 00010000:00010000:3.0:1786562532.461778:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 18 pid: 29965 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.461817:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8553 00000100:00100000:3.0:1786562532.461827:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652738432:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562532.461840:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562532.461861:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 18 pid: 29965 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.461874:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 18 pid: 29965 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.461897:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001920fd48/0x5c655bf66689e5fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc696 expref: 18 pid: 29965 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.461910:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562532.461945:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652738432:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 119us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.461952:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8553 00000100:00100000:3.0:1786562532.472550:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654845056:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562532.472601:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.472954:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22600, rc 0) 00000100:00100000:3.0:1786562532.473055:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+32:64017:x1873345652738304:12345-192.168.204.29@tcp:101:cat.0 Request processed in 17600us (20390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.473065:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17552 00000100:00100000:0.0:1786562532.481266:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.481306:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.481384:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.482987:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738688 00000100:00100000:3.0:1786562532.483000:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738688 00010000:00010000:3.0:1786562532.483079:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.483121:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738816 00000100:00100000:3.0:1786562532.483125:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738816 00010000:00010000:3.0:1786562532.483138:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 10 pid: 8368 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.483159:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8554 00000100:00100000:3.0:1786562532.483169:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652738688:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562532.483184:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562532.483207:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483221:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483249:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e580 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc649 expref: 18 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483270:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562532.483323:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652738688:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 155us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.483330:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8554 00000100:00100000:3.0:1786562532.483347:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8555 00000100:00100000:3.0:1786562532.483365:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652738816:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562532.483374:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562532.483383:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 10 pid: 8368 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483394:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 10 pid: 8368 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483407:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689e667 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6c7 expref: 10 pid: 8368 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483419:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1786562532.483423:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1786562532.483431:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483445:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.483484:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.483498:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654845184:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562532.483550:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562532.484401:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738560 00000100:00100000:1.0:1786562532.484409:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738560 00002000:00100000:1.0:1786562532.484452:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (4104192->4194303) req@ffff90e98873fb80 x1873345652738560/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.484475:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873fb80 with x1873345652738560 ext(4104192->4194303) 00010000:00010000:1.0:1786562532.484483:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 32 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.484498:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 32 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562532.484516:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98873fb80 00000100:00100000:1.0:1786562532.484555:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5910 00000100:00100000:1.0:1786562532.484564:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652738560:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:3.0:1786562532.499376:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652738560:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 14791us (18100us total) trans 17179876039 rc 0/0 00000100:00100000:3.0:1786562532.499390:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5910 00002000:00100000:3.0:1786562532.499403:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (4104192->4194303) req@ffff90e98873fb80 x1873345652738560/t17179876039(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/448 e 0 to 0 dl 1786562543 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562532.499415:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873fb80 with x1873345652738560 ext(4104192->4194303) 00010000:00010000:3.0:1786562532.499427:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 34 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.499445:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 34 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562532.499454:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98873fb80 00000100:00100000:3.0:1786562532.499524:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654845184:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562532.499545:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562532.499569:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652738816:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 16215us (18184us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.499579:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8555 00000100:00100000:0.0:1786562532.518591:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.519068:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652738944 00000100:00100000:3.0:1786562532.519078:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652738944 00010000:00010000:3.0:1786562532.519118:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 34 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.519162:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8556 00000100:00100000:3.0:1786562532.519173:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652738944:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562532.519189:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562532.519212:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 34 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.519227:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 34 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.519251:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051559b7a/0x5c655bf66689e78d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4104192->4194303] (req 4104192->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc78b expref: 34 pid: 29967 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.519268:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 3) 00010000:00010000:3.0:1786562532.519273:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 3) 00010000:00010000:3.0:1786562532.519281:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 33 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.519292:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 33 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.519330:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 33 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.519344:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654845312:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562532.519445:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562532.534449:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.534566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.534657:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652739072 00000100:00100000:0.0:1786562532.534666:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652739072 00002000:00100000:0.0:1786562532.534717:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3715072->3719167) req@ffff90e9a99fb480 x1873345652739072/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.534729:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fb480 with x1873345652739072 ext(3715072->3719167) 00002000:00010000:0.0:1786562532.534734:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99fb480 00000100:00100000:0.0:1786562532.534762:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652739200 00000100:00100000:0.0:1786562532.534766:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652739200 00002000:00100000:0.0:1786562532.534782:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9a99fa680 x1873345652739200/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.534790:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fa680 with x1873345652739200 ext(3145728->4194303) 00002000:00010000:0.0:1786562532.534794:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a99fa680 00000100:00100000:0.0:1786562532.534814:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11412 00000100:00100000:0.0:1786562532.534824:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652739072:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562532.535041:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652739072:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 217us (601us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562532.535050:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11412 00002000:00100000:0.0:1786562532.535057:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3715072->3719167) req@ffff90e9a99fb480 x1873345652739072/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/4536 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.535066:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fb480 with x1873345652739072 ext(3715072->3719167) 00002000:00010000:0.0:1786562532.535069:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99fb480 00000100:00100000:0.0:1786562532.535087:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11413 00000100:00100000:0.0:1786562532.535094:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652739200:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562532.536224:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654845312:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562532.536250:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562532.536289:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+35:2348:x1873345652738944:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 17117us (17707us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.536299:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8556 00000100:00100000:2.0:1786562532.549204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.554226:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652739456 00000100:00100000:1.0:1786562532.554241:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652739456 00000100:00100000:1.0:1786562532.554317:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6249 00000100:00100000:1.0:1786562532.554327:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+510:64020:x1873345652739456:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562532.554598:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+511:64020:x1873345652739456:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 271us (5404us total) trans 8589950593 rc 0/0 00000100:00100000:1.0:1786562532.554607:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6249 00000100:00100000:3.0:1786562532.559758:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.559906:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+33:2348:x1873345652739200:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 24810us (25337us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562532.559920:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11413 00002000:00100000:0.0:1786562532.559933:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9a99fa680 x1873345652739200/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562532.559944:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fa680 with x1873345652739200 ext(3145728->4194303) 00002000:00010000:0.0:1786562532.559951:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a99fa680 00000100:00100000:1.0:1786562532.560067:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652739712 00000100:00100000:1.0:1786562532.560075:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652739712 00000100:00100000:1.0:1786562532.560129:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17058 00000100:00100000:1.0:1786562532.560138:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64024:x1873345652739712:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562532.560157:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.560176:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e7b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7ae expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.560244:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.560258:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.560269:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.560284:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.560292:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.560299:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562256:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562280:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562291:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562532.562302:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562532.562411:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562418:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562425:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562430:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562532.562435:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562443:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562454:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562532.562457:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562532.562461:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562467:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689e7b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562485:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562491:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562496:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562500:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562532.562503:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562508:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562515:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2f00) 00010000:00010000:1.0:1786562532.562517:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562532.562520:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562526:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689e7be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562571:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689e7b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562585:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.562597:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562532.562599:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562532.562601:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881c00, rc 0) 00000100:00100000:1.0:1786562532.565231:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:64024:x1873345652739712:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 5084us (5472us total) trans 8589950594 rc 0/0 00000100:00100000:1.0:1786562532.565246:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17058 00000100:00100000:3.0:1786562532.596080:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.596683:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652739840 00000100:00100000:2.0:1786562532.596695:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652739840 00002000:00100000:2.0:1786562532.596752:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (3719168->4194303) req@ffff90e9bfe93800 x1873345652739840/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.596764:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe93800 with x1873345652739840 ext(3719168->4194303) 00002000:00010000:2.0:1786562532.596770:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe93800 00000100:00100000:2.0:1786562532.596805:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11414 00000100:00100000:2.0:1786562532.596815:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652739840:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562532.616553:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652739840:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 19729us (20471us total) trans 0 rc 475136/475136 00000100:00100000:2.0:1786562532.616568:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11414 00002000:00100000:2.0:1786562532.616582:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (3719168->4194303) req@ffff90e9bfe93800 x1873345652739840/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 475136/475136 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.616593:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe93800 with x1873345652739840 ext(3719168->4194303) 00002000:00010000:2.0:1786562532.616599:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe93800 00000100:00100000:3.0:1786562532.689980:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.690091:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652739968 00000100:00100000:1.0:1786562532.690100:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652739968 00002000:00100000:1.0:1786562532.690147:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bfe90a80 x1873345652739968/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.690158:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90a80 with x1873345652739968 ext(4194304->5185535) 00002000:00010000:1.0:1786562532.690164:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfe90a80 00000100:00100000:1.0:1786562532.690186:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11415 00000100:00100000:1.0:1786562532.690195:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652739968:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562532.708476:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652739968:12345-192.168.204.29@tcp:3:cat.0 Request processed in 18271us (18493us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562532.708491:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11415 00002000:00100000:1.0:1786562532.708505:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bfe90a80 x1873345652739968/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562532.708514:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe90a80 with x1873345652739968 ext(4194304->5185535) 00002000:00010000:1.0:1786562532.708520:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfe90a80 00000100:00100000:3.0:1786562532.713067:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.713099:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.715741:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740096 00000100:00100000:2.0:1786562532.715754:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740096 00000100:00100000:2.0:1786562532.715817:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740224 00000100:00100000:2.0:1786562532.715820:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740224 00000100:00100000:2.0:1786562532.715843:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17553 00000100:00100000:2.0:1786562532.715851:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652740096:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562532.715869:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562532.715887:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7b5 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.715912:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(4 3) 00010000:00010000:2.0:1786562532.715916:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 3) 00010000:00010000:2.0:1786562532.715926:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.715944:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.715957:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:2.0:1786562532.716041:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652740096:12345-192.168.204.29@tcp:101:cat.0 Request processed in 190us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.716048:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17553 00000100:00100000:2.0:1786562532.716065:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17554 00000100:00100000:2.0:1786562532.716072:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652740224:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562532.716079:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562532.716091:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689e7da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7bc expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.716134:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654845440:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562532.716188:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1786562532.725797:0:28861:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562529 -> 1786562531 00002000:00010000:2.0:1786562532.725806:0:28861:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562530 -> 1786562532 00002000:00010000:2.0:1786562532.725808:0:28861:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562529 -> 1786562531 00000100:00100000:2.0:1786562532.725832:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654845440:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562532.725871:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689e7da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7bc expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.725894:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689e7da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7bc expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.725919:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:2.0:1786562532.725984:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652740224:12345-192.168.204.29@tcp:101:cat.0 Request processed in 9911us (12883us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562532.725994:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17554 00000100:00100000:3.0:1786562532.777130:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.779895:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740480 00000100:00100000:0.0:1786562532.779908:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740480 00000100:00100000:0.0:1786562532.779980:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6250 00000100:00100000:0.0:1786562532.779991:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+511:64017:x1873345652740480:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1786562532.780245:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+512:64017:x1873345652740480:12345-192.168.204.29@tcp:35:cat.0 Request processed in 256us (3125us total) trans 8589950595 rc 0/0 00000100:00100000:0.0:1786562532.780253:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6250 00000100:00100000:3.0:1786562532.829568:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.829776:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740608 00000100:00100000:2.0:1786562532.829787:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740608 00002000:00100000:2.0:1786562532.829837:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9bfe91f80 x1873345652740608/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.829856:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91f80 with x1873345652740608 ext(1048576->2097151) 00002000:00010000:2.0:1786562532.829862:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfe91f80 00000100:00100000:2.0:1786562532.829894:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11416 00000100:00100000:2.0:1786562532.829905:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652740608:12345-192.168.204.29@tcp:3:cat.0 00000001:00080000:1.0:1786562532.844103:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843558 is committed 00000001:00080000:1.0:1786562532.844124:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843548 is committed 00000001:00080000:1.0:1786562532.844139:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843528 is committed 00000001:00080000:1.0:1786562532.844156:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843552 is committed 00000001:00080000:1.0:1786562532.844173:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843529 is committed 00000001:00080000:1.0:1786562532.844178:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843557 is committed 00000001:00080000:1.0:1786562532.844186:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843556 is committed 00000001:00080000:1.0:1786562532.844198:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843532 is committed 00000100:00100000:3.0:1786562532.849180:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.849287:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740736 00000100:00100000:0.0:1786562532.849296:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740736 00000100:00100000:0.0:1786562532.849361:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17059 00000100:00100000:0.0:1786562532.849371:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64031:x1873345652740736:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562532.849391:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562532.849411:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e7e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7c3 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849474:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849488:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849498:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849512:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849519:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849524:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849885:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849897:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849905:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562532.849942:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:0.0:1786562532.849946:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562532.849964:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849976:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849987:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.849992:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.850000:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853084:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562532.853093:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853107:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853132:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562532.853136:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562532.853142:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853149:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689e7e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853176:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853183:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853189:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853196:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562532.853199:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853205:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853213:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562532.853216:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562532.853220:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853226:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e7ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853290:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e7e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853307:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 16 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.853315:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562532.853319:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562532.853321:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:2.0:1786562532.853698:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64031:x1873345652740736:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4325us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.853709:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17059 00000100:00100000:0.0:1786562532.864597:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.864800:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740864 00000100:00100000:3.0:1786562532.864810:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740864 00000100:00100000:3.0:1786562532.864867:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17555 00000100:00100000:3.0:1786562532.864876:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64024:x1873345652740864:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562532.864892:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562532.864908:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7ca expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.864939:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 32 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.864947:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.864954:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 18 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.864961:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 3) 00010000:00010000:3.0:1786562532.864965:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 3) 00010000:00010000:3.0:1786562532.864971:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2396160->2977791] (req 2396160->2977791) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.865000:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 18 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.865052:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 18 pid: 28861 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.865066:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654845568:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562532.865159:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.865173:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.865181:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654845696:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562532.865209:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 32 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.865218:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 32 pid: 6660 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.865226:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654845824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562532.865246:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562532.869281:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2349:x1873345652740608:12345-192.168.204.29@tcp:3:cat.0 Request processed in 39367us (39712us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562532.869294:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11416 00002000:00100000:2.0:1786562532.869308:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9bfe91f80 x1873345652740608/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/440 e 0 to 0 dl 1786562543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.869319:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91f80 with x1873345652740608 ext(1048576->2097151) 00002000:00010000:2.0:1786562532.869325:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfe91f80 00000100:00100000:1.0:1786562532.887835:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.887883:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.887908:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.888045:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652740992 00000100:00100000:3.0:1786562532.888054:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652740992 00000100:00100000:3.0:1786562532.888108:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652741120 00000100:00100000:3.0:1786562532.888111:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652741120 00000100:00100000:3.0:1786562532.888129:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652741248 00000100:00100000:3.0:1786562532.888131:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652741248 00000100:00100000:3.0:1786562532.888151:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17556 00000100:00100000:3.0:1786562532.888161:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652740992:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562532.888179:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562532.888198:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7d1 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.888225:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=1s v=(1 1) 00010000:00010000:3.0:1786562532.888231:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562532.888241:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 18 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.888257:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 18 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.888271:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:3.0:1786562532.888317:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652740992:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 157us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.888325:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17556 00000100:00100000:3.0:1786562532.888341:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17557 00000100:00100000:3.0:1786562532.888356:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652741120:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562532.888363:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562532.888370:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689e80b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7d8 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.888382:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 3) 00010000:00010000:3.0:1786562532.888392:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689e80b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d8 expref: 18 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.888407:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689e80b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d8 expref: 18 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.888418:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:3.0:1786562532.888435:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652741120:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 89us (552us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562532.888441:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17557 00000100:00100000:3.0:1786562532.888452:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17558 00000100:00100000:3.0:1786562532.888457:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652741248:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562532.888463:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562532.888472:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e812 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7df expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562532.888509:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654845952:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562532.888552:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562532.888584:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654845824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562532.902508:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.902654:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652741504 00000100:00100000:0.0:1786562532.902663:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652741504 00000100:00100000:0.0:1786562532.902729:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17060 00000100:00100000:0.0:1786562532.902739:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+512:64033:x1873345652741504:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562532.902764:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562532.902783:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689e819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7e6 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.902856:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.902870:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.902881:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.902896:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.902903:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.902910:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903320:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903331:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903339:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562532.903358:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562532.903448:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903457:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903464:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903470:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562532.903475:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903483:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903495:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562532.903498:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562532.903503:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903509:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689e820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903522:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903528:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903534:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903544:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562532.903547:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903553:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903560:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562532.903563:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562532.903566:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903571:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689e827 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903609:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689e819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 515 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903623:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 514 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.903631:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562532.903633:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562532.903635:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269e00, rc 0) 00000100:00100000:0.0:1786562532.903693:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+514:64033:x1873345652741504:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 955us (1194us total) trans 8589950596 rc 0/0 00000100:00100000:0.0:1786562532.903701:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17060 00000100:00100000:0.0:1786562532.911479:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.911515:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562532.911650:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654845568:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562532.911665:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654845696:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562532.911703:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2396160->2977791] (req 2396160->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.911724:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:3.0:1786562532.911784:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64024:x1873345652740864:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 46909us (47195us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562532.911793:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17555 00000100:00100000:2.0:1786562532.911981:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652741760 00000100:00100000:2.0:1786562532.911989:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652741760 00010000:00010000:2.0:1786562532.912048:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 16 pid: 28861 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.912082:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652741632 00000100:00100000:2.0:1786562532.912085:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652741632 00010000:00010000:2.0:1786562532.912098:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 33 pid: 6660 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.912125:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8557 00000100:00100000:2.0:1786562532.912134:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652741760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562532.912146:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562532.912168:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 16 pid: 28861 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.912181:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 16 pid: 28861 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.912201:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf66689e7d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7b5 expref: 16 pid: 28861 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.912226:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.912248:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652741760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 116us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.912255:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8557 00000100:00100000:2.0:1786562532.912269:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8558 00000100:00100000:2.0:1786562532.912275:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652741632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562532.912283:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562532.912291:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 33 pid: 6660 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.912300:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 33 pid: 6660 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.912313:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689e778 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc776 expref: 33 pid: 6660 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.912322:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.912339:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652741632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 64us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.912355:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8558 00000100:00100000:3.0:1786562532.914372:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654845952:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562532.914408:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e812 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7df expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.914435:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3984d42/0x5c655bf66689e812 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7df expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562532.914448:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9c00, rc 0) 00000100:00100000:3.0:1786562532.914495:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652741248:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 26036us (26584us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562532.914503:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17558 00000100:00100000:0.0:1786562532.927154:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.927262:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652741888 00000100:00100000:2.0:1786562532.927272:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652741888 00000100:00100000:2.0:1786562532.927327:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17559 00000100:00100000:2.0:1786562532.927336:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64029:x1873345652741888:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562532.927367:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562532.927386:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7ed expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.927416:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 3) 00010000:00010000:2.0:1786562532.927424:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->2977791] (req 2396160->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.927432:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 3) 00010000:00010000:2.0:1786562532.927437:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.927475:0:29964:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->2977791] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.927495:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.927508:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:2.0:1786562532.927578:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64029:x1873345652741888:12345-192.168.204.29@tcp:101:cat.0 Request processed in 243us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.927586:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17559 00000100:00100000:0.0:1786562532.944933:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.945047:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742272 00000100:00100000:1.0:1786562532.945057:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742272 00010000:00010000:1.0:1786562532.945094:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.945135:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8559 00000100:00100000:1.0:1786562532.945145:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652742272:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562532.945163:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562532.945188:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.945203:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.945226:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e7a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a7 expref: 32 pid: 29966 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.945242:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:1.0:1786562532.945248:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:1.0:1786562532.945257:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.945266:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.945304:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.945317:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x70000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 15 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.945330:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654846208:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562532.945411:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bcecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562532.948430:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.948545:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742144 00000100:00100000:1.0:1786562532.948555:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742144 00000100:00100000:1.0:1786562532.948605:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17061 00000100:00100000:1.0:1786562532.948635:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64031:x1873345652742144:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562532.948655:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.948684:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e843 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7f4 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948784:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948801:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948810:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948818:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 513 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948826:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 6/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948859:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 513 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948870:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 513 pid: 35929 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.948884:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654846336:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.948977:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.948987:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 17 pid: 33113 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.948996:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654846464:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.949063:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.949078:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 18 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.949088:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654846592:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562532.949111:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562532.956982:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654846208:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562532.957055:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.957105:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652742272:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11961us (12182us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.957116:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8559 00000100:00100000:0.0:1786562532.958380:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.958412:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.958427:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.958443:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562532.958663:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742400 00000100:00100000:2.0:1786562532.958672:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742400 00002000:00100000:2.0:1786562532.958720:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2396160->2400255) req@ffff90e98873c380 x1873345652742400/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/0 e 0 to 0 dl 1786562543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.958731:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c380 with x1873345652742400 ext(2396160->2400255) 00010000:00010000:2.0:1786562532.958741:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.958757:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562532.958765:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98873c380 00000100:00100000:2.0:1786562532.958795:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5911 00000100:00100000:2.0:1786562532.958806:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652742400:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562532.958992:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652742400:12345-192.168.204.29@tcp:3:cat.0 Request processed in 187us (618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562532.958999:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5911 00002000:00100000:2.0:1786562532.959028:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2396160->2400255) req@ffff90e98873c380 x1873345652742400/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:3/0 lens 488/4536 e 0 to 0 dl 1786562543 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562532.959037:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c380 with x1873345652742400 ext(2396160->2400255) 00010000:00010000:2.0:1786562532.959043:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959053:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562532.959060:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98873c380 00000100:00100000:2.0:1786562532.959082:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742656 00000100:00100000:2.0:1786562532.959086:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742656 00010000:00010000:2.0:1786562532.959103:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 19 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.959125:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742528 00000100:00100000:2.0:1786562532.959128:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742528 00010000:00010000:2.0:1786562532.959140:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 514 pid: 35929 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.959155:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742784 00000100:00100000:2.0:1786562532.959158:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742784 00010000:00010000:2.0:1786562532.959169:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 18 pid: 33113 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.959185:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8560 00000100:00100000:2.0:1786562532.959192:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:2348:x1873345652742656:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562532.959203:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562532.959210:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 19 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959221:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 19 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959242:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562532.959247:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959256:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959261:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.959287:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:2348:x1873345652742656:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 96us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.959294:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8560 00000100:00100000:2.0:1786562532.959307:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8561 00000100:00100000:2.0:1786562532.959314:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+514:2348:x1873345652742528:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562532.959322:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562532.959327:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 514 pid: 35929 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959337:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 514 pid: 35929 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959359:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562532.959363:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959370:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959375:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.959394:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+514:2348:x1873345652742528:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 81us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.959400:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8561 00000100:00100000:2.0:1786562532.959412:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8562 00000100:00100000:2.0:1786562532.959419:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652742784:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562532.959425:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562532.959430:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 18 pid: 33113 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959438:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 18 pid: 33113 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959449:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562532.959453:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959462:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959470:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562532.959487:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562532.959503:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652742784:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 85us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562532.959510:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8562 00010000:00010000:1.0:1786562532.959969:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689e82e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7e6 expref: 513 pid: 35929 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.959987:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654846336:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.960001:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689e7f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7c3 expref: 17 pid: 33113 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.960048:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654846464:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.960060:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689e7c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ae expref: 18 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.960071:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654846592:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562532.960098:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.960106:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.960112:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562532.960135:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562532.960264:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e843 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.960278:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.960286:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562532.960289:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562532.960291:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988267e00, rc 0) 00000100:00100000:1.0:1786562532.960318:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64031:x1873345652742144:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11705us (11897us total) trans 8589950597 rc 0/0 00000100:00100000:1.0:1786562532.960324:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17061 00000100:00100000:2.0:1786562532.984690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562532.984800:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652742912 00000100:00100000:1.0:1786562532.984810:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652742912 00000100:00100000:1.0:1786562532.984871:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17062 00000100:00100000:1.0:1786562532.984881:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64031:x1873345652742912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562532.984905:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562532.984924:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e858 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc7fb expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.985052:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.985068:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.985082:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.985127:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.985138:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 18 pid: 33115 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562532.985152:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654846720:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562532.985236:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce900 going to sleep for 11 seconds 00000100:00100000:0.0:1786562532.993418:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654846720:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562532.993456:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562532.998324:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562532.998428:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652743040 00000100:00100000:0.0:1786562532.998439:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652743040 00010000:00010000:0.0:1786562532.998478:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 19 pid: 33115 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562532.998519:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8563 00000100:00100000:0.0:1786562532.998528:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652743040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562532.998550:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562532.998557:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 19 pid: 33115 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.998569:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 19 pid: 33115 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.998593:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689e84a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7f4 expref: 19 pid: 33115 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.998630:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562532.998636:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.998647:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.998654:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562532.998695:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562532.998750:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652743040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 223us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562532.998758:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8563 00010000:00010000:1.0:1786562532.998993:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.999002:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562532.999077:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562532.999082:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562532.999102:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.999142:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267000/0x5c655bf66689e858 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.999159:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 17 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562532.999172:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562532.999175:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562532.999177:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:1.0:1786562532.999217:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64031:x1873345652742912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 14338us (14535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562532.999225:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17062 00000100:00100000:2.0:1786562533.002856:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.002938:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652743168 00000100:00100000:1.0:1786562533.002946:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652743168 00002000:00100000:1.0:1786562533.003035:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2973696->2977791) req@ffff90e9a99fa300 x1873345652743168/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.003047:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fa300 with x1873345652743168 ext(2973696->2977791) 00010000:00010000:1.0:1786562533.003056:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.003072:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562533.003081:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99fa300 00000100:00100000:1.0:1786562533.003110:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5912 00000100:00100000:1.0:1786562533.003121:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652743168:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562533.003303:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652743168:12345-192.168.204.29@tcp:3:cat.0 Request processed in 184us (458us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562533.003311:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5912 00002000:00100000:1.0:1786562533.003317:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2973696->2977791) req@ffff90e9a99fa300 x1873345652743168/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/4536 e 0 to 0 dl 1786562544 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.003326:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fa300 with x1873345652743168 ext(2973696->2977791) 00010000:00010000:1.0:1786562533.003331:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.003343:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562533.003358:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99fa300 00000100:00080000:2.0:1786562533.003604:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562533.034318:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.034368:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.034407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562533.034507:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652743552 00000100:00100000:0.0:1786562533.034517:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652743552 00000100:00100000:0.0:1786562533.034575:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652743680 00000100:00100000:0.0:1786562533.034578:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652743680 00000100:00100000:0.0:1786562533.034598:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17560 00000100:00100000:0.0:1786562533.034607:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652743552:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562533.034637:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562533.034655:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689e866 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc802 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.034692:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689e866 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc802 expref: 18 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.034718:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689e866 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc802 expref: 18 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.034732:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268000, rc 0) 00000100:00100000:0.0:1786562533.034783:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652743552:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 176us (414us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562533.034789:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17560 00000100:00100000:0.0:1786562533.034806:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17561 00000100:00100000:0.0:1786562533.034813:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652743680:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562533.034820:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562533.034830:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d788ddc/0x5c655bf66689e86d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc809 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562533.034870:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654846848:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562533.034919:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562533.035174:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652743424 00000100:00100000:1.0:1786562533.035178:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652743424 00000100:00100000:1.0:1786562533.035226:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6251 00000100:00100000:1.0:1786562533.035234:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:64024:x1873345652743424:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562533.035492:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:64024:x1873345652743424:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 258us (1184us total) trans 8589950598 rc 0/0 00000100:00100000:1.0:1786562533.035498:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6251 00000100:00080000:2.0:1786562533.035564:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562533.039574:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.039808:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652743808 00000100:00100000:3.0:1786562533.039817:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652743808 00002000:00100000:3.0:1786562533.039866:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (2396160->2977791) req@ffff90e9a99f9c00 x1873345652743808/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.039877:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f9c00 with x1873345652743808 ext(2396160->2977791) 00010000:00010000:3.0:1786562533.039887:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.039903:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 16 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562533.039911:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99f9c00 00000100:00100000:3.0:1786562533.039943:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5913 00000100:00100000:3.0:1786562533.039954:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2348:x1873345652743808:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562533.056290:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562533.056414:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654846848:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562533.056452:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d788ddc/0x5c655bf66689e86d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc809 expref: 13 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.056477:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d788ddc/0x5c655bf66689e86d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc809 expref: 13 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.056495:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562533.056545:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652743680:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 21731us (22136us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562533.056565:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17561 00000100:00100000:3.0:1786562533.057912:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652744064 00000100:00100000:3.0:1786562533.057924:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652744064 00000100:00100000:3.0:1786562533.058032:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17063 00000100:00100000:3.0:1786562533.058046:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+513:64036:x1873345652744064:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562533.058070:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562533.058091:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc810 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058159:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058173:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058183:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058198:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058204:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058210:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058564:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058575:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.058582:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562533.058590:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562533.062863:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062882:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062891:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062897:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af415600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562533.062902:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062910:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062926:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562533.062929:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562533.062933:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062940:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689e87b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062957:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062969:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062975:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062980:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9ba9d9c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562533.062982:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062988:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.062994:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab100) 00010000:00010000:3.0:1786562533.062997:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562533.062999:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.063024:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9c00/0x5c655bf66689e882 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.063082:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689e874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 516 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.063098:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 515 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.063106:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562533.063109:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562533.063112:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:3.0:1786562533.063180:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+515:64036:x1873345652744064:12345-192.168.204.29@tcp:101:cat.0 Request processed in 5138us (6903us total) trans 8589950599 rc 0/0 00000100:00100000:3.0:1786562533.063189:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17063 00000100:00080000:0.0:1786562533.063781:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562533.093213:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562533.103117:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.104451:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2348:x1873345652743808:12345-192.168.204.29@tcp:4:cat.0 Request processed in 64493us (64878us total) trans 17179876040 rc 0/0 00000100:00100000:1.0:1786562533.104465:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5913 00002000:00100000:1.0:1786562533.104479:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (2396160->2977791) req@ffff90e9a99f9c00 x1873345652743808/t17179876040(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/448 e 0 to 0 dl 1786562544 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.104489:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f9c00 with x1873345652743808 ext(2396160->2977791) 00010000:00010000:1.0:1786562533.104501:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.104526:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562533.104534:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99f9c00 00000100:00100000:2.0:1786562533.104907:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652744320 00000100:00100000:2.0:1786562533.104915:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652744320 00000100:00100000:2.0:1786562533.104964:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17064 00000100:00100000:2.0:1786562533.104974:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64031:x1873345652744320:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562533.104991:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562533.105038:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e897 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc817 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105121:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105136:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105148:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105159:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105166:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105173:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105178:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb3f6400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562533.105182:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105189:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105199:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562533.105202:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562533.105205:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105211:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6400/0x5c655bf66689e89e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105238:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e897 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc817 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105253:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562533.105255:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562533.105259:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689e897 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc817 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.105278:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:2.0:1786562533.105304:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64031:x1873345652744320:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 332us (2197us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562533.105310:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17064 00000100:00100000:3.0:1786562533.118597:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.118976:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652744448 00000100:00100000:1.0:1786562533.118986:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652744448 00000100:00100000:1.0:1786562533.119137:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17562 00000100:00100000:1.0:1786562533.119147:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652744448:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562533.119164:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562533.119182:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e8a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc81e expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.119216:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e8a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc81e expref: 32 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.119234:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689e8a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc81e expref: 32 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.119247:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365200, rc 0) 00000100:00100000:1.0:1786562533.119307:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652744448:12345-192.168.204.29@tcp:101:cat.0 Request processed in 162us (720us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562533.119315:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17562 00000100:00100000:3.0:1786562533.124134:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.124277:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652744576 00000100:00100000:2.0:1786562533.124285:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652744576 00010000:00010000:2.0:1786562533.124320:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.124367:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8564 00000100:00100000:2.0:1786562533.124377:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2348:x1873345652744576:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.124391:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1786562533.124410:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562531 -> 1786562532 00002000:00010000:2.0:1786562533.124413:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562531 -> 1786562532 00010000:00010000:2.0:1786562533.124419:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.124433:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.124465:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689e7fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2396160->4194303] (req 2396160->2977791) gid 0 flags: 0x44801000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ca expref: 18 pid: 28862 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.124483:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:2.0:1786562533.124488:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:2.0:1786562533.124495:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.124505:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.124542:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.124556:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654846976:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562533.124635:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562533.130799:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.130942:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652744832 00000100:00100000:2.0:1786562533.130953:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652744832 00000100:00100000:2.0:1786562533.130998:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6252 00000100:00100000:2.0:1786562533.131034:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64031:x1873345652744832:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562533.131265:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64031:x1873345652744832:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 256us (473us total) trans 8589950600 rc 0/0 00000100:00100000:2.0:1786562533.131273:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6252 00000100:00080000:0.0:1786562533.136333:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562533.138674:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654846976:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562533.138699:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.138756:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652744576:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 14380us (14632us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.138767:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8564 00000100:00100000:1.0:1786562533.165931:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.166049:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652744960 00000100:00100000:3.0:1786562533.166060:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652744960 00002000:00100000:3.0:1786562533.166111:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88bf04380 x1873345652744960/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.166123:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04380 with x1873345652744960 ext(2097152->3145727) 00002000:00010000:3.0:1786562533.166129:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04380 00000100:00100000:3.0:1786562533.166152:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11417 00000100:00100000:3.0:1786562533.166161:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652744960:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562533.201729:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.201904:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745088 00000100:00100000:2.0:1786562533.201914:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745088 00000100:00100000:2.0:1786562533.201970:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17563 00000100:00100000:2.0:1786562533.201980:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+31:64036:x1873345652745088:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562533.201998:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562533.202053:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc825 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.202082:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:2.0:1786562533.202086:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:2.0:1786562533.202095:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 32 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.202110:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 32 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.202123:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f6400, rc 0) 00000100:00100000:2.0:1786562533.202172:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:64036:x1873345652745088:12345-192.168.204.29@tcp:101:cat.0 Request processed in 193us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.202178:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17563 00000100:00100000:0.0:1786562533.218434:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652744960:12345-192.168.204.29@tcp:3:cat.0 Request processed in 52263us (52500us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562533.218448:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11417 00002000:00100000:0.0:1786562533.218460:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88bf04380 x1873345652744960/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562533.218470:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04380 with x1873345652744960 ext(2097152->3145727) 00002000:00010000:0.0:1786562533.218475:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf04380 00000100:00100000:1.0:1786562533.239403:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.239503:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745216 00000100:00100000:2.0:1786562533.239513:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745216 00000100:00100000:2.0:1786562533.239594:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17564 00000100:00100000:2.0:1786562533.239615:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:64029:x1873345652745216:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562533.239636:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562533.239655:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc82c expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.239689:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 14 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.239700:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=1s v=(0 2) 00010000:00010000:2.0:1786562533.239705:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562533.239710:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.239744:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 14 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.239759:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 14 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.239773:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654847104:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562533.239854:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f180 going to sleep for 11 seconds 00000100:00080000:1.0:1786562533.240154:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562533.247059:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654847104:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562533.247097:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.247124:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f6000, rc 0) 00000100:00100000:2.0:1786562533.247194:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64029:x1873345652745216:12345-192.168.204.29@tcp:101:cat.0 Request processed in 7591us (7798us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.247203:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17564 00000100:00100000:3.0:1786562533.259466:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.260526:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745344 00000100:00100000:2.0:1786562533.260544:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745344 00000100:00080000:1.0:1786562533.260848:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1786562533.260879:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3719167) req@ffff90e88313f480 x1873345652745344/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562533.260891:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313f480 with x1873345652745344 ext(3145728->3719167) 00010000:00010000:2.0:1786562533.260901:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 15 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.260918:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 15 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562533.260925:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88313f480 00000100:00100000:2.0:1786562533.260952:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5914 00000100:00100000:2.0:1786562533.260963:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652745344:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562533.296793:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652745344:12345-192.168.204.29@tcp:4:cat.0 Request processed in 35819us (37323us total) trans 21474843559 rc 0/0 00000100:00100000:0.0:1786562533.296811:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5914 00002000:00100000:0.0:1786562533.296826:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3719167) req@ffff90e88313f480 x1873345652745344/t21474843559(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/448 e 0 to 0 dl 1786562544 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562533.296836:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313f480 with x1873345652745344 ext(3145728->3719167) 00010000:00010000:0.0:1786562533.296847:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 17 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.296874:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 17 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562533.296884:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88313f480 00000100:00100000:1.0:1786562533.321138:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.321188:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.321264:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.337200:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.343267:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745600 00000100:00100000:3.0:1786562533.343282:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745600 00002000:00100000:3.0:1786562533.348196:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf06680 x1873345652745600/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.348211:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf06680 with x1873345652745600 ext(3145728->4194303) 00002000:00010000:3.0:1786562533.348218:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf06680 00000100:00100000:3.0:1786562533.348252:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745856 00000100:00100000:3.0:1786562533.348260:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745856 00002000:00100000:3.0:1786562533.348280:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf05f80 x1873345652745856/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.348294:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf05f80 with x1873345652745856 ext(2097152->3145727) 00010000:00010000:3.0:1786562533.348303:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 17 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.348320:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 17 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562533.348328:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88bf05f80 00000100:00100000:3.0:1786562533.348364:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745472 00000100:00100000:3.0:1786562533.348369:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745472 00002000:00100000:3.0:1786562533.348385:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88bf07100 x1873345652745472/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.348394:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07100 with x1873345652745472 ext(2097152->3145727) 00002000:00010000:3.0:1786562533.348397:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf07100 00000100:00100000:3.0:1786562533.348414:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5915 00000100:00100000:3.0:1786562533.348423:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652745856:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562533.351127:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11418 00000100:00100000:0.0:1786562533.351162:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+33:2349:x1873345652745600:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562533.351979:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745728 00000100:00100000:1.0:1786562533.351987:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745728 00002000:00100000:1.0:1786562533.352032:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88bf07480 x1873345652745728/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.352044:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07480 with x1873345652745728 ext(4194304->5185535) 00002000:00010000:1.0:1786562533.352048:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf07480 00000100:00100000:1.0:1786562533.352068:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11419 00000100:00100000:1.0:1786562533.352075:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+35:2349:x1873345652745472:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562533.354195:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11420 00000100:00100000:2.0:1786562533.354213:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652745728:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562533.385377:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.385545:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652745984 00000100:00100000:3.0:1786562533.385555:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652745984 00000100:00100000:3.0:1786562533.385628:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17565 00000100:00100000:3.0:1786562533.385639:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:64033:x1873345652745984:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562533.385658:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562533.385677:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc833 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385717:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385728:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385735:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 20 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385743:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=1s v=(1 2) 00010000:00010000:3.0:1786562533.385747:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562533.385753:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 20 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385788:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 20 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385812:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 20 pid: 29966 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.385826:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654847232:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562533.385925:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.385940:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 11 pid: 6660 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.386317:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654847360:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562533.407053:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.407079:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 7 pid: 6658 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.407097:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654847488:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562533.407133:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562533.430891:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652745856:12345-192.168.204.29@tcp:3:cat.0 Request processed in 82457us (109690us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562533.430904:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5915 00002000:00100000:3.0:1786562533.430918:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf05f80 x1873345652745856/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:H/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.430929:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf05f80 with x1873345652745856 ext(2097152->3145727) 00010000:00010000:3.0:1786562533.430939:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 19 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.431064:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 19 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562533.431073:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88bf05f80 00000100:00100000:2.0:1786562533.431558:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652745728:12345-192.168.204.29@tcp:3:cat.0 Request processed in 77349us (94363us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1786562533.431566:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11420 00002000:00100000:2.0:1786562533.431573:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88bf07480 x1873345652745728/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562533.431582:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07480 with x1873345652745728 ext(4194304->5185535) 00002000:00010000:2.0:1786562533.431586:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf07480 00000100:00100000:2.0:1786562533.433159:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:2349:x1873345652745472:12345-192.168.204.29@tcp:3:cat.0 Request processed in 81068us (111878us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562533.433168:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11419 00002000:00100000:2.0:1786562533.433178:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e88bf07100 x1873345652745472/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562533.433187:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf07100 with x1873345652745472 ext(2097152->3145727) 00002000:00010000:2.0:1786562533.433192:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf07100 00000100:00100000:2.0:1786562533.443906:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654847232:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562533.454909:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.454946:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.455116:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652746112 00000100:00100000:2.0:1786562533.455125:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652746112 00010000:00010000:2.0:1786562533.455166:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 12 pid: 6660 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.455195:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652746368 00000100:00100000:2.0:1786562533.455198:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652746368 00010000:00010000:2.0:1786562533.455210:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 8 pid: 6658 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.455232:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8565 00000100:00100000:2.0:1786562533.455240:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652746112:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.455255:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.455288:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 12 pid: 6660 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.455302:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 12 pid: 6660 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.455325:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.455582:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652746112:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 341us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.455590:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8565 00000100:00100000:2.0:1786562533.455607:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8566 00000100:00100000:2.0:1786562533.455614:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992130c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652746368:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.455621:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.455630:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 8 pid: 6658 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.455647:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 8 pid: 6658 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.455660:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.455676:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992130c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652746368:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 63us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.455682:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8566 00010000:00010000:2.0:1786562533.455814:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689e70f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc737 expref: 11 pid: 6660 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.455830:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654847360:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562533.455840:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80526c2/0x5c655bf66689e6ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ff expref: 7 pid: 6658 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.455849:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654847488:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562533.455877:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.455889:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a6600, rc 0) 00000100:00100000:2.0:1786562533.455910:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:64033:x1873345652745984:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 70274us (70544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.455917:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17565 00000100:00100000:0.0:1786562533.456322:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652745600:12345-192.168.204.29@tcp:3:cat.0 Request processed in 105181us (135193us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562533.456331:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11418 00002000:00100000:0.0:1786562533.456527:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf06680 x1873345652745600/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562533.456537:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf06680 with x1873345652745600 ext(3145728->4194303) 00002000:00010000:0.0:1786562533.456542:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf06680 00000100:00100000:1.0:1786562533.456712:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.457694:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652746240 00000100:00100000:2.0:1786562533.457702:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652746240 00010000:00010000:2.0:1786562533.457726:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 18 pid: 29966 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.457752:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8567 00000100:00100000:2.0:1786562533.457759:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652746240:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.457769:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.457784:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 18 pid: 29966 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.457796:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 18 pid: 29966 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.457813:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689e6de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc714 expref: 18 pid: 29966 timeout: 1065 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.457828:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562533.457832:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562533.457840:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 17 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.457850:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 17 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.457885:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 17 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.457904:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654847616:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562533.457964:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562533.499759:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.499917:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652746496 00000100:00100000:1.0:1786562533.499930:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652746496 00000100:00100000:1.0:1786562533.499989:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17566 00000100:00100000:1.0:1786562533.499999:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+18:64036:x1873345652746496:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562533.500130:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562533.500149:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc83a expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.500181:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 2) 00010000:00010000:1.0:1786562533.500192:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 19 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.500205:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 19 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.500218:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafda000, rc 0) 00000100:00100000:1.0:1786562533.500286:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+19:64036:x1873345652746496:12345-192.168.204.29@tcp:101:cat.0 Request processed in 289us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562533.500293:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17566 00000100:00100000:0.0:1786562533.506783:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562533.510248:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654847616:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562533.510286:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562533.510356:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652746240:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 52595us (53643us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562533.510367:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8567 00000100:00100000:1.0:1786562533.510882:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652746752 00000100:00100000:1.0:1786562533.510891:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652746752 00000100:00100000:1.0:1786562533.511082:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17065 00000100:00100000:1.0:1786562533.511093:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:64040:x1873345652746752:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562533.511117:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562533.511149:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdba00/0x5c655bf66689e8c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc841 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511392:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511410:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 17 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511417:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 514 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511423:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 5/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511457:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 514 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511467:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 514 pid: 34450 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562533.511480:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654847744:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562533.511687:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 17 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.511698:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 17 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562533.511708:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654847872:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562533.511734:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bcecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562533.525477:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.525510:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.525539:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.525567:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747264 00000100:00100000:2.0:1786562533.525576:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747264 00010000:00010000:2.0:1786562533.525626:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 18 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.525657:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652746880 00000100:00100000:2.0:1786562533.525660:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652746880 00000100:00100000:0.0:1786562533.525687:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747008 00000100:00100000:0.0:1786562533.525693:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747008 00002000:00100000:0.0:1786562533.525727:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72e:0x0] (1900544->1904639) req@ffff90e9a99f8000 x1873345652747008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562533.525743:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8000 with x1873345652747008 ext(1900544->1904639) 00002000:00010000:0.0:1786562533.525748:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99f8000 00000100:00100000:0.0:1786562533.525773:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11421 00000100:00100000:0.0:1786562533.525783:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652747008:12345-192.168.204.29@tcp:3:multiop.0 00010000:00010000:2.0:1786562533.525897:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 19 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.525924:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8568 00000100:00100000:2.0:1786562533.525933:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652747264:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1786562533.525970:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652747008:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 187us (500us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562533.525977:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11421 00002000:00100000:0.0:1786562533.525983:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72e:0x0] (1900544->1904639) req@ffff90e9a99f8000 x1873345652747008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/4536 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562533.525992:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8000 with x1873345652747008 ext(1900544->1904639) 00002000:00010000:0.0:1786562533.525996:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99f8000 00000100:00100000:3.0:1786562533.526097:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8569 00000100:00100000:3.0:1786562533.526121:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652746880:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562533.526135:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.526772:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.526781:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 18 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.526794:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 18 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.526821:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562533.526826:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.526836:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.526842:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.526883:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652747264:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 951us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.526890:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8568 00000100:00100000:2.0:1786562533.526955:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.526981:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747136 00000100:00100000:2.0:1786562533.526986:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747136 00010000:00010000:2.0:1786562533.527001:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 515 pid: 34450 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.527037:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8570 00000100:00100000:2.0:1786562533.527044:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+515:2348:x1873345652747136:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.527052:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.527057:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 515 pid: 34450 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.527065:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 515 pid: 34450 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.527077:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562533.527081:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.527089:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.527097:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562533.527359:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562531 -> 1786562532 00010000:00010000:3.0:1786562533.527367:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 18 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527381:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 18 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527397:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689e7a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3719167) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7a0 expref: 18 pid: 29964 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527412:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562533.527416:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562533.527423:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 6 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527430:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 6 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527438:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562533.527441:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562533.527446:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527453:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.527485:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.527505:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654848000:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562533.527563:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 6 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.527572:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654848128:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562533.527589:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00010000:00010000:1.0:1786562533.527880:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689e889 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc810 expref: 515 pid: 34450 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562533.527896:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654847744:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562533.527909:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689e85f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7fb expref: 17 pid: 33114 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562533.527920:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654847872:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562533.538234:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654848000:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562533.538249:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654848128:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562533.538272:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562533.538329:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652746880:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12223us (12788us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562533.538349:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8569 00010000:00010000:1.0:1786562533.541263:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.550215:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.550309:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+514:2348:x1873345652747136:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23258us (23359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.550322:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8570 00010000:00010000:1.0:1786562533.567828:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.567846:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562533.567870:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562533.568153:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdba00/0x5c655bf66689e8c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.568179:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.568193:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562533.568197:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562533.568212:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdbc00, rc 0) 00000100:00100000:0.0:1786562533.568284:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:64040:x1873345652746752:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 57192us (62684us total) trans 8589950601 rc 0/0 00000100:00100000:0.0:1786562533.568304:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17065 00000100:00100000:1.0:1786562533.579195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.579238:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.579308:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747392 00000100:00100000:3.0:1786562533.579317:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747392 00002000:00100000:3.0:1786562533.579384:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf05180 x1873345652747392/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.579395:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf05180 with x1873345652747392 ext(2097152->3145727) 00002000:00010000:3.0:1786562533.579401:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf05180 00000100:00100000:3.0:1786562533.579429:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747520 00000100:00100000:3.0:1786562533.579432:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747520 00002000:00100000:3.0:1786562533.579449:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf04700 x1873345652747520/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.579458:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04700 with x1873345652747520 ext(3145728->4194303) 00002000:00010000:3.0:1786562533.579461:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf04700 00000100:00100000:3.0:1786562533.579491:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11422 00000100:00100000:3.0:1786562533.579499:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652747392:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562533.580056:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11423 00000100:00100000:0.0:1786562533.580066:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652747520:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562533.616277:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.616328:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.616368:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.616397:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.616579:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747776 00000100:00100000:1.0:1786562533.616589:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747776 00002000:00100000:1.0:1786562533.616647:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88313ca80 x1873345652747776/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.616659:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ca80 with x1873345652747776 ext(2097152->3145727) 00002000:00010000:1.0:1786562533.616673:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313ca80 00000100:00100000:1.0:1786562533.616700:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747904 00000100:00100000:1.0:1786562533.616703:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747904 00002000:00100000:1.0:1786562533.616719:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88313fb80 x1873345652747904/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.616728:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313fb80 with x1873345652747904 ext(3145728->4194303) 00002000:00010000:1.0:1786562533.616731:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313fb80 00000100:00100000:1.0:1786562533.616744:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652748032 00000100:00100000:1.0:1786562533.616748:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652748032 00002000:00100000:1.0:1786562533.616763:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88313ea00 x1873345652748032/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.616771:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ea00 with x1873345652748032 ext(3145728->4194303) 00002000:00010000:1.0:1786562533.616774:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88313ea00 00000100:00100000:1.0:1786562533.616790:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11424 00000100:00100000:1.0:1786562533.616799:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652747776:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562533.617421:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11425 00000100:00100000:1.0:1786562533.617429:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652747904:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562533.617913:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11426 00000100:00100000:1.0:1786562533.617935:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2351:x1873345652748032:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562533.619805:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652747648 00000100:00100000:2.0:1786562533.619817:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652747648 00000100:00100000:2.0:1786562533.619883:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17567 00000100:00100000:2.0:1786562533.619892:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:64033:x1873345652747648:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562533.619908:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562533.619928:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc848 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620063:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 10 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620074:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 10 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620082:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 22 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620091:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=4s v=(2 0) 00010000:00010000:2.0:1786562533.620095:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 2) 00010000:00010000:2.0:1786562533.620100:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [1048576->1523711] (req 1048576->1523711) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 22 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620134:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 22 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620147:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 22 pid: 6658 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.620161:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654848256:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562533.620514:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 10 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620523:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 10 pid: 12119 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.620544:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654848384:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562533.620572:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 10 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.620582:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 10 pid: 8368 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.620591:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654848512:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562533.620607:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f180 going to sleep for 11 seconds 00000100:00100000:1.0:1786562533.668590:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654848256:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562533.668609:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654848384:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562533.668624:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654848512:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562533.668663:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [1048576->1523711] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 22 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.668687:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988557e00, rc 0) 00000100:00100000:1.0:1786562533.668749:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:64033:x1873345652747648:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 48857us (52481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562533.668758:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17567 00000100:00100000:3.0:1786562533.668894:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652747520:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 88829us (89654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562533.668904:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11423 00002000:00100000:3.0:1786562533.668913:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf04700 x1873345652747520/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.668923:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf04700 with x1873345652747520 ext(3145728->4194303) 00002000:00010000:3.0:1786562533.668928:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf04700 00000100:00100000:1.0:1786562533.669118:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562533.669135:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654848640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562533.669178:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562533.669216:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654848640 00000100:00100000:1.0:1786562533.669223:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654848640 00000100:00100000:1.0:1786562533.669267:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1786562533.669277:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3292:x1873345654848640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562533.669296:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 504561664 pending 11927552 free 3829399552 avail 3827302400 00000100:00100000:1.0:1786562533.669344:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3292:x1873345654848640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562533.669351:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:1.0:1786562533.669370:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562533.669397:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654848640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562533.671080:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654849152:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671139:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562533.671171:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786562533.671177:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654848768:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671204:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562533.671227:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654849280:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671252:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562533.671275:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654848896:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671313:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562533.671344:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562533.671350:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654849024:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671370:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562533.671395:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654849152 00000100:00100000:0.0:1786562533.671402:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654849152 00000100:00100000:0.0:1786562533.671447:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1786562533.671456:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654849152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671503:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654849152:12345-0@lo:400:kworker.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562533.671510:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1786562533.671529:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654849280 00000100:00100000:0.0:1786562533.671532:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654849280 00000100:00100000:0.0:1786562533.671550:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654848896 00000100:00100000:0.0:1786562533.671552:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654848896 00000100:00100000:0.0:1786562533.671570:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654849024 00000100:00100000:0.0:1786562533.671573:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654849024 00000100:00100000:0.0:1786562533.671592:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1786562533.671609:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654849280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671643:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654849280:12345-0@lo:400:kworker.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562533.671649:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1786562533.671660:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1786562533.671665:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654848896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671695:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654848896:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562533.671701:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1786562533.671713:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1786562533.671719:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654849024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671746:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654849024:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562533.671751:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1786562533.671790:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654849024:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671800:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654848896:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671825:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654849280:0@lo:400:kworker.0 00000100:00100000:0.0:1786562533.671833:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843556 gen 2 00000004:00080000:0.0:1786562533.671837:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5ad80, transno 21474843533 00000004:00080000:0.0:1786562533.671844:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf58e00, transno 21474843534 00000004:00080000:0.0:1786562533.671847:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf59500, transno 21474843535 00000004:00080000:0.0:1786562533.671850:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5a680, transno 21474843536 00000004:00080000:0.0:1786562533.671853:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5bb80, transno 21474843537 00000004:00080000:0.0:1786562533.671855:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5b480, transno 21474843538 00000004:00080000:0.0:1786562533.671857:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5b800, transno 21474843539 00000004:00080000:0.0:1786562533.671860:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553f480, transno 21474843540 00000004:00080000:0.0:1786562533.671862:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebca80, transno 21474843541 00000004:00080000:0.0:1786562533.671865:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebdc00, transno 21474843542 00000004:00080000:0.0:1786562533.671866:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebed80, transno 21474843543 00000004:00080000:0.0:1786562533.671869:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebf100, transno 21474843544 00000004:00080000:0.0:1786562533.671871:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebc000, transno 21474843545 00000004:00080000:0.0:1786562533.671874:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebf480, transno 21474843546 00000004:00080000:0.0:1786562533.671876:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebce00, transno 21474843547 00000004:00080000:0.0:1786562533.671878:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebd500, transno 21474843548 00000004:00080000:0.0:1786562533.671880:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11dc00, transno 21474843549 00000004:00080000:0.0:1786562533.671883:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11d500, transno 21474843550 00000004:00080000:0.0:1786562533.671885:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11ed80, transno 21474843551 00000004:00080000:0.0:1786562533.671888:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11c700, transno 21474843552 00000004:00080000:0.0:1786562533.671890:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11ca80, transno 21474843553 00000004:00080000:0.0:1786562533.671892:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11c000, transno 21474843554 00000004:00080000:0.0:1786562533.671895:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11d880, transno 21474843555 00000004:00080000:0.0:1786562533.671898:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11fb80, transno 21474843556 00000100:00100000:0.0:1786562533.671902:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654849152:0@lo:400:kworker.0 00000100:00100000:2.0:1786562533.672246:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654848768 00000100:00100000:2.0:1786562533.672251:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654848768 00000100:00100000:2.0:1786562533.672290:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1786562533.672298:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654848768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562533.672352:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654848768:12345-0@lo:400:kworker.0 Request processed in 55us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.672359:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000004:00080000:2.0:1786562533.672901:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 24 done 00000100:00100000:2.0:1786562533.675268:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654848768:0@lo:400:kworker.0 00000100:00080000:1.0:1786562533.676261:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562533.676269:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562533.677116:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654849408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562533.677190:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562533.677341:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654849408 00000100:00100000:1.0:1786562533.677351:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654849408 00000100:00100000:1.0:1786562533.677443:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1786562533.677452:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654849408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562533.677473:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 608370688 pending 1703936 free 3828350976 avail 3826253824 00000100:00100000:1.0:1786562533.677518:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654849408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562533.677525:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1786562533.677751:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654849408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562533.711407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.711433:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.711455:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.711478:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652748160 00000100:00100000:2.0:1786562533.711486:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652748160 00010000:00010000:2.0:1786562533.711525:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 20 pid: 6658 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.711557:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652748416 00000100:00100000:2.0:1786562533.711560:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652748416 00010000:00010000:2.0:1786562533.711573:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 11 pid: 8368 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.711590:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652748288 00000100:00100000:2.0:1786562533.711594:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652748288 00010000:00010000:2.0:1786562533.711606:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 11 pid: 12119 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.711628:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8571 00000100:00100000:2.0:1786562533.711639:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652748160:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.711653:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.711677:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 20 pid: 6658 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711692:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 20 pid: 6658 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711718:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689e4a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5cb expref: 20 pid: 6658 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711734:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.711781:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652748160:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 144us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.711789:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8571 00000100:00100000:2.0:1786562533.711807:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8572 00000100:00100000:2.0:1786562533.711814:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652748416:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.711821:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.711830:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 11 pid: 8368 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711844:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 11 pid: 8368 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711858:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689e499 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc5c4 expref: 11 pid: 8368 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711868:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562533.711885:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652748416:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562533.711892:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8572 00000100:00100000:2.0:1786562533.711903:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8573 00000100:00100000:2.0:1786562533.711910:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992133850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652748288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562533.711916:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562533.711923:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 11 pid: 12119 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.711933:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 11 pid: 12119 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.712725:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652747392:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 133220us (133534us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562533.712735:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11422 00002000:00100000:3.0:1786562533.712745:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf05180 x1873345652747392/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.712753:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf05180 with x1873345652747392 ext(2097152->3145727) 00002000:00010000:3.0:1786562533.712757:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf05180 00010000:00010000:2.0:1786562533.713705:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e517 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc603 expref: 11 pid: 12119 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.713724:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 2) 00010000:00010000:2.0:1786562533.713728:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 2) 00010000:00010000:2.0:1786562533.713736:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.713745:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562533.713784:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.713800:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654849536:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562533.713858:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562533.739213:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652747776:12345-192.168.204.29@tcp:3:cat.0 Request processed in 122403us (122873us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562533.739227:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11424 00002000:00100000:1.0:1786562533.739241:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88313ca80 x1873345652747776/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562533.739252:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ca80 with x1873345652747776 ext(2097152->3145727) 00002000:00010000:1.0:1786562533.739257:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313ca80 00000100:00100000:1.0:1786562533.739506:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654849536:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562533.739540:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562533.739564:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992133850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652748288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 27654us (28108us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562533.739572:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8573 00000100:00100000:0.0:1786562533.751137:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2351:x1873345652748032:12345-192.168.204.29@tcp:3:cat.0 Request processed in 133192us (134726us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562533.751152:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11426 00002000:00100000:0.0:1786562533.751165:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88313ea00 x1873345652748032/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562533.751174:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ea00 with x1873345652748032 ext(3145728->4194303) 00002000:00010000:0.0:1786562533.751180:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88313ea00 00000100:00100000:3.0:1786562533.752057:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2350:x1873345652747904:12345-192.168.204.29@tcp:3:cat.0 Request processed in 134626us (135686us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562533.752066:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11425 00002000:00100000:3.0:1786562533.752073:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88313fb80 x1873345652747904/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.752081:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313fb80 with x1873345652747904 ext(3145728->4194303) 00002000:00010000:3.0:1786562533.752085:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313fb80 00000001:00080000:1.0:1786562533.781536:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876036 is committed 00000001:00080000:1.0:1786562533.781552:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876032 is committed 00000001:00080000:1.0:1786562533.781578:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876002 is committed 00000001:00080000:1.0:1786562533.781584:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876040 is committed 00000001:00080000:1.0:1786562533.781635:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876003 is committed 00000001:00080000:1.0:1786562533.781641:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876039 is committed 00000001:00080000:1.0:1786562533.781657:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876033 is committed 00000001:00080000:1.0:1786562533.781684:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876006 is committed 00000100:00100000:2.0:1786562533.784173:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.784479:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652748544 00000100:00100000:3.0:1786562533.784489:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652748544 00002000:00100000:3.0:1786562533.784547:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72f:0x0] (1519616->1523711) req@ffff90e9a99fb100 x1873345652748544/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.784557:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fb100 with x1873345652748544 ext(1519616->1523711) 00002000:00010000:3.0:1786562533.784562:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99fb100 00000100:00100000:3.0:1786562533.784588:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11427 00000100:00100000:3.0:1786562533.784607:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652748544:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562533.785175:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652748544:12345-192.168.204.29@tcp:3:cat.0 Request processed in 578us (1010us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562533.785184:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11427 00002000:00100000:3.0:1786562533.785191:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72f:0x0] (1519616->1523711) req@ffff90e9a99fb100 x1873345652748544/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:4/0 lens 488/4536 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562533.785199:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fb100 with x1873345652748544 ext(1519616->1523711) 00002000:00010000:3.0:1786562533.785203:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99fb100 00000100:00100000:2.0:1786562533.793597:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.793877:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652748800 00000100:00100000:1.0:1786562533.793888:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652748800 00000100:00100000:1.0:1786562533.793933:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6253 00000100:00100000:1.0:1786562533.793955:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+514:64036:x1873345652748800:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1786562533.794622:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+515:64036:x1873345652748800:12345-192.168.204.29@tcp:35:cat.0 Request processed in 667us (1033us total) trans 8589950602 rc 0/0 00000100:00100000:1.0:1786562533.794631:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6253 00000100:00100000:0.0:1786562533.799410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.799565:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749056 00000100:00100000:2.0:1786562533.799575:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749056 00000100:00100000:2.0:1786562533.799645:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6254 00000100:00100000:2.0:1786562533.799656:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+515:64033:x1873345652749056:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:2.0:1786562533.799955:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+516:64033:x1873345652749056:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 301us (553us total) trans 8589950603 rc 0/0 00000100:00100000:2.0:1786562533.799964:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6254 00000100:00100000:2.0:1786562533.817388:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.817422:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.817519:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749184 00000100:00100000:3.0:1786562533.817539:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749184 00000100:00100000:3.0:1786562533.817592:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749312 00000100:00100000:3.0:1786562533.817595:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749312 00000100:00100000:3.0:1786562533.817624:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17568 00000100:00100000:3.0:1786562533.817634:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2349:x1873345652749184:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562533.817652:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562533.817669:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e8e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc84f expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.817726:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654849664:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562533.817798:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562533.817862:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17569 00000100:00100000:0.0:1786562533.817871:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652749312:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562533.817877:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562533.817886:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689e8eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc856 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562533.817910:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654849792:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562533.817934:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00002000:00010000:3.0:1786562533.837830:0:6658:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562530 -> 1786562533 00002000:00010000:3.0:1786562533.837840:0:6658:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562530 -> 1786562533 00002000:00010000:3.0:1786562533.837843:0:6658:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562530 -> 1786562533 00000100:00100000:3.0:1786562533.837868:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654849664:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562533.837904:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e8e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc84f expref: 9 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.837925:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e8e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc84f expref: 9 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.837951:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ee00, rc 0) 00000100:00100000:3.0:1786562533.838046:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652749184:12345-192.168.204.29@tcp:101:cat.0 Request processed in 20414us (20667us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562533.838055:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17568 00002000:00010000:1.0:1786562533.838902:0:6659:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562525 -> 1786562533 00002000:00010000:1.0:1786562533.838908:0:6659:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562525 -> 1786562533 00002000:00010000:1.0:1786562533.838910:0:6659:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562528 -> 1786562533 00000100:00100000:1.0:1786562533.838922:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654849792:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562533.838959:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689e8eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc856 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.838980:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689e8eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc856 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.838989:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:1.0:1786562533.839119:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652749312:12345-192.168.204.29@tcp:101:cat.0 Request processed in 21248us (21694us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562533.839126:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17569 00000100:00100000:0.0:1786562533.895303:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.898225:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749440 00000100:00100000:2.0:1786562533.898243:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749440 00002000:00100000:2.0:1786562533.898307:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5181439) req@ffff90e88aeb9500 x1873345652749440/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/0 e 0 to 0 dl 1786562544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562533.898335:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9500 with x1873345652749440 ext(4194304->5181439) 00002000:00010000:2.0:1786562533.898342:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aeb9500 00000100:00100000:2.0:1786562533.898378:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11428 00000100:00100000:2.0:1786562533.898388:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652749440:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562533.930623:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652749440:12345-192.168.204.29@tcp:3:cat.0 Request processed in 32226us (35319us total) trans 0 rc 987136/987136 00000100:00100000:2.0:1786562533.930638:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11428 00002000:00100000:2.0:1786562533.930650:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5181439) req@ffff90e88aeb9500 x1873345652749440/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:4/0 lens 488/440 e 0 to 0 dl 1786562544 ref 1 fl Complete:/600/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562533.930661:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9500 with x1873345652749440 ext(4194304->5181439) 00002000:00010000:2.0:1786562533.930677:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88aeb9500 00000100:00100000:3.0:1786562533.931896:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562533.932035:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749568 00000100:00100000:1.0:1786562533.932045:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749568 00000100:00100000:1.0:1786562533.932099:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17066 00000100:00100000:1.0:1786562533.932110:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64043:x1873345652749568:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562533.932132:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562533.932154:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb600/0x5c655bf66689e8f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc85d expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932216:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932231:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932253:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932268:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932279:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932285:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932688:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932701:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932709:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932742:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.932755:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 20 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562533.932769:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf05500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654849920:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562533.932847:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e000 going to sleep for 11 seconds 00000100:00100000:1.0:1786562533.952689:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654849920:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562533.952723:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562533.966844:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.966927:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562533.967074:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749696 00000100:00100000:0.0:1786562533.967084:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749696 00000100:00100000:0.0:1786562533.967145:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17570 00000100:00100000:0.0:1786562533.967156:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652749696:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562533.967174:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562533.967192:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba2740eb/0x5c655bf66689e90e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc864 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562533.967268:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654850048:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562533.967364:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562533.968630:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749952 00000100:00100000:3.0:1786562533.968639:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749952 00010000:00010000:3.0:1786562533.968689:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 21 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.968730:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8574 00000100:00100000:3.0:1786562533.968739:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:2348:x1873345652749952:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562533.968751:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562533.968758:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 21 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.968777:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 21 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.968799:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdbc00/0x5c655bf66689e8cf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc841 expref: 21 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.968816:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562533.968821:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.968830:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.968836:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562533.968867:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562533.968913:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+20:2348:x1873345652749952:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 175us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562533.968921:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8574 00010000:00010000:1.0:1786562533.969094:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969103:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562533.969147:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562533.969151:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562533.969172:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969184:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969195:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969202:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969208:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969215:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bafda200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562533.969219:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969225:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969235:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562533.969238:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562533.969253:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969264:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafda200/0x5c655bf66689e8f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969274:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969280:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969285:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969289:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bafdac00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562533.969292:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969297:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969304:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2f00) 00010000:00010000:1.0:1786562533.969307:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562533.969310:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969316:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdac00/0x5c655bf66689e900 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969357:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb600/0x5c655bf66689e8f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969374:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.969380:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562533.969382:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562533.969384:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdb800, rc 0) 00000100:00100000:1.0:1786562533.969416:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64043:x1873345652749568:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 37308us (37526us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562533.969423:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17066 00000100:00100000:1.0:1786562533.976514:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562533.976608:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652749824 00000100:00100000:3.0:1786562533.976621:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652749824 00000100:00100000:3.0:1786562533.976688:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17571 00000100:00100000:3.0:1786562533.976700:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652749824:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562533.976718:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562533.976735:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc86b expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562533.976801:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654850176:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562533.976880:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562533.978978:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654850048:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562533.979037:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba2740eb/0x5c655bf66689e90e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc864 expref: 9 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.979060:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba2740eb/0x5c655bf66689e90e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc864 expref: 9 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562533.979072:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bff99000, rc 0) 00000100:00100000:0.0:1786562533.979109:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652749696:12345-192.168.204.29@tcp:101:cat.0 Request processed in 11955us (12273us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562533.979117:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17570 00000100:00100000:1.0:1786562533.984614:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654850176:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562533.984655:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e915 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc86b expref: 7 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.984690:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d8a77d/0x5c655bf66689e915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc86b expref: 7 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562533.984703:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ee00, rc 0) 00000100:00100000:1.0:1786562533.984808:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652749824:12345-192.168.204.29@tcp:101:cat.0 Request processed in 8111us (8303us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562533.984817:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17571 00000100:00100000:2.0:1786562533.995336:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562533.995455:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.000468:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652750208 00000100:00100000:0.0:1786562534.000483:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652750208 00000100:00100000:0.0:1786562534.000567:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652750464 00000100:00100000:0.0:1786562534.000571:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652750464 00000100:00100000:0.0:1786562534.000592:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17572 00000100:00100000:0.0:1786562534.000600:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652750208:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562534.000617:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562534.000633:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e91c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc879 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.000983:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654850304:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562534.001098:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00080000:2.0:1786562534.001557:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562534.001591:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17573 00000100:00100000:2.0:1786562534.001612:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652750464:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562534.001623:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.001634:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc887 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.001650:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(2 2) 00010000:00010000:2.0:1786562534.001656:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:2.0:1786562534.001675:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 13 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.001692:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 13 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.001705:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:2.0:1786562534.001736:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652750464:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 127us (6281us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562534.001743:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17573 00000100:00100000:1.0:1786562534.005558:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.005606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.006470:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652750080 00000100:00100000:2.0:1786562534.006480:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652750080 00000100:00100000:2.0:1786562534.006531:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652750336 00000100:00100000:2.0:1786562534.006534:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652750336 00000100:00100000:2.0:1786562534.006568:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17574 00000100:00100000:2.0:1786562534.006577:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652750080:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562534.006598:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.006616:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e92a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc872 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.006678:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654850432:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562534.006747:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881f13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.006848:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17575 00000100:00100000:1.0:1786562534.006859:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652750336:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562534.006868:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.006879:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc880 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.006894:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(6 3) 00010000:00010000:1.0:1786562534.006899:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:1.0:1786562534.006909:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.006926:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.006950:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdac00, rc 0) 00000100:00100000:1.0:1786562534.006979:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652750336:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 122us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.006986:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17575 00000100:00080000:3.0:1786562534.007268:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562534.007679:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654850304:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562534.007709:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e91c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc879 expref: 14 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.007726:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d04b4083/0x5c655bf66689e91c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc879 expref: 14 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.007738:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1600, rc 0) 00000100:00100000:0.0:1786562534.007766:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652750208:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 7167us (12449us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562534.007774:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17572 00000100:00100000:2.0:1786562534.015272:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654850432:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562534.015316:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e92a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc872 expref: 12 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.015361:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689e92a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc872 expref: 12 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.015375:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:2.0:1786562534.015436:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652750080:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 8859us (9884us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562534.015446:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17574 00000100:00100000:0.0:1786562534.024303:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.024557:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652750720 00000100:00100000:3.0:1786562534.024567:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652750720 00000100:00100000:3.0:1786562534.024640:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17067 00000100:00100000:3.0:1786562534.024651:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64043:x1873345652750720:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562534.024679:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.024699:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689e938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc88e expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.024798:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.024813:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.024822:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.024856:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.024870:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 19 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.024884:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654850560:192.168.204.29@tcp:104: 00000100:00080000:2.0:1786562534.025076:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562534.025978:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.043186:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.043301:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654850560:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562534.043337:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.043835:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652750848 00000100:00100000:1.0:1786562534.043843:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652750848 00010000:00010000:1.0:1786562534.043878:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 20 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.046821:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8575 00000100:00100000:1.0:1786562534.046845:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:2351:x1873345652750848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562534.046867:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562534.046878:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 20 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.046897:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 20 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.046921:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e907 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc85d expref: 20 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.046952:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562534.046958:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.046968:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.046976:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.047106:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562534.047168:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2351:x1873345652750848:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 335us (3990us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.047178:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8575 00010000:00010000:3.0:1786562534.047257:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.047265:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562534.047287:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562534.047448:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689e938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc88e expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.047464:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc88e expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.047472:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.047475:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562534.047477:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fe00, rc 0) 00000100:00100000:3.0:1786562534.047509:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64043:x1873345652750720:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 22861us (23216us total) trans 8589950604 rc 0/0 00000100:00100000:3.0:1786562534.047516:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17067 00000100:00100000:3.0:1786562534.054086:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.054796:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652751104 00000100:00100000:2.0:1786562534.054808:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652751104 00000100:00100000:2.0:1786562534.054875:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17068 00000100:00100000:2.0:1786562534.054885:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64043:x1873345652751104:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562534.054910:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.054913:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562534.054999:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fe00/0x5c655bf66689e93f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc88e expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055039:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562534.055044:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562534.055057:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e94d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc895 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055150:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055181:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055192:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055206:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055213:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055221:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055227:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562534.055231:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055239:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055258:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562534.055261:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562534.055265:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055272:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e954 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055298:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e94d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc895 expref: 19 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055308:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562534.055311:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562534.055314:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e94d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc895 expref: 19 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.055333:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364a00, rc 0) 00000100:00100000:2.0:1786562534.055388:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64043:x1873345652751104:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 505us (1315us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562534.055396:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17068 00000100:00100000:3.0:1786562534.058648:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.058792:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652751360 00000100:00100000:0.0:1786562534.058801:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652751360 00000100:00100000:0.0:1786562534.058855:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6255 00000100:00100000:0.0:1786562534.058864:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64043:x1873345652751360:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:0.0:1786562534.059183:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64043:x1873345652751360:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 319us (542us total) trans 8589950605 rc 0/0 00000100:00100000:0.0:1786562534.059190:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6255 00000100:00100000:1.0:1786562534.060532:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.060613:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652751616 00000100:00100000:2.0:1786562534.060619:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652751616 00000100:00100000:2.0:1786562534.060659:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17069 00000100:00100000:2.0:1786562534.060676:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+516:64047:x1873345652751616:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562534.060695:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.060713:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689e95b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc89c expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.060789:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.060803:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.060813:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.060827:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.060833:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.060843:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.061564:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.061575:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.061583:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562534.061592:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562534.062307:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062315:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062322:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062337:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562534.062341:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062348:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062361:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562534.062364:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562534.062369:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062375:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062386:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062392:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062397:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062402:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562534.062405:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062410:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062417:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d500) 00010000:00010000:2.0:1786562534.062419:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562534.062422:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062427:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689e969 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062474:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689e95b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 519 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062493:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 518 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.062500:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562534.062502:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562534.062505:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:2.0:1786562534.063417:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+518:64047:x1873345652751616:12345-192.168.204.29@tcp:101:cat.0 Request processed in 2748us (2891us total) trans 8589950606 rc 0/0 00000100:00100000:2.0:1786562534.063428:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17069 00000100:00100000:2.0:1786562534.098162:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.098465:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652751744 00000100:00100000:3.0:1786562534.098475:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652751744 00000100:00100000:3.0:1786562534.098536:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17576 00000100:00100000:3.0:1786562534.098546:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:64040:x1873345652751744:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562534.098563:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.098583:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8a3 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098625:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098636:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098646:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098654:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562534.098658:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562534.098663:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3170304->3993599] (req 3170304->3993599) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098697:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098711:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 16 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.098725:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654850688:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562534.098815:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098830:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 10 pid: 28861 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.098840:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654850816:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562534.098868:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.098878:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.098887:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654850944:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562534.098906:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.109924:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654850688:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562534.110000:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654850816:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562534.110042:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654850944:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562534.110077:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3170304->3993599] (req 3170304->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.110099:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f200, rc 0) 00000100:00100000:3.0:1786562534.110159:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:64040:x1873345652751744:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 11614us (12004us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.110168:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17576 00010000:00010000:1.0:1786562534.123552:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562534.124316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.124367:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.124433:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652751872 00000100:00100000:1.0:1786562534.124442:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652751872 00010000:00010000:1.0:1786562534.124477:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.124512:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752000 00000100:00100000:1.0:1786562534.124515:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752000 00010000:00010000:1.0:1786562534.124534:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 11 pid: 28861 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.124557:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8576 00000100:00100000:1.0:1786562534.124565:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2351:x1873345652751872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562534.124579:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562534.124600:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.124613:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.124636:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c184bbe/0x5c655bf66689e8b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc82c expref: 7 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.124654:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562534.124710:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2351:x1873345652751872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 145us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.124717:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8576 00000100:00100000:1.0:1786562534.124733:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8577 00000100:00100000:1.0:1786562534.124740:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652752000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562534.124746:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562534.124753:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 11 pid: 28861 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.124769:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 11 pid: 28861 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.124781:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689e923 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc887 expref: 11 pid: 28861 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.124791:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562534.124808:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652752000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 69us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.124815:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8577 00000100:00100000:2.0:1786562534.146920:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.146995:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.147208:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752128 00000100:00100000:0.0:1786562534.147219:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752128 00010000:00010000:0.0:1786562534.147270:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.147313:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8578 00000100:00100000:0.0:1786562534.147333:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652752128:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562534.147349:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562534.147372:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.147386:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.147409:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb544a8a/0x5c655bf66689e8c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc83a expref: 17 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.147426:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:0.0:1786562534.147430:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 2) 00010000:00010000:0.0:1786562534.147439:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.147447:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.147485:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.147503:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654851072:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562534.147582:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.147904:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.148495:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752256 00000100:00100000:1.0:1786562534.148502:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752256 00002000:00100000:1.0:1786562534.148541:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->1900543) req@ffff90e88b11ed80 x1873345652752256/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.148552:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11ed80 with x1873345652752256 ext(1048576->1900543) 00002000:00010000:1.0:1786562534.148557:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11ed80 00000100:00100000:1.0:1786562534.148591:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752384 00000100:00100000:1.0:1786562534.148594:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752384 00002000:00100000:1.0:1786562534.148609:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72f:0x0] (1523712->2097151) req@ffff90e88be23800 x1873345652752384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.148617:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23800 with x1873345652752384 ext(1523712->2097151) 00002000:00010000:1.0:1786562534.148621:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be23800 00000100:00100000:1.0:1786562534.148638:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11429 00000100:00100000:1.0:1786562534.148646:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652752256:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562534.149554:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11430 00000100:00100000:1.0:1786562534.149567:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652752384:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.163796:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.166698:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654851072:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562534.166727:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562534.166804:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652752128:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 19482us (19893us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562534.166817:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8578 00000100:00100000:1.0:1786562534.169543:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752512 00000100:00100000:1.0:1786562534.169556:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752512 00002000:00100000:1.0:1786562534.169610:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3170304->3174399) req@ffff90e88be23b80 x1873345652752512/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.169623:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23b80 with x1873345652752512 ext(3170304->3174399) 00002000:00010000:1.0:1786562534.169629:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be23b80 00000100:00100000:1.0:1786562534.169667:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11431 00000100:00100000:1.0:1786562534.169677:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652752512:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562534.169866:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652752512:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 189us (6085us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.169874:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11431 00002000:00100000:1.0:1786562534.169882:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3170304->3174399) req@ffff90e88be23b80 x1873345652752512/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.169891:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23b80 with x1873345652752512 ext(3170304->3174399) 00002000:00010000:1.0:1786562534.169894:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be23b80 00000100:00100000:3.0:1786562534.190924:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.191387:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652752256:12345-192.168.204.29@tcp:3:cat.0 Request processed in 42738us (44388us total) trans 0 rc 851968/851968 00000100:00100000:1.0:1786562534.191401:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11429 00002000:00100000:1.0:1786562534.191418:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->1900543) req@ffff90e88b11ed80 x1873345652752256/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/440 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 851968/851968 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.191430:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11ed80 with x1873345652752256 ext(1048576->1900543) 00002000:00010000:1.0:1786562534.191438:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11ed80 00000100:00100000:1.0:1786562534.191488:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752768 00000100:00100000:1.0:1786562534.191497:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752768 00000100:00100000:1.0:1786562534.191565:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17070 00000100:00100000:1.0:1786562534.191576:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+518:64050:x1873345652752768:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562534.191873:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.191900:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8aa expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.193855:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.193887:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 519 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.193896:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.193946:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 519 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.193963:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 519 pid: 35929 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.194241:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654851200:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562534.194430:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.200495:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:2349:x1873345652752384:12345-192.168.204.29@tcp:3:cat.0 Request processed in 50914us (52582us total) trans 0 rc 573440/573440 00000100:00100000:1.0:1786562534.200518:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11430 00002000:00100000:1.0:1786562534.200537:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1523712->2097151) req@ffff90e88be23800 x1873345652752384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/440 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 573440/573440 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.200549:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be23800 with x1873345652752384 ext(1523712->2097151) 00002000:00010000:1.0:1786562534.200556:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88be23800 00000100:00100000:3.0:1786562534.203535:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.203825:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652752896 00000100:00100000:2.0:1786562534.203837:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652752896 00010000:00010000:2.0:1786562534.203889:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 520 pid: 35929 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.203939:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8579 00000100:00100000:2.0:1786562534.203951:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+520:2348:x1873345652752896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562534.203981:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562534.203990:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 520 pid: 35929 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.204039:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 520 pid: 35929 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.204080:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562534.204086:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.204099:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.204108:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.204130:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562534.204207:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+520:2348:x1873345652752896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 258us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562534.204217:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8579 00010000:00010000:1.0:1786562534.206423:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365800/0x5c655bf66689e970 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc89c expref: 519 pid: 35929 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.206456:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654851200:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562534.206488:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.206500:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.206506:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562534.206546:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562534.206761:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdb800/0x5c655bf66689e985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 520 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.206794:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 519 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.206806:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562534.206810:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562534.206814:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdae00, rc 0) 00000100:00100000:1.0:1786562534.206911:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+519:64050:x1873345652752768:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 15336us (16002us total) trans 8589950607 rc 0/0 00000100:00100000:1.0:1786562534.206920:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17070 00000100:00100000:3.0:1786562534.218915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.219110:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753024 00000100:00100000:0.0:1786562534.219124:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753024 00000100:00100000:0.0:1786562534.219207:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17577 00000100:00100000:0.0:1786562534.219220:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+26:64050:x1873345652753024:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562534.219247:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562534.219271:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8b1 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219333:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 8 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219345:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219354:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219368:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:0.0:1786562534.219373:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:0.0:1786562534.219378:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2420736->2506751] (req 2420736->2506751) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219420:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219435:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.219454:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654851328:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562534.219569:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219580:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 12 pid: 29967 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.219589:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654851456:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562534.219618:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 8 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.219629:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 8 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.219640:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654851584:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562534.219660:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562534.226660:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654851328:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562534.226680:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654851456:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562534.226690:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654851584:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562534.226742:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2420736->2506751] (req 2420736->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.226768:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22000, rc 0) 00000100:00100000:2.0:1786562534.226844:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+27:64050:x1873345652753024:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 7626us (7941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562534.226856:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17577 00000100:00100000:1.0:1786562534.243568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.243716:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753152 00000100:00100000:3.0:1786562534.243730:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753152 00010000:00010000:3.0:1786562534.243787:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 13 pid: 29967 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.243839:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8580 00000100:00100000:3.0:1786562534.243851:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992133450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652753152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562534.243871:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562534.243901:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 13 pid: 29967 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.243916:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 13 pid: 29967 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.243945:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e56e628f/0x5c655bf66689e931 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc880 expref: 13 pid: 29967 timeout: 1066 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.244149:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562534.244218:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992133450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652753152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 369us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.244227:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8580 00000100:00100000:3.0:1786562534.264531:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.264665:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753280 00000100:00100000:2.0:1786562534.264677:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753280 00010000:00010000:2.0:1786562534.264731:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 9 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.264786:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8581 00000100:00100000:2.0:1786562534.264798:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652753280:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562534.264818:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562534.264850:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 9 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.264866:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 9 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.264897:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689e83c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7ed expref: 9 pid: 29964 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.264919:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562534.265000:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652753280:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 204us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562534.265074:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8581 00000100:00100000:1.0:1786562534.280463:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.280521:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.280618:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753536 00000100:00100000:2.0:1786562534.280630:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753536 00002000:00100000:2.0:1786562534.280694:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3989504->3993599) req@ffff90e889d4a680 x1873345652753536/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.280714:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4a680 with x1873345652753536 ext(3989504->3993599) 00002000:00010000:2.0:1786562534.280721:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d4a680 00000100:00100000:2.0:1786562534.280763:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11432 00000100:00100000:2.0:1786562534.280775:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652753536:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562534.281073:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2349:x1873345652753536:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 300us (625us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.281081:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11432 00002000:00100000:2.0:1786562534.281087:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (3989504->3993599) req@ffff90e889d4a680 x1873345652753536/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.281096:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4a680 with x1873345652753536 ext(3989504->3993599) 00002000:00010000:2.0:1786562534.281099:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d4a680 00000100:00100000:3.0:1786562534.281410:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753408 00000100:00100000:3.0:1786562534.281416:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753408 00010000:00010000:3.0:1786562534.281446:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.281486:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8582 00000100:00100000:3.0:1786562534.281494:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652753408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562534.281507:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562534.281532:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.281546:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.281575:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef05bd92/0x5c655bf66689e8ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc825 expref: 27 pid: 6660 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.281593:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:3.0:1786562534.281599:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:3.0:1786562534.281610:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 26 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.281621:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 26 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.281680:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 26 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.281697:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be22680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654851712:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562534.281776:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.290446:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.290525:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.290681:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753792 00000100:00100000:2.0:1786562534.290693:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753792 00002000:00100000:2.0:1786562534.290753:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (2420736->2424831) req@ffff90e889d4ad80 x1873345652753792/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.290765:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4ad80 with x1873345652753792 ext(2420736->2424831) 00002000:00010000:2.0:1786562534.290771:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d4ad80 00000100:00100000:2.0:1786562534.290808:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11433 00000100:00100000:2.0:1786562534.290817:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652753792:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.291124:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652753792:12345-192.168.204.29@tcp:3:cat.0 Request processed in 306us (596us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.291133:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11433 00002000:00100000:2.0:1786562534.291141:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (2420736->2424831) req@ffff90e889d4ad80 x1873345652753792/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.291149:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4ad80 with x1873345652753792 ext(2420736->2424831) 00002000:00010000:2.0:1786562534.291153:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d4ad80 00000100:00100000:0.0:1786562534.291303:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753664 00000100:00100000:0.0:1786562534.291309:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753664 00000100:00100000:0.0:1786562534.291366:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17578 00000100:00100000:0.0:1786562534.291376:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+27:64047:x1873345652753664:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562534.291387:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562534.291410:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8b8 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.291447:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 28 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.291458:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 3) 00010000:00010000:0.0:1786562534.291463:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:0.0:1786562534.291470:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.291510:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 28 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.291527:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 28 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.291551:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654851840:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562534.291622:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.291900:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be22680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654851712:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562534.291925:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562534.291951:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652753408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10458us (11430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.291961:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8582 00000100:00100000:0.0:1786562534.300422:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29963:1873345654851840:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562534.300460:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.300480:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22600, rc 0) 00000100:00100000:0.0:1786562534.300544:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+27:64047:x1873345652753664:12345-192.168.204.29@tcp:101:cat.0 Request processed in 9169us (10113us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562534.300554:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17578 00000100:00100000:1.0:1786562534.305916:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.306069:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.306105:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.306180:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652753920 00000100:00100000:3.0:1786562534.306191:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652753920 00000100:00100000:3.0:1786562534.306255:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754048 00000100:00100000:3.0:1786562534.306258:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754048 00000100:00100000:3.0:1786562534.306273:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754176 00000100:00100000:3.0:1786562534.306275:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754176 00000100:00100000:3.0:1786562534.306294:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17579 00000100:00100000:3.0:1786562534.306304:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652753920:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562534.306331:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.306349:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000298d5fee/0x5c655bf66689e9a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8bf expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.306411:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654851968:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562534.306482:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562534.306752:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17580 00000100:00100000:2.0:1786562534.306778:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652754048:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562534.306796:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.306815:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e9af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8c6 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.306872:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654852096:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562534.306942:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881f13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.306949:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17581 00000100:00100000:1.0:1786562534.306963:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652754176:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562534.306973:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.306984:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689e9b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8cd expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.307035:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689e9b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8cd expref: 9 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.307053:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689e9b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8cd expref: 9 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.307065:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdb600, rc 0) 00000100:00100000:1.0:1786562534.307097:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652754176:12345-192.168.204.29@tcp:101:cat.0 Request processed in 139us (992us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562534.307105:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17581 00000100:00100000:0.0:1786562534.310651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.310704:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.310811:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754560 00000100:00100000:1.0:1786562534.310821:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754560 00002000:00100000:1.0:1786562534.310864:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2502656->2506751) req@ffff90e88aeb9f80 x1873345652754560/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.310876:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9f80 with x1873345652754560 ext(2502656->2506751) 00010000:00010000:1.0:1786562534.310886:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.310904:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.310913:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88aeb9f80 00000100:00100000:1.0:1786562534.311023:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5916 00000100:00100000:1.0:1786562534.311034:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652754560:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.311104:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754432 00000100:00100000:2.0:1786562534.311118:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754432 00000100:00100000:2.0:1786562534.311191:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6256 00000100:00100000:2.0:1786562534.311203:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e984ef7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+20:64040:x1873345652754432:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562534.311260:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652754560:12345-192.168.204.29@tcp:3:cat.0 Request processed in 225us (552us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.311269:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5916 00002000:00100000:1.0:1786562534.311277:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2502656->2506751) req@ffff90e88aeb9f80 x1873345652754560/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.311286:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9f80 with x1873345652754560 ext(2502656->2506751) 00010000:00010000:1.0:1786562534.311292:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.311311:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.311326:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88aeb9f80 00000100:00100000:3.0:1786562534.311566:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654851968:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562534.311598:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000298d5fee/0x5c655bf66689e9a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8bf expref: 9 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.311617:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000298d5fee/0x5c655bf66689e9a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8bf expref: 9 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.311629:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e600, rc 0) 00000100:00100000:3.0:1786562534.311663:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652753920:12345-192.168.204.29@tcp:101:cat.0 Request processed in 5361us (5758us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562534.311670:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17579 00000100:00100000:2.0:1786562534.315307:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e984ef7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:64040:x1873345652754432:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 4091us (4649us total) trans 8589950608 rc 0/0 00000100:00100000:2.0:1786562534.315334:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6256 00000100:00100000:2.0:1786562534.345155:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654852096:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562534.345224:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e9af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8c6 expref: 7 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.345253:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689e9af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8c6 expref: 7 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.345268:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:2.0:1786562534.345338:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652754048:12345-192.168.204.29@tcp:101:cat.0 Request processed in 38572us (39268us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562534.345349:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17580 00000100:00100000:0.0:1786562534.348142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.348201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.354533:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754816 00000100:00100000:1.0:1786562534.354552:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754816 00000100:00100000:2.0:1786562534.355611:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17071 00000100:00100000:2.0:1786562534.355629:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64054:x1873345652754816:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562534.355664:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.355692:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e9bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8d4 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.355784:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.355801:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.355815:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.355832:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.355839:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.355845:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.356455:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.356470:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 518 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.356480:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.356525:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 518 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.356539:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 518 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.356556:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654852224:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562534.356662:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881186a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.365374:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754688 00000100:00100000:3.0:1786562534.365389:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754688 00002000:00100000:3.0:1786562534.365450:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2420736->2506751) req@ffff90e88aeb9880 x1873345652754688/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562534.365462:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9880 with x1873345652754688 ext(2420736->2506751) 00010000:00010000:3.0:1786562534.365472:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.365508:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 27 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562534.365517:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88aeb9880 00000100:00100000:3.0:1786562534.365552:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5917 00000100:00100000:3.0:1786562534.365564:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652754688:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562534.395268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.397993:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652754944 00000100:00100000:1.0:1786562534.398037:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652754944 00000100:00100000:1.0:1786562534.398140:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17582 00000100:00100000:1.0:1786562534.398152:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:64053:x1873345652754944:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562534.398178:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.398217:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8db expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.398264:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.398275:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=1s v=(1 2) 00010000:00010000:1.0:1786562534.398281:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:1.0:1786562534.398287:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 7 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.398388:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.398407:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 15 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.398424:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654852352:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562534.398528:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562534.411263:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652754688:12345-192.168.204.29@tcp:4:cat.0 Request processed in 45671us (63967us total) trans 17179876041 rc 0/0 00000100:00100000:2.0:1786562534.411288:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5917 00002000:00100000:2.0:1786562534.411309:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2420736->2506751) req@ffff90e88aeb9880 x1873345652754688/t17179876041(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/448 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.411332:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88aeb9880 with x1873345652754688 ext(2420736->2506751) 00010000:00010000:2.0:1786562534.411347:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 29 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.411371:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 29 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.411379:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88aeb9880 00000100:00100000:0.0:1786562534.421541:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.421607:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755200 00000100:00100000:0.0:1786562534.421618:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755200 00000100:00100000:2.0:1786562534.422122:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654852224:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562534.422158:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.422237:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.422302:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755328 00000100:00100000:2.0:1786562534.422307:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755328 00002000:00100000:2.0:1786562534.422364:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x72e:0x0] (1900544->2097151) req@ffff90e88b11c700 x1873345652755328/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.422375:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11c700 with x1873345652755328 ext(1900544->2097151) 00010000:00010000:2.0:1786562534.422385:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 16 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.422400:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 16 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.422409:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b11c700 00000100:00100000:2.0:1786562534.422438:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5918 00000100:00100000:2.0:1786562534.422449:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652755328:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562534.424450:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6257 00000100:00100000:0.0:1786562534.424476:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+519:56898:x1873345652755200:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786562534.424868:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+520:56898:x1873345652755200:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 403us (3351us total) trans 8589950609 rc 0/0 00000100:00100000:0.0:1786562534.424879:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6257 00000100:00100000:3.0:1786562534.426940:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654852352:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562534.427673:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 7 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.427703:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafda600, rc 0) 00000100:00100000:3.0:1786562534.427778:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:64053:x1873345652754944:12345-192.168.204.29@tcp:101:cat.0 Request processed in 29628us (32526us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.427789:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17582 00000100:00100000:3.0:1786562534.437663:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.440474:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755456 00000100:00100000:0.0:1786562534.440493:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755456 00010000:00010000:0.0:1786562534.440563:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 29 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.440617:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8583 00000100:00100000:0.0:1786562534.440629:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652755456:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562534.440648:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562534.440673:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562532 -> 1786562533 00002000:00010000:0.0:1786562534.440677:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562532 -> 1786562533 00010000:00010000:0.0:1786562534.440685:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 29 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.440700:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 29 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.440731:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689e99a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2420736->4194303] (req 2420736->2506751) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b1 expref: 29 pid: 29965 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.440753:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:0.0:1786562534.440759:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:0.0:1786562534.440768:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.440780:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.440834:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.440853:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654852480:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562534.441444:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.448092:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652755328:12345-192.168.204.29@tcp:4:cat.0 Request processed in 25625us (25835us total) trans 21474843560 rc 0/0 00000100:00100000:1.0:1786562534.448110:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5918 00002000:00100000:1.0:1786562534.448128:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x72e:0x0] (1900544->2097151) req@ffff90e88b11c700 x1873345652755328/t21474843560(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/448 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.448140:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11c700 with x1873345652755328 ext(1900544->2097151) 00010000:00010000:1.0:1786562534.448152:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.448169:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.448178:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b11c700 00000100:00100000:2.0:1786562534.457309:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.458119:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755584 00000100:00100000:1.0:1786562534.458132:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755584 00000100:00100000:2.0:1786562534.458183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562534.458191:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 520 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.458228:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755712 00000100:00100000:1.0:1786562534.458232:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755712 00000100:00100000:2.0:1786562534.458241:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8584 00010000:00010000:1.0:1786562534.458249:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.458426:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+520:2348:x1873345652755584:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562534.458447:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562534.458456:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 520 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.458471:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 520 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.458499:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bafdae00/0x5c655bf66689e98c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8aa expref: 520 pid: 33115 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.458527:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562534.458533:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.458546:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.458555:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.458596:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562534.458654:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+519:2348:x1873345652755584:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 234us (1360us total) trans 0 rc 0/0 00010000:00010000:3.0:1786562534.459216:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459227:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562534.459302:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:3.0:1786562534.459307:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562534.459344:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459357:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459369:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459376:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459388:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459394:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562534.459398:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459405:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459416:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562534.459419:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562534.459423:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459430:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689e9c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459444:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459451:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459457:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459462:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562534.459465:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459476:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459483:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d500) 00010000:00010000:3.0:1786562534.459486:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562534.459489:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459496:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689e9cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459547:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365000/0x5c655bf66689e9bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459563:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.459571:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.459574:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562534.459576:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:3.0:1786562534.459633:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64054:x1873345652754816:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 104008us (111430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.459642:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17071 00000100:00100000:1.0:1786562534.467117:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8585 00000100:00100000:1.0:1786562534.467152:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652755712:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562534.467189:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562534.467226:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.467249:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.467279:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689e8ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc833 expref: 18 pid: 28862 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.467300:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:1.0:1786562534.467305:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:1.0:1786562534.467324:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 6 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.467336:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 6 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.467388:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 6 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.467412:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654852608:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562534.467535:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.475284:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.475477:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.475516:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755840 00000100:00100000:1.0:1786562534.475527:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755840 00000100:00100000:1.0:1786562534.475586:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756096 00000100:00100000:1.0:1786562534.475589:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756096 00000100:00100000:1.0:1786562534.475620:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17583 00000100:00100000:1.0:1786562534.475630:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652755840:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562534.475655:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.475680:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8e2 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.475714:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:1.0:1786562534.475719:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:1.0:1786562534.475731:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 11 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.475752:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 11 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.475769:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdb000, rc 0) 00000100:00100000:1.0:1786562534.475833:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652755840:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 204us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.475845:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17583 00000100:00100000:1.0:1786562534.475866:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17584 00000100:00100000:1.0:1786562534.475873:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652756096:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562534.475881:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.475892:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8f0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.475905:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:1.0:1786562534.475908:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:1.0:1786562534.475914:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.475926:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.475936:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafda800, rc 0) 00000100:00100000:1.0:1786562534.475953:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652756096:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 81us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.475960:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17584 00000100:00100000:1.0:1786562534.475999:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.476284:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.476406:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652755968 00000100:00100000:1.0:1786562534.476411:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652755968 00000100:00100000:1.0:1786562534.476434:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756224 00000100:00100000:1.0:1786562534.476437:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756224 00000100:00100000:1.0:1786562534.476454:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17585 00000100:00100000:1.0:1786562534.476462:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652755968:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562534.476470:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.476479:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa6327c/0x5c655bf66689e9ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8e9 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.476533:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654852736:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562534.476590:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.476616:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17586 00000100:00100000:1.0:1786562534.476623:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652756224:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562534.476631:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.476640:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d50ae265/0x5c655bf66689e9f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8f7 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.476672:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654852864:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562534.476698:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.476770:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654852480:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562534.476789:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562534.476817:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652755456:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 36190us (39172us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.476828:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8583 00000100:00100000:1.0:1786562534.479910:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.480035:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756352 00000100:00100000:3.0:1786562534.480047:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756352 00002000:00100000:3.0:1786562534.480117:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2101247) req@ffff90e889d49180 x1873345652756352/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562534.480138:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d49180 with x1873345652756352 ext(2097152->2101247) 00002000:00010000:3.0:1786562534.480145:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d49180 00000100:00100000:3.0:1786562534.480322:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11434 00000100:00100000:3.0:1786562534.480339:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652756352:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.480610:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652756352:12345-192.168.204.29@tcp:3:cat.0 Request processed in 274us (711us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562534.480619:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11434 00002000:00100000:3.0:1786562534.480627:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (2097152->2101247) req@ffff90e889d49180 x1873345652756352/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562534.480637:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d49180 with x1873345652756352 ext(2097152->2101247) 00002000:00010000:3.0:1786562534.480641:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d49180 00000100:00100000:2.0:1786562534.481122:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8584 00002000:00010000:2.0:1786562534.488450:0:6660:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562532 -> 1786562533 00002000:00010000:2.0:1786562534.488465:0:6660:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562532 -> 1786562533 00002000:00010000:2.0:1786562534.488468:0:6660:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562531 -> 1786562533 00000100:00100000:2.0:1786562534.488503:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654852864:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562534.488556:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d50ae265/0x5c655bf66689e9f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f7 expref: 14 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.488594:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d50ae265/0x5c655bf66689e9f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f7 expref: 14 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.488610:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdb200, rc 0) 00000100:00100000:3.0:1786562534.488674:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d4aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654852608:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562534.488687:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652756224:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 12064us (12403us total) trans 0 rc 301/301 00010000:00010000:3.0:1786562534.488689:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562534.488697:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17586 00000100:00100000:3.0:1786562534.488717:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652755712:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 21586us (30534us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.488725:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8585 00000100:00100000:0.0:1786562534.488946:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654852736:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562534.488977:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000daa6327c/0x5c655bf66689e9ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e9 expref: 12 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.488993:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa6327c/0x5c655bf66689e9ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e9 expref: 12 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.489031:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdbe00, rc 0) 00000100:00100000:0.0:1786562534.489066:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652755968:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 12603us (13066us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562534.489072:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17585 00000100:00100000:1.0:1786562534.502244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.502403:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756736 00000100:00100000:3.0:1786562534.502418:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756736 00000100:00100000:3.0:1786562534.502506:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17072 00000100:00100000:3.0:1786562534.502518:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64054:x1873345652756736:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562534.502557:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.502584:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e9fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc8fe expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.502716:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.502734:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.502744:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.502785:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.502800:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 21 pid: 33140 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.502816:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654852992:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562534.502917:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.506637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.506798:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756480 00000100:00100000:0.0:1786562534.506811:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756480 00002000:00100000:0.0:1786562534.506878:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2101248->2105343) req@ffff90e889d4aa00 x1873345652756480/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.506891:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4aa00 with x1873345652756480 ext(2101248->2105343) 00002000:00010000:0.0:1786562534.506898:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d4aa00 00000100:00100000:0.0:1786562534.506936:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11435 00000100:00100000:0.0:1786562534.506948:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652756480:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562534.507311:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652756480:12345-192.168.204.29@tcp:3:cat.0 Request processed in 363us (685us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562534.507330:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11435 00002000:00100000:0.0:1786562534.507338:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2101248->2105343) req@ffff90e889d4aa00 x1873345652756480/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.507347:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4aa00 with x1873345652756480 ext(2101248->2105343) 00002000:00010000:0.0:1786562534.507351:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889d4aa00 00000100:00100000:1.0:1786562534.522863:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.523640:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756864 00000100:00100000:0.0:1786562534.523655:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756864 00002000:00100000:0.0:1786562534.523725:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e889d4b800 x1873345652756864/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.523737:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4b800 with x1873345652756864 ext(1048576->2097151) 00002000:00010000:0.0:1786562534.523744:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d4b800 00000100:00100000:0.0:1786562534.523782:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11436 00000100:00100000:0.0:1786562534.523793:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652756864:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.539484:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654852992:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562534.539526:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.551628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.551687:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.551815:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652757120 00000100:00100000:2.0:1786562534.551834:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652757120 00002000:00100000:2.0:1786562534.551904:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2105344->2109439) req@ffff90e88c79f100 x1873345652757120/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.551917:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79f100 with x1873345652757120 ext(2105344->2109439) 00002000:00010000:2.0:1786562534.551924:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c79f100 00000100:00100000:2.0:1786562534.551966:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11437 00000100:00100000:2.0:1786562534.551979:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652757120:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.552297:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652757120:12345-192.168.204.29@tcp:3:cat.0 Request processed in 319us (608us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.552306:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11437 00002000:00100000:2.0:1786562534.552325:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2105344->2109439) req@ffff90e88c79f100 x1873345652757120/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.552335:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79f100 with x1873345652757120 ext(2105344->2109439) 00002000:00010000:2.0:1786562534.552339:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c79f100 00000100:00100000:3.0:1786562534.553002:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652756992 00000100:00100000:3.0:1786562534.553038:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652756992 00010000:00010000:3.0:1786562534.553086:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 22 pid: 33140 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562534.553120:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8586 00000100:00100000:3.0:1786562534.553130:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+22:2349:x1873345652756992:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562534.553145:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562534.553152:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 22 pid: 33140 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553167:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 22 pid: 33140 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553262:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689e9d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8d4 expref: 22 pid: 33140 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553283:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.553290:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553303:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553311:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553352:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562534.553394:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:2349:x1873345652756992:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 264us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.553401:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8586 00010000:00010000:3.0:1786562534.553427:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553435:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562534.553458:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562534.553648:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689e9fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8fe expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553666:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8fe expref: 21 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.553675:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.553678:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562534.553680:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e000, rc 0) 00000100:00100000:3.0:1786562534.553706:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:64054:x1873345652756736:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 51192us (51478us total) trans 8589950610 rc 0/0 00000100:00100000:3.0:1786562534.553714:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17072 00000100:00100000:2.0:1786562534.564103:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.564443:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652757376 00000100:00100000:3.0:1786562534.564457:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652757376 00000100:00100000:3.0:1786562534.564864:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17073 00000100:00100000:3.0:1786562534.564877:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+519:64060:x1873345652757376:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562534.564910:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.564936:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ea11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc905 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565223:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565241:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565262:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565278:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565286:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565293:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565776:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565789:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565796:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562534.565807:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562534.565923:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565931:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565937:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565944:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562534.565950:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565957:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565972:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562534.565975:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562534.565981:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.565987:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689ea18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.566002:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562534.566668:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652756864:12345-192.168.204.29@tcp:3:cat.0 Request processed in 42870us (43813us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562534.566682:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11436 00002000:00100000:1.0:1786562534.566696:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e889d4b800 x1873345652756864/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/440 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.566707:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4b800 with x1873345652756864 ext(1048576->2097151) 00002000:00010000:1.0:1786562534.566712:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889d4b800 00010000:00010000:3.0:1786562534.571287:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571299:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571306:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562534.571323:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571350:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571375:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab600) 00010000:00010000:3.0:1786562534.571379:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562534.571386:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571394:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689ea1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571503:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ea11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 522 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571519:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 521 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.571527:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.571530:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562534.571532:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f800, rc 0) 00000100:00100000:3.0:1786562534.571633:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+521:64060:x1873345652757376:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 6756us (7542us total) trans 8589950611 rc 0/0 00000100:00100000:3.0:1786562534.571644:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17073 00000100:00100000:1.0:1786562534.585758:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.585874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562534.586265:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652757760 00000100:00100000:3.0:1786562534.586278:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652757760 00000100:00100000:3.0:1786562534.586369:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17074 00000100:00100000:3.0:1786562534.586381:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:64054:x1873345652757760:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562534.586416:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.586421:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562534.586457:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689ea03 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8fe expref: 21 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586480:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.586487:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562534.586502:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ea34 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc90c expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586822:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586839:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586849:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586865:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586871:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586879:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586886:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ea00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562534.586890:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586898:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586907:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.586910:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562534.586915:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586921:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea3b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586953:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ea34 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc90c expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586962:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.586965:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562534.586969:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ea34 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc90c expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.586978:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e600, rc 0) 00000100:00100000:0.0:1786562534.588532:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652757504 00000100:00100000:0.0:1786562534.588546:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652757504 00002000:00100000:0.0:1786562534.588609:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2109440->2113535) req@ffff90e88c79df80 x1873345652757504/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.588622:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79df80 with x1873345652757504 ext(2109440->2113535) 00002000:00010000:0.0:1786562534.588628:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c79df80 00000100:00100000:0.0:1786562534.588671:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11438 00000100:00100000:0.0:1786562534.588682:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652757504:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.588877:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64054:x1873345652757760:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 2496us (3000us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562534.588887:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17074 00000100:00100000:0.0:1786562534.600401:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652757504:12345-192.168.204.29@tcp:3:cat.0 Request processed in 11702us (14639us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562534.600420:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11438 00002000:00100000:0.0:1786562534.600439:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2109440->2113535) req@ffff90e88c79df80 x1873345652757504/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.600450:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79df80 with x1873345652757504 ext(2109440->2113535) 00002000:00010000:0.0:1786562534.600459:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c79df80 00000100:00100000:1.0:1786562534.616490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.616548:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.616593:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.616629:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758144 00000100:00100000:1.0:1786562534.616640:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758144 00002000:00100000:1.0:1786562534.616707:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2113536->2117631) req@ffff90e88c79d880 x1873345652758144/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.616721:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79d880 with x1873345652758144 ext(2113536->2117631) 00002000:00010000:1.0:1786562534.616729:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c79d880 00000100:00100000:1.0:1786562534.616766:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11439 00000100:00100000:1.0:1786562534.616777:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652758144:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562534.617158:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758016 00000100:00100000:0.0:1786562534.617163:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758016 00000100:00100000:0.0:1786562534.617197:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6258 00000100:00100000:0.0:1786562534.617203:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64054:x1873345652758016:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:3.0:1786562534.618651:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758400 00000100:00100000:3.0:1786562534.618665:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758400 00000100:00100000:3.0:1786562534.618731:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17075 00000100:00100000:3.0:1786562534.618741:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:64059:x1873345652758400:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562534.618763:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562534.618804:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ea42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc913 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.618920:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.618942:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.618958:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562534.618972:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562534.619143:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ea42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 24 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.619167:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 23 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.619178:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562534.619182:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562534.619186:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ea00, rc 0) 00000100:00100000:1.0:1786562534.619297:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652758144:12345-192.168.204.29@tcp:3:cat.0 Request processed in 2520us (2701us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.619309:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11439 00002000:00100000:1.0:1786562534.619329:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2113536->2117631) req@ffff90e88c79d880 x1873345652758144/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.619340:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79d880 with x1873345652758144 ext(2113536->2117631) 00002000:00010000:1.0:1786562534.619346:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c79d880 00000100:00100000:0.0:1786562534.624852:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:64054:x1873345652758016:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 7619us (8273us total) trans 8589950612 rc 0/0 00000100:00100000:0.0:1786562534.624872:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6258 00000100:00100000:3.0:1786562534.647908:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+23:64059:x1873345652758400:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 29147us (31412us total) trans 8589950613 rc 0/0 00000100:00100000:3.0:1786562534.647927:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17075 00000100:00100000:0.0:1786562534.659437:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.659489:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.659521:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758656 00000100:00100000:0.0:1786562534.659534:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758656 00000100:00100000:0.0:1786562534.659599:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17587 00000100:00100000:0.0:1786562534.659612:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:64053:x1873345652758656:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562534.659635:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562534.659660:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc91a expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.659702:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.659714:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=1s v=(0 2) 00010000:00010000:0.0:1786562534.659720:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562534.659725:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 8 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.659771:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.659787:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 16 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.659804:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654853120:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562534.659895:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.672438:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758528 00000100:00100000:3.0:1786562534.672458:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758528 00002000:00100000:3.0:1786562534.672532:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (2117632->2121727) req@ffff90e98873d880 x1873345652758528/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562534.672545:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873d880 with x1873345652758528 ext(2117632->2121727) 00002000:00010000:3.0:1786562534.672551:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873d880 00000100:00100000:3.0:1786562534.672737:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11440 00000100:00100000:3.0:1786562534.672747:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652758528:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.672990:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652758528:12345-192.168.204.29@tcp:3:cat.0 Request processed in 243us (13568us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562534.672999:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11440 00002000:00100000:3.0:1786562534.673034:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (2117632->2121727) req@ffff90e98873d880 x1873345652758528/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562534.673043:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873d880 with x1873345652758528 ext(2117632->2121727) 00002000:00010000:3.0:1786562534.673047:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873d880 00000100:00100000:1.0:1786562534.674134:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.674276:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.674498:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758912 00000100:00100000:2.0:1786562534.674508:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758912 00002000:00100000:2.0:1786562534.674553:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1523711) req@ffff90e88c79ea00 x1873345652758912/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.674563:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79ea00 with x1873345652758912 ext(1048576->1523711) 00010000:00010000:2.0:1786562534.674573:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 17 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.674590:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 17 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.674597:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88c79ea00 00000100:00100000:2.0:1786562534.674629:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5919 00000100:00100000:2.0:1786562534.674638:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652758912:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:2.0:1786562534.675152:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654853120:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562534.675188:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 8 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675210:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22000, rc 0) 00000100:00100000:2.0:1786562534.675240:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64053:x1873345652758656:12345-192.168.204.29@tcp:101:cat.0 Request processed in 15632us (15751us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562534.675249:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17587 00000100:00100000:2.0:1786562534.675270:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652758784 00000100:00100000:2.0:1786562534.675274:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652758784 00000100:00100000:2.0:1786562534.675302:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17588 00000100:00100000:2.0:1786562534.675309:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64059:x1873345652758784:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562534.675331:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562534.675352:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc921 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675376:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675387:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 12 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675396:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(7 3) 00010000:00010000:2.0:1786562534.675402:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:2.0:1786562534.675407:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->3919871] (req 3891200->3919871) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 9 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675447:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 12 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675459:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 12 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.675480:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654853248:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562534.675553:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.675563:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 27 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.675571:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654853376:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562534.675593:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881186000 going to sleep for 11 seconds 00000100:00100000:1.0:1786562534.691864:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.691916:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.691956:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759168 00000100:00100000:1.0:1786562534.691967:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759168 00000100:00100000:3.0:1786562534.692040:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759040 00000100:00100000:3.0:1786562534.692045:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759040 00002000:00100000:1.0:1786562534.692066:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2121728->2125823) req@ffff90e88c79f480 x1873345652759168/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1786562534.692076:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 13 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1786562534.692079:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79f480 with x1873345652759168 ext(2121728->2125823) 00010000:00010000:1.0:1786562534.692087:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.692099:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.692107:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79f480 00000100:00100000:3.0:1786562534.692114:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8587 00000100:00100000:3.0:1786562534.692124:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992132450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652759040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1786562534.692125:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5920 00000100:00100000:1.0:1786562534.692131:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652759168:12345-192.168.204.29@tcp:3:cat.0 00010000:00010000:3.0:1786562534.692140:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562534.692169:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 13 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.692184:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 13 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.692217:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562534.692290:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992132450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652759040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 167us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562534.692298:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8587 00000100:00100000:1.0:1786562534.692336:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652759168:12345-192.168.204.29@tcp:3:cat.0 Request processed in 205us (420us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.692343:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5920 00002000:00100000:1.0:1786562534.692349:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2121728->2125823) req@ffff90e88c79f480 x1873345652759168/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.692358:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79f480 with x1873345652759168 ext(2121728->2125823) 00010000:00010000:1.0:1786562534.692363:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.692373:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.692380:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79f480 00010000:00010000:0.0:1786562534.692674:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069da364b/0x5c655bf66689e9e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8f0 expref: 12 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562534.692692:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654853248:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562534.692708:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654853376:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562534.692741:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3891200->3919871] (req 3891200->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 9 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.692755:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880600, rc 0) 00000100:00100000:0.0:1786562534.692794:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64059:x1873345652758784:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 17484us (18665us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562534.692802:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17588 00000100:00100000:1.0:1786562534.709860:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.709963:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759296 00000100:00100000:0.0:1786562534.709977:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759296 00002000:00100000:0.0:1786562534.710087:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2125824->2129919) req@ffff90e88c79ce00 x1873345652759296/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.710101:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79ce00 with x1873345652759296 ext(2125824->2129919) 00010000:00010000:0.0:1786562534.710112:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.710128:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.710138:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79ce00 00000100:00100000:0.0:1786562534.710171:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5921 00000100:00100000:0.0:1786562534.710183:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652759296:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562534.715550:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652759296:12345-192.168.204.29@tcp:3:cat.0 Request processed in 5350us (5687us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562534.715568:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5921 00002000:00100000:0.0:1786562534.715584:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2125824->2129919) req@ffff90e88c79ce00 x1873345652759296/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.715597:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79ce00 with x1873345652759296 ext(2125824->2129919) 00010000:00010000:0.0:1786562534.715610:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.715633:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.715642:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79ce00 00000100:00100000:3.0:1786562534.720930:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652758912:12345-192.168.204.29@tcp:4:cat.0 Request processed in 46274us (46635us total) trans 21474843561 rc 0/0 00000100:00100000:3.0:1786562534.720951:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5919 00002000:00100000:3.0:1786562534.720970:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1523711) req@ffff90e88c79ea00 x1873345652758912/t21474843561(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/448 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562534.720981:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79ea00 with x1873345652758912 ext(1048576->1523711) 00010000:00010000:3.0:1786562534.720994:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 19 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562534.721052:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 19 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562534.721062:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88c79ea00 00000100:00100000:1.0:1786562534.739864:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.740068:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759424 00000100:00100000:2.0:1786562534.740082:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759424 00002000:00100000:2.0:1786562534.740149:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (2129920->2134015) req@ffff90e88c79c700 x1873345652759424/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.740162:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79c700 with x1873345652759424 ext(2129920->2134015) 00010000:00010000:2.0:1786562534.740173:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.740190:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.740198:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79c700 00000100:00100000:2.0:1786562534.740233:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5922 00000100:00100000:2.0:1786562534.740244:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652759424:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.741125:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652759424:12345-192.168.204.29@tcp:3:cat.0 Request processed in 798us (1192us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.741137:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5922 00002000:00100000:2.0:1786562534.741146:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (2129920->2134015) req@ffff90e88c79c700 x1873345652759424/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.741155:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79c700 with x1873345652759424 ext(2129920->2134015) 00010000:00010000:2.0:1786562534.741162:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.741173:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.741181:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79c700 00000100:00100000:1.0:1786562534.741837:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.741956:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759552 00000100:00100000:2.0:1786562534.741965:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759552 00010000:00010000:2.0:1786562534.741997:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 19 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.742061:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8588 00000100:00100000:2.0:1786562534.742072:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652759552:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562534.742089:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562534.742116:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 19 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.742128:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 19 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.742158:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689e8dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc848 expref: 19 pid: 8368 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.742179:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562534.742184:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562534.742194:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.742205:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.743405:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562534.743431:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654853504:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562534.743540:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881186e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562534.756428:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.756699:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759680 00000100:00100000:2.0:1786562534.756713:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759680 00002000:00100000:2.0:1786562534.756791:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2134016->2138111) req@ffff90e88be21f80 x1873345652759680/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.756804:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be21f80 with x1873345652759680 ext(2134016->2138111) 00010000:00010000:2.0:1786562534.756816:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.756842:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.756851:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be21f80 00000100:00100000:2.0:1786562534.756891:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5923 00000100:00100000:2.0:1786562534.756903:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652759680:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.757197:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652759680:12345-192.168.204.29@tcp:3:cat.0 Request processed in 296us (784us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.757206:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5923 00002000:00100000:2.0:1786562534.757213:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2134016->2138111) req@ffff90e88be21f80 x1873345652759680/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.757222:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be21f80 with x1873345652759680 ext(2134016->2138111) 00010000:00010000:2.0:1786562534.757228:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.757250:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.757258:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be21f80 00000100:00100000:2.0:1786562534.775094:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654853504:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562534.775131:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562534.775227:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2351:x1873345652759552:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 33156us (33391us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562534.775245:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8588 00000100:00100000:0.0:1786562534.793841:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.793980:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759808 00000100:00100000:1.0:1786562534.793992:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759808 00002000:00100000:1.0:1786562534.794099:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e98873e680 x1873345652759808/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.794112:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873e680 with x1873345652759808 ext(1048576->2097151) 00002000:00010000:1.0:1786562534.794119:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873e680 00000100:00100000:1.0:1786562534.794159:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11441 00000100:00100000:1.0:1786562534.794171:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652759808:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562534.808963:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652759808:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 14777us (15118us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562534.808981:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11441 00002000:00100000:1.0:1786562534.809000:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e98873e680 x1873345652759808/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/440 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.809072:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873e680 with x1873345652759808 ext(1048576->2097151) 00002000:00010000:1.0:1786562534.809080:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873e680 00000100:00100000:3.0:1786562534.819570:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.821388:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652759936 00000100:00100000:0.0:1786562534.821406:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652759936 00002000:00100000:0.0:1786562534.821480:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2138112->2142207) req@ffff90e88be22680 x1873345652759936/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.821492:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22680 with x1873345652759936 ext(2138112->2142207) 00010000:00010000:0.0:1786562534.821514:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.821537:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.821555:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be22680 00000100:00100000:0.0:1786562534.821978:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5924 00000100:00100000:0.0:1786562534.821991:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652759936:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.826958:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.827523:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760064 00000100:00100000:1.0:1786562534.827537:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760064 00000100:00100000:1.0:1786562534.827611:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17589 00000100:00100000:1.0:1786562534.827623:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64053:x1873345652760064:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562534.827646:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.827671:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc928 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.827708:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:1.0:1786562534.827714:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:1.0:1786562534.827727:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.827745:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.827761:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdbc00, rc 0) 00000100:00100000:1.0:1786562534.827832:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64053:x1873345652760064:12345-192.168.204.29@tcp:101:cat.0 Request processed in 212us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.827839:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17589 00000100:00100000:2.0:1786562534.832864:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652759936:12345-192.168.204.29@tcp:3:cat.0 Request processed in 10860us (13294us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.832882:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5924 00002000:00100000:2.0:1786562534.832895:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2138112->2142207) req@ffff90e88be22680 x1873345652759936/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.832907:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22680 with x1873345652759936 ext(2138112->2142207) 00010000:00010000:2.0:1786562534.832919:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.832943:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.832953:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be22680 00000100:00100000:3.0:1786562534.836610:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.836891:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760192 00000100:00100000:1.0:1786562534.836903:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760192 00002000:00100000:1.0:1786562534.836964:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2142208->2146303) req@ffff90e88be22d80 x1873345652760192/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.836978:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22d80 with x1873345652760192 ext(2142208->2146303) 00010000:00010000:1.0:1786562534.836989:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.837053:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.837064:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be22d80 00000100:00100000:1.0:1786562534.837098:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5925 00000100:00100000:1.0:1786562534.837109:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652760192:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562534.837411:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652760192:12345-192.168.204.29@tcp:3:cat.0 Request processed in 303us (813us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.837419:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5925 00002000:00100000:1.0:1786562534.837426:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2142208->2146303) req@ffff90e88be22d80 x1873345652760192/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.837435:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88be22d80 with x1873345652760192 ext(2142208->2146303) 00010000:00010000:1.0:1786562534.837441:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.837453:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.837461:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88be22d80 00000100:00100000:3.0:1786562534.859185:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.859302:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760320 00000100:00100000:2.0:1786562534.859329:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760320 00002000:00100000:2.0:1786562534.859400:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (2146304->2150399) req@ffff90e889d4b100 x1873345652760320/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.859413:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4b100 with x1873345652760320 ext(2146304->2150399) 00010000:00010000:2.0:1786562534.859425:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.859444:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.859459:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e889d4b100 00000100:00100000:2.0:1786562534.859501:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5926 00000100:00100000:2.0:1786562534.859519:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652760320:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.859788:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652760320:12345-192.168.204.29@tcp:3:cat.0 Request processed in 271us (620us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.859797:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5926 00002000:00100000:2.0:1786562534.859804:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (2146304->2150399) req@ffff90e889d4b100 x1873345652760320/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.859813:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889d4b100 with x1873345652760320 ext(2146304->2150399) 00010000:00010000:2.0:1786562534.859819:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.859831:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.859838:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e889d4b100 00000100:00100000:0.0:1786562534.875160:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.875197:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.875247:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.875385:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760448 00000100:00100000:1.0:1786562534.875402:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760448 00002000:00100000:1.0:1786562534.875480:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e98873ea00 x1873345652760448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.875494:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873ea00 with x1873345652760448 ext(2097152->3145727) 00002000:00010000:1.0:1786562534.875501:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873ea00 00000100:00100000:1.0:1786562534.875538:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760576 00000100:00100000:1.0:1786562534.875541:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760576 00002000:00100000:1.0:1786562534.875561:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e98873c700 x1873345652760576/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.875570:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c700 with x1873345652760576 ext(2097152->3145727) 00002000:00010000:1.0:1786562534.875575:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873c700 00000100:00100000:1.0:1786562534.875595:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760704 00000100:00100000:1.0:1786562534.875599:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760704 00002000:00100000:1.0:1786562534.875615:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2150400->2154495) req@ffff90e88433a680 x1873345652760704/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.875624:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433a680 with x1873345652760704 ext(2150400->2154495) 00010000:00010000:1.0:1786562534.875635:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.875657:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.875666:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88433a680 00000100:00100000:1.0:1786562534.875689:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5927 00000100:00100000:1.0:1786562534.875700:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652760704:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562534.875973:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652760704:12345-192.168.204.29@tcp:3:cat.0 Request processed in 273us (733us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.875981:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5927 00002000:00100000:1.0:1786562534.875988:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2150400->2154495) req@ffff90e88433a680 x1873345652760704/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.875996:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433a680 with x1873345652760704 ext(2150400->2154495) 00010000:00010000:1.0:1786562534.876037:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.876050:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.876058:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88433a680 00000100:00100000:1.0:1786562534.876081:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11442 00000100:00100000:1.0:1786562534.876089:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652760448:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562534.876708:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11443 00000100:00100000:1.0:1786562534.876720:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652760576:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562534.901252:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.902391:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760832 00000100:00100000:1.0:1786562534.902406:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760832 00002000:00100000:1.0:1786562534.902475:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (2154496->2158591) req@ffff90e9a99fbb80 x1873345652760832/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.902487:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fbb80 with x1873345652760832 ext(2154496->2158591) 00010000:00010000:1.0:1786562534.902499:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.902528:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.902537:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99fbb80 00000100:00100000:0.0:1786562534.905619:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652760448:12345-192.168.204.29@tcp:3:cat.0 Request processed in 29512us (30456us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562534.905642:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11442 00002000:00100000:0.0:1786562534.905657:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e98873ea00 x1873345652760448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/440 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.905681:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873ea00 with x1873345652760448 ext(2097152->3145727) 00002000:00010000:0.0:1786562534.905688:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98873ea00 00000100:00100000:0.0:1786562534.905736:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5928 00000100:00100000:0.0:1786562534.905763:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652760832:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562534.905966:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652760832:12345-192.168.204.29@tcp:3:cat.0 Request processed in 220us (4742us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562534.905972:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5928 00002000:00100000:0.0:1786562534.905977:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2154496->2158591) req@ffff90e9a99fbb80 x1873345652760832/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.905985:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99fbb80 with x1873345652760832 ext(2154496->2158591) 00010000:00010000:0.0:1786562534.905994:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.906051:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.906060:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99fbb80 00000100:00100000:1.0:1786562534.925447:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652760576:12345-192.168.204.29@tcp:3:cat.0 Request processed in 48711us (50229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562534.925463:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11443 00002000:00100000:1.0:1786562534.925480:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e98873c700 x1873345652760576/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:5/0 lens 488/440 e 0 to 0 dl 1786562545 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.925490:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98873c700 with x1873345652760576 ext(2097152->3145727) 00002000:00010000:1.0:1786562534.925497:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98873c700 00000100:00100000:3.0:1786562534.938120:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.938364:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652760960 00000100:00100000:0.0:1786562534.938377:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652760960 00002000:00100000:0.0:1786562534.938443:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (2158592->2162687) req@ffff90e9a99f8a80 x1873345652760960/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.938461:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8a80 with x1873345652760960 ext(2158592->2162687) 00010000:00010000:0.0:1786562534.938472:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.938493:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.938501:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99f8a80 00000100:00100000:0.0:1786562534.938540:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5929 00000100:00100000:0.0:1786562534.938551:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652760960:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562534.938834:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652760960:12345-192.168.204.29@tcp:3:cat.0 Request processed in 283us (729us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562534.938842:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5929 00002000:00100000:0.0:1786562534.938850:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (2158592->2162687) req@ffff90e9a99f8a80 x1873345652760960/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.938858:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8a80 with x1873345652760960 ext(2158592->2162687) 00010000:00010000:0.0:1786562534.938864:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.938876:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.938883:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9a99f8a80 00000100:00100000:3.0:1786562534.953822:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.954299:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761088 00000100:00100000:1.0:1786562534.954325:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761088 00002000:00100000:1.0:1786562534.954394:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (2162688->2166783) req@ffff90e9831fea00 x1873345652761088/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.954406:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fea00 with x1873345652761088 ext(2162688->2166783) 00010000:00010000:1.0:1786562534.954417:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.954437:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.954445:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9831fea00 00000100:00100000:1.0:1786562534.954491:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5930 00000100:00100000:1.0:1786562534.954510:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652761088:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562534.954789:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652761088:12345-192.168.204.29@tcp:3:cat.0 Request processed in 287us (982us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562534.954798:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5930 00002000:00100000:1.0:1786562534.954805:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (2162688->2166783) req@ffff90e9831fea00 x1873345652761088/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.954814:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9831fea00 with x1873345652761088 ext(2162688->2166783) 00010000:00010000:1.0:1786562534.954819:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.954831:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.954838:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9831fea00 00000100:00100000:1.0:1786562534.959220:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562534.968217:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761216 00000100:00100000:2.0:1786562534.968252:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761216 00002000:00100000:2.0:1786562534.968340:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2166784->2170879) req@ffff90e88c79d180 x1873345652761216/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.968353:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79d180 with x1873345652761216 ext(2166784->2170879) 00010000:00010000:2.0:1786562534.968365:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.968394:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.968403:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79d180 00000100:00100000:2.0:1786562534.968444:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5931 00000100:00100000:2.0:1786562534.968457:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652761216:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562534.968930:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652761216:12345-192.168.204.29@tcp:3:cat.0 Request processed in 473us (9723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562534.968939:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5931 00002000:00100000:2.0:1786562534.968946:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2166784->2170879) req@ffff90e88c79d180 x1873345652761216/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562534.968955:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79d180 with x1873345652761216 ext(2166784->2170879) 00010000:00010000:2.0:1786562534.968961:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562534.968975:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562534.968982:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79d180 00000100:00100000:3.0:1786562534.973866:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.974396:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761344 00000100:00100000:1.0:1786562534.974409:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761344 00000100:00100000:1.0:1786562534.974481:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17590 00000100:00100000:1.0:1786562534.974494:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64053:x1873345652761344:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562534.974532:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562534.974557:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc92f expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.974608:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:1.0:1786562534.974620:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->3919871] (req 3891200->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.974629:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 3) 00010000:00010000:1.0:1786562534.974637:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.974688:0:6658:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->3919871] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.974707:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.974724:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bafdb600, rc 0) 00000100:00100000:1.0:1786562534.974792:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64053:x1873345652761344:12345-192.168.204.29@tcp:101:cat.0 Request processed in 301us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562534.974801:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17590 00000100:00100000:3.0:1786562534.983473:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562534.983925:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761472 00000100:00100000:0.0:1786562534.983938:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761472 00002000:00100000:0.0:1786562534.984049:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (2170880->2174975) req@ffff90e88313ed80 x1873345652761472/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.984062:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ed80 with x1873345652761472 ext(2170880->2174975) 00010000:00010000:0.0:1786562534.984075:0:29463:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.984096:0:29463:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.984104:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313ed80 00000100:00100000:0.0:1786562534.984144:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5932 00000100:00100000:0.0:1786562534.984155:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652761472:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562534.984452:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652761472:12345-192.168.204.29@tcp:3:cat.0 Request processed in 297us (993us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562534.984461:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5932 00002000:00100000:0.0:1786562534.984468:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (2170880->2174975) req@ffff90e88313ed80 x1873345652761472/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562534.984476:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ed80 with x1873345652761472 ext(2170880->2174975) 00010000:00010000:0.0:1786562534.984482:0:29463:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562534.984493:0:29463:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562534.984516:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313ed80 00000100:00100000:0.0:1786562534.992896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562534.999053:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761600 00000100:00100000:1.0:1786562534.999074:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761600 00002000:00100000:1.0:1786562534.999160:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2174976->2179071) req@ffff90e884339f80 x1873345652761600/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/0 e 0 to 0 dl 1786562545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562534.999172:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339f80 with x1873345652761600 ext(2174976->2179071) 00010000:00010000:1.0:1786562534.999185:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562534.999208:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562534.999218:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884339f80 00000100:00100000:1.0:1786562535.002793:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5933 00000100:00100000:1.0:1786562535.002848:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652761600:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562535.003153:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652761600:12345-192.168.204.29@tcp:3:cat.0 Request processed in 342us (10271us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562535.003162:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5933 00002000:00100000:1.0:1786562535.003173:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2174976->2179071) req@ffff90e884339f80 x1873345652761600/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:5/0 lens 488/4536 e 0 to 0 dl 1786562545 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.003184:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339f80 with x1873345652761600 ext(2174976->2179071) 00010000:00010000:1.0:1786562535.003195:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.003216:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.003225:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884339f80 00000100:00080000:3.0:1786562535.003454:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562535.006332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.006445:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761728 00000100:00100000:2.0:1786562535.006458:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761728 00002000:00100000:2.0:1786562535.006530:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2179072->2183167) req@ffff90e88313c380 x1873345652761728/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.006549:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313c380 with x1873345652761728 ext(2179072->2183167) 00010000:00010000:2.0:1786562535.006561:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.006590:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.006599:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313c380 00000100:00100000:2.0:1786562535.006636:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5934 00000100:00100000:2.0:1786562535.006650:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652761728:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562535.006906:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652761728:12345-192.168.204.29@tcp:3:cat.0 Request processed in 259us (584us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.006914:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5934 00002000:00100000:2.0:1786562535.006922:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (2179072->2183167) req@ffff90e88313c380 x1873345652761728/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.006929:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313c380 with x1873345652761728 ext(2179072->2183167) 00010000:00010000:2.0:1786562535.006935:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.006946:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.006953:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313c380 00000100:00100000:0.0:1786562535.018834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.018998:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761856 00000100:00100000:3.0:1786562535.019038:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761856 00002000:00100000:3.0:1786562535.019106:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (2183168->2187263) req@ffff90e88433ad80 x1873345652761856/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.019121:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433ad80 with x1873345652761856 ext(2183168->2187263) 00010000:00010000:3.0:1786562535.019132:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.019152:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562535.019161:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88433ad80 00000100:00100000:3.0:1786562535.019203:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5935 00000100:00100000:3.0:1786562535.019215:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652761856:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562535.019478:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652761856:12345-192.168.204.29@tcp:3:cat.0 Request processed in 266us (659us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562535.019487:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5935 00002000:00100000:3.0:1786562535.019495:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (2183168->2187263) req@ffff90e88433ad80 x1873345652761856/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.019504:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433ad80 with x1873345652761856 ext(2183168->2187263) 00010000:00010000:3.0:1786562535.019522:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.019535:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562535.019543:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88433ad80 00000100:00100000:1.0:1786562535.022436:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.022553:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652761984 00000100:00100000:0.0:1786562535.022565:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652761984 00002000:00100000:0.0:1786562535.022630:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2187264->2191359) req@ffff90e88c79fb80 x1873345652761984/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.022642:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79fb80 with x1873345652761984 ext(2187264->2191359) 00010000:00010000:0.0:1786562535.022653:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.022673:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.022682:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79fb80 00000100:00100000:0.0:1786562535.022759:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5936 00000100:00100000:0.0:1786562535.022772:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652761984:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562535.023051:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652761984:12345-192.168.204.29@tcp:3:cat.0 Request processed in 280us (627us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562535.023059:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5936 00002000:00100000:0.0:1786562535.023065:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2187264->2191359) req@ffff90e88c79fb80 x1873345652761984/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.023073:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79fb80 with x1873345652761984 ext(2187264->2191359) 00010000:00010000:0.0:1786562535.023080:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.023091:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.023099:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79fb80 00000100:00100000:2.0:1786562535.028630:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.031533:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762112 00000100:00100000:3.0:1786562535.031552:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762112 00000100:00100000:3.0:1786562535.031906:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17591 00000100:00100000:3.0:1786562535.031924:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+18:64060:x1873345652762112:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562535.031947:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.031970:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc936 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.032030:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 7 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.032043:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 10 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.032051:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=1s v=(2 2) 00010000:00010000:3.0:1786562535.032056:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562535.032063:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1323008->2097151] (req 1323008->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.032110:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 10 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.032123:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 10 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.032141:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654853760:192.168.204.29@tcp:104: 00000100:00080000:2.0:1786562535.032669:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562535.032738:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562535.032814:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 7 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.032828:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 7 pid: 29966 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.032841:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654853888:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.032875:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439300 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.037421:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762240 00000100:00100000:1.0:1786562535.037442:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762240 00002000:00100000:1.0:1786562535.037526:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (2191360->2195455) req@ffff90e88b11ce00 x1873345652762240/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.037539:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11ce00 with x1873345652762240 ext(2191360->2195455) 00010000:00010000:1.0:1786562535.037552:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.037983:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.037995:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b11ce00 00000100:00100000:1.0:1786562535.038057:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5937 00000100:00100000:1.0:1786562535.038070:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652762240:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562535.038351:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652762240:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 283us (5612us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562535.038360:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5937 00002000:00100000:1.0:1786562535.038369:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x714:0x0] (2191360->2195455) req@ffff90e88b11ce00 x1873345652762240/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.038379:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11ce00 with x1873345652762240 ext(2191360->2195455) 00010000:00010000:1.0:1786562535.038386:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.038397:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.038403:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b11ce00 00000100:00100000:2.0:1786562535.038859:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654853760:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562535.038874:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654853888:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562535.038909:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1323008->2097151] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.038930:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365200, rc 0) 00000100:00100000:2.0:1786562535.038969:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+19:64060:x1873345652762112:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 7051us (10353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.038977:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17591 00000100:00100000:0.0:1786562535.046271:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.046415:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762368 00000100:00100000:3.0:1786562535.046428:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762368 00002000:00100000:3.0:1786562535.046488:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (2195456->2199551) req@ffff90e884338a80 x1873345652762368/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.046510:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338a80 with x1873345652762368 ext(2195456->2199551) 00010000:00010000:3.0:1786562535.046522:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.046537:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562535.046546:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884338a80 00000100:00100000:1.0:1786562535.046708:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5938 00000100:00100000:1.0:1786562535.046722:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652762368:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562535.046979:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652762368:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 259us (722us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562535.046988:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5938 00002000:00100000:1.0:1786562535.046995:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (2195456->2199551) req@ffff90e884338a80 x1873345652762368/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.047036:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338a80 with x1873345652762368 ext(2195456->2199551) 00010000:00010000:1.0:1786562535.047043:0:16005:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.047053:0:16005:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.047060:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884338a80 00000100:00100000:1.0:1786562535.050561:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.050619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.050889:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762752 00000100:00100000:2.0:1786562535.050903:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762752 00002000:00100000:2.0:1786562535.050966:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2199552->2203647) req@ffff90e88c79e300 x1873345652762752/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.050978:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79e300 with x1873345652762752 ext(2199552->2203647) 00010000:00010000:2.0:1786562535.050989:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.051058:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.051067:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79e300 00000100:00100000:2.0:1786562535.051101:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5939 00000100:00100000:2.0:1786562535.051113:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652762752:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.051519:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652762752:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 406us (898us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.051528:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5939 00002000:00100000:2.0:1786562535.051535:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2199552->2203647) req@ffff90e88c79e300 x1873345652762752/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.051544:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c79e300 with x1873345652762752 ext(2199552->2203647) 00010000:00010000:2.0:1786562535.051550:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.051559:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.051566:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88c79e300 00000100:00100000:3.0:1786562535.051700:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762624 00000100:00100000:3.0:1786562535.051706:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762624 00010000:00010000:3.0:1786562535.051754:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 8 pid: 29966 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.051785:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8589 00000100:00100000:3.0:1786562535.051794:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652762624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562535.051808:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562535.051833:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 8 pid: 29966 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.051846:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 8 pid: 29966 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.051875:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724acea4/0x5c655bf66689e9d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8db expref: 8 pid: 29966 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.051896:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1786562535.051951:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562535.054347:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652762624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2538us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562535.054367:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8589 00000100:00100000:0.0:1786562535.058024:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.058393:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762496 00000100:00100000:3.0:1786562535.058407:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762496 00010000:00010000:3.0:1786562535.058459:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 11 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.058659:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8590 00000100:00100000:3.0:1786562535.058672:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652762496:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562535.058696:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562535.058724:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 11 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.058746:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 11 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.058774:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003790471a/0x5c655bf66689e9e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8e2 expref: 11 pid: 6658 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.058793:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562535.058798:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1786562535.058808:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.058819:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.058866:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.058884:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654854016:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562535.069090:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.080418:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.080694:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652762880 00000100:00100000:2.0:1786562535.080708:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652762880 00002000:00100000:2.0:1786562535.080787:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2203648->2207743) req@ffff90e884338000 x1873345652762880/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.080799:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338000 with x1873345652762880 ext(2203648->2207743) 00010000:00010000:2.0:1786562535.080812:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.080833:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.080848:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884338000 00000100:00100000:2.0:1786562535.080884:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5940 00000100:00100000:2.0:1786562535.080896:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652762880:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.081171:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652762880:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 276us (770us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.081180:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5940 00002000:00100000:2.0:1786562535.081188:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2203648->2207743) req@ffff90e884338000 x1873345652762880/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.081197:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338000 with x1873345652762880 ext(2203648->2207743) 00010000:00010000:2.0:1786562535.081203:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.081216:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.081224:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884338000 00000100:00100000:2.0:1786562535.089193:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.089941:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763008 00000100:00100000:0.0:1786562535.089954:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763008 00002000:00100000:0.0:1786562535.090110:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72e:0x0] (1323008->1327103) req@ffff90e88b11fb80 x1873345652763008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.090124:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11fb80 with x1873345652763008 ext(1323008->1327103) 00002000:00010000:0.0:1786562535.090132:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11fb80 00000100:00100000:3.0:1786562535.090349:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654854016:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562535.090378:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562535.090453:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652762496:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 31783us (32457us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562535.090466:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8590 00000100:00100000:0.0:1786562535.090588:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11444 00000100:00100000:0.0:1786562535.090600:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652763008:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.090834:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652763008:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 237us (1655us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562535.090841:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11444 00002000:00100000:0.0:1786562535.090848:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72e:0x0] (1323008->1327103) req@ffff90e88b11fb80 x1873345652763008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.090861:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11fb80 with x1873345652763008 ext(1323008->1327103) 00002000:00010000:0.0:1786562535.090864:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11fb80 00000100:00100000:3.0:1786562535.100092:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.100129:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.100615:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763264 00000100:00100000:1.0:1786562535.100629:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763264 00002000:00100000:1.0:1786562535.100699:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88313ce00 x1873345652763264/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 504/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.100713:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ce00 with x1873345652763264 ext(1048576->2097151) 00002000:00010000:1.0:1786562535.100720:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313ce00 00000100:00100000:1.0:1786562535.100833:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763136 00000100:00100000:1.0:1786562535.100838:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763136 00002000:00100000:1.0:1786562535.100858:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (2207744->2211839) req@ffff90e88313df80 x1873345652763136/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.100867:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313df80 with x1873345652763136 ext(2207744->2211839) 00010000:00010000:1.0:1786562535.100878:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.100896:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.100905:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313df80 00000100:00100000:0.0:1786562535.107186:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5941 00000100:00100000:0.0:1786562535.107223:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652763136:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.108191:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652763136:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 985us (8057us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562535.108203:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5941 00002000:00100000:0.0:1786562535.108216:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2207744->2211839) req@ffff90e88313df80 x1873345652763136/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.108228:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313df80 with x1873345652763136 ext(2207744->2211839) 00010000:00010000:0.0:1786562535.108248:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.108270:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.108280:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88313df80 00000100:00100000:0.0:1786562535.108329:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11445 00000100:00100000:0.0:1786562535.108340:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652763264:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.120054:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.120202:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763392 00000100:00100000:1.0:1786562535.120215:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763392 00002000:00100000:1.0:1786562535.120289:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2211840->2215935) req@ffff90e884338380 x1873345652763392/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.120311:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338380 with x1873345652763392 ext(2211840->2215935) 00010000:00010000:1.0:1786562535.120322:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.120343:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.120352:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884338380 00000100:00100000:1.0:1786562535.120387:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5942 00000100:00100000:1.0:1786562535.120397:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652763392:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562535.120657:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652763392:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 260us (657us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562535.120666:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5942 00002000:00100000:1.0:1786562535.120673:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2211840->2215935) req@ffff90e884338380 x1873345652763392/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.120683:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884338380 with x1873345652763392 ext(2211840->2215935) 00010000:00010000:1.0:1786562535.120690:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.120702:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.120710:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884338380 00010000:00010000:1.0:1786562535.149326:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562535.153618:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652763264:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 45264us (53525us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1786562535.153636:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11445 00002000:00100000:1.0:1786562535.153653:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e88313ce00 x1873345652763264/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 504/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.153664:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88313ce00 with x1873345652763264 ext(1048576->2097151) 00002000:00010000:1.0:1786562535.153672:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88313ce00 00000100:00100000:3.0:1786562535.165477:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.165658:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763520 00000100:00100000:2.0:1786562535.165671:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763520 00002000:00100000:2.0:1786562535.165735:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (2215936->2220031) req@ffff90e88ac85f80 x1873345652763520/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.165747:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac85f80 with x1873345652763520 ext(2215936->2220031) 00010000:00010000:2.0:1786562535.165759:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.165779:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.165788:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac85f80 00000100:00100000:2.0:1786562535.165825:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5943 00000100:00100000:2.0:1786562535.165836:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652763520:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.166143:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652763520:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 309us (682us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.166153:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5943 00002000:00100000:2.0:1786562535.166160:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (2215936->2220031) req@ffff90e88ac85f80 x1873345652763520/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.166169:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac85f80 with x1873345652763520 ext(2215936->2220031) 00010000:00010000:2.0:1786562535.166174:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.166186:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.166193:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac85f80 00000100:00100000:2.0:1786562535.179190:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.179414:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763776 00000100:00100000:3.0:1786562535.179428:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763776 00000100:00100000:3.0:1786562535.179514:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17592 00000100:00100000:3.0:1786562535.179527:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:64060:x1873345652763776:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562535.179551:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.179587:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc93d expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.179627:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 6 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.179638:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562535.179644:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1786562535.179650:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 20 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.179694:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 6 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.179707:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 6 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.179724:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654854144:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.179824:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.182969:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654854144:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.183046:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 20 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.183073:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364a00, rc 0) 00000100:00100000:1.0:1786562535.183139:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:64060:x1873345652763776:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 3615us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.183154:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17592 00000100:00100000:0.0:1786562535.185252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.185496:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763648 00000100:00100000:2.0:1786562535.185515:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763648 00002000:00100000:2.0:1786562535.185578:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2220032->2224127) req@ffff90e884339500 x1873345652763648/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.185591:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339500 with x1873345652763648 ext(2220032->2224127) 00010000:00010000:2.0:1786562535.185601:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.185618:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.185628:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884339500 00000100:00100000:2.0:1786562535.185661:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5944 00000100:00100000:2.0:1786562535.185681:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652763648:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.185986:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652763648:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 307us (752us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.185993:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5944 00002000:00100000:2.0:1786562535.185999:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (2220032->2224127) req@ffff90e884339500 x1873345652763648/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.186048:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884339500 with x1873345652763648 ext(2220032->2224127) 00010000:00010000:2.0:1786562535.186054:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.186064:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.186071:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e884339500 00000100:00100000:3.0:1786562535.186655:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.187179:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652763904 00000100:00100000:0.0:1786562535.187186:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652763904 00010000:00010000:0.0:1786562535.187214:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.187254:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8591 00000100:00100000:0.0:1786562535.187270:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652763904:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.187283:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.187317:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.187331:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.187357:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004df9615/0x5c655bf66689ea57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc91a expref: 7 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.187376:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562535.187381:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562535.187390:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 19 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.187401:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 19 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.187440:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 19 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.187456:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654854272:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562535.187539:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.192460:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654854272:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562535.192506:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.192578:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652763904:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5308us (5924us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.192593:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8591 00000100:00100000:2.0:1786562535.195267:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.195314:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.195483:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764032 00000100:00100000:3.0:1786562535.195505:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764032 00002000:00100000:3.0:1786562535.195577:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x72f:0x0] (1089536->1093631) req@ffff90e88b11c000 x1873345652764032/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.195589:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11c000 with x1873345652764032 ext(1089536->1093631) 00002000:00010000:3.0:1786562535.195596:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11c000 00000100:00100000:3.0:1786562535.195625:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764160 00000100:00100000:3.0:1786562535.195628:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764160 00002000:00100000:3.0:1786562535.195646:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (2224128->2228223) req@ffff90e88b11dc00 x1873345652764160/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.195655:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11dc00 with x1873345652764160 ext(2224128->2228223) 00010000:00010000:3.0:1786562535.195663:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.195684:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562535.195692:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b11dc00 00000100:00100000:3.0:1786562535.195715:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5945 00000100:00100000:3.0:1786562535.195727:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652764160:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.195857:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11446 00000100:00100000:0.0:1786562535.195867:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652764032:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.196124:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652764032:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 258us (883us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562535.196132:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11446 00002000:00100000:0.0:1786562535.196138:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (1089536->1093631) req@ffff90e88b11c000 x1873345652764032/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.196146:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11c000 with x1873345652764032 ext(1089536->1093631) 00002000:00010000:0.0:1786562535.196150:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b11c000 00000100:00100000:3.0:1786562535.196548:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652764160:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 822us (1232us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562535.196556:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5945 00002000:00100000:3.0:1786562535.196561:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (2224128->2228223) req@ffff90e88b11dc00 x1873345652764160/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.196854:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11dc00 with x1873345652764160 ext(2224128->2228223) 00010000:00010000:3.0:1786562535.196862:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.196878:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562535.196886:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b11dc00 00000100:00100000:1.0:1786562535.200599:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.200789:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764416 00000100:00100000:0.0:1786562535.200801:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764416 00000100:00100000:0.0:1786562535.200877:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6259 00000100:00100000:0.0:1786562535.200888:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+521:64060:x1873345652764416:12345-192.168.204.29@tcp:35:multiop.0 00000100:00080000:2.0:1786562535.201391:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562535.202115:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+522:64060:x1873345652764416:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 1224us (1523us total) trans 8589950614 rc 0/0 00000100:00100000:0.0:1786562535.202127:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6259 00000100:00100000:2.0:1786562535.263762:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.263810:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.264109:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764544 00000100:00100000:2.0:1786562535.264121:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764544 00002000:00100000:2.0:1786562535.264186:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2228224->3145727) req@ffff90e88b11d500 x1873345652764544/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.264200:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11d500 with x1873345652764544 ext(2228224->3145727) 00010000:00010000:2.0:1786562535.264212:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.264493:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764672 00000100:00100000:0.0:1786562535.264498:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764672 00002000:00100000:0.0:1786562535.264524:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72f:0x0] (1093632->2097151) req@ffff90e9bfe91880 x1873345652764672/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.264538:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91880 with x1873345652764672 ext(1093632->2097151) 00002000:00010000:0.0:1786562535.264543:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe91880 00000100:00100000:0.0:1786562535.264573:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11447 00000100:00100000:0.0:1786562535.264583:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652764672:12345-192.168.204.29@tcp:3:multiop.0 00010000:00010000:2.0:1786562535.267980:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.268018:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b11d500 00000100:00100000:2.0:1786562535.268073:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5946 00000100:00100000:2.0:1786562535.268091:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652764544:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.304189:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652764672:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 39590us (40361us total) trans 0 rc 1003520/1003520 00000100:00100000:0.0:1786562535.304207:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11447 00002000:00100000:0.0:1786562535.304224:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72f:0x0] (1093632->2097151) req@ffff90e9bfe91880 x1873345652764672/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1003520/1003520 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.304246:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfe91880 with x1873345652764672 ext(1093632->2097151) 00002000:00010000:0.0:1786562535.304261:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bfe91880 00000100:00100000:2.0:1786562535.305590:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2349:x1873345652764544:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 37501us (42011us total) trans 0 rc 917504/917504 00000100:00100000:2.0:1786562535.305603:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5946 00002000:00100000:2.0:1786562535.305613:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (2228224->3145727) req@ffff90e88b11d500 x1873345652764544/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 917504/917504 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.305624:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b11d500 with x1873345652764544 ext(2228224->3145727) 00010000:00010000:2.0:1786562535.305635:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.305657:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.305666:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b11d500 00000100:00100000:0.0:1786562535.319954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.320191:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764800 00000100:00100000:2.0:1786562535.320205:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764800 00000100:00100000:2.0:1786562535.320290:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17593 00000100:00100000:2.0:1786562535.320315:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:64047:x1873345652764800:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562535.320339:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.320363:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc944 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.320403:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.320413:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=1s v=(2 2) 00010000:00010000:2.0:1786562535.320418:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 2) 00010000:00010000:2.0:1786562535.320423:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 21 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.320463:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.320476:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 5 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.320493:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654854400:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562535.320878:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.325896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.325991:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652764928 00000100:00100000:2.0:1786562535.326032:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652764928 00010000:00010000:2.0:1786562535.326087:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.326139:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8592 00000100:00100000:2.0:1786562535.326149:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652764928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.326168:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.326200:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.326214:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.326261:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d758f5/0x5c655bf66689e9a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8b8 expref: 28 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.326283:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 3) 00010000:00010000:2.0:1786562535.326288:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 3) 00010000:00010000:2.0:1786562535.326307:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.326324:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.326371:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.326383:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x70000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 10 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.326399:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654854528:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562535.326528:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bb0c0 going to sleep for 11 seconds 00000001:00080000:3.0:1786562535.328136:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950614 is committed 00000001:00080000:3.0:1786562535.328157:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950612 is committed 00000001:00080000:3.0:1786562535.328166:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950601 is committed 00000001:00080000:3.0:1786562535.328250:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950608 is committed 00000001:00080000:3.0:1786562535.328326:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950613 is committed 00000100:00100000:0.0:1786562535.333639:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.333770:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654854400:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562535.333816:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 21 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.333844:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176fe00, rc 0) 00000100:00100000:2.0:1786562535.333923:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:64047:x1873345652764800:12345-192.168.204.29@tcp:101:cat.0 Request processed in 13623us (13985us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.333934:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17593 00000100:00100000:1.0:1786562535.334963:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765056 00000100:00100000:1.0:1786562535.334976:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765056 00002000:00100000:1.0:1786562535.335056:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (3170304->3993599) req@ffff90e88433a300 x1873345652765056/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.335068:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433a300 with x1873345652765056 ext(3170304->3993599) 00010000:00010000:1.0:1786562535.335078:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 6 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.335093:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 6 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.335102:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88433a300 00000100:00100000:1.0:1786562535.335127:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5947 00000100:00100000:1.0:1786562535.335138:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652765056:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:2.0:1786562535.339142:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654854528:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562535.339176:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.339261:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652764928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13112us (13378us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.339280:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8592 00000100:00100000:3.0:1786562535.339714:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.340091:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765184 00000100:00100000:2.0:1786562535.340101:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765184 00002000:00100000:2.0:1786562535.340169:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (3891200->3895295) req@ffff90e88ac87480 x1873345652765184/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.340181:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac87480 with x1873345652765184 ext(3891200->3895295) 00010000:00010000:2.0:1786562535.340193:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.340210:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.340218:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac87480 00000100:00100000:2.0:1786562535.340374:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5948 00000100:00100000:2.0:1786562535.340388:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652765184:12345-192.168.204.29@tcp:3:cat.0 00000100:00080000:3.0:1786562535.341768:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562535.343916:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652765184:12345-192.168.204.29@tcp:3:cat.0 Request processed in 3516us (4189us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.343932:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5948 00002000:00100000:2.0:1786562535.343945:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (3891200->3895295) req@ffff90e88ac87480 x1873345652765184/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.343957:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac87480 with x1873345652765184 ext(3891200->3895295) 00010000:00010000:2.0:1786562535.343970:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.343991:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.344000:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac87480 00000100:00100000:3.0:1786562535.350807:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.351754:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765312 00000100:00100000:0.0:1786562535.351769:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765312 00002000:00100000:0.0:1786562535.351834:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3915776->3919871) req@ffff90e88ac85180 x1873345652765312/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.351847:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac85180 with x1873345652765312 ext(3915776->3919871) 00010000:00010000:0.0:1786562535.351858:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.351874:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.351887:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac85180 00000100:00100000:0.0:1786562535.351928:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5949 00000100:00100000:0.0:1786562535.351940:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652765312:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562535.352266:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652765312:12345-192.168.204.29@tcp:3:cat.0 Request processed in 317us (1464us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562535.352275:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5949 00002000:00100000:0.0:1786562535.352283:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3915776->3919871) req@ffff90e88ac85180 x1873345652765312/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.352291:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac85180 with x1873345652765312 ext(3915776->3919871) 00010000:00010000:0.0:1786562535.352307:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.352317:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.352325:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac85180 00000100:00100000:3.0:1786562535.361540:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.363478:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765440 00000100:00100000:0.0:1786562535.363505:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765440 00000100:00100000:0.0:1786562535.363600:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17076 00000100:00100000:0.0:1786562535.363612:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:64063:x1873345652765440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562535.363647:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.363685:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ea88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc94b expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.363781:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.363797:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.363809:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.363827:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.363834:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.363840:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.365614:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.365641:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.365650:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.365914:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.365933:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 10 pid: 33140 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.365951:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654854656:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562535.366102:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99829dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562535.368646:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.370734:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765568 00000100:00100000:0.0:1786562535.370751:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765568 00002000:00100000:0.0:1786562535.370809:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (3891200->3919871) req@ffff90e88ac87800 x1873345652765568/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.370822:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac87800 with x1873345652765568 ext(3891200->3919871) 00010000:00010000:0.0:1786562535.370833:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.370849:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 11 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.370857:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac87800 00000100:00100000:0.0:1786562535.370896:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5950 00000100:00100000:0.0:1786562535.370908:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652765568:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562535.375475:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652765056:12345-192.168.204.29@tcp:4:cat.0 Request processed in 40322us (41835us total) trans 21474843562 rc 0/0 00000100:00100000:1.0:1786562535.375494:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5947 00002000:00100000:1.0:1786562535.375510:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (3170304->3993599) req@ffff90e88433a300 x1873345652765056/t21474843562(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/448 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.375521:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88433a300 with x1873345652765056 ext(3170304->3993599) 00010000:00010000:1.0:1786562535.375534:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 8 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.375556:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 8 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.375580:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88433a300 00000100:00100000:0.0:1786562535.378793:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654854656:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562535.378832:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.388422:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652765568:12345-192.168.204.29@tcp:4:cat.0 Request processed in 17499us (19771us total) trans 17179876042 rc 0/0 00000100:00100000:0.0:1786562535.388440:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5950 00002000:00100000:0.0:1786562535.388458:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (3891200->3919871) req@ffff90e88ac87800 x1873345652765568/t17179876042(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/448 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.388469:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac87800 with x1873345652765568 ext(3891200->3919871) 00010000:00010000:0.0:1786562535.388484:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 13 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.388512:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 13 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.388523:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88ac87800 00000100:00100000:2.0:1786562535.393478:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.393610:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765824 00000100:00100000:0.0:1786562535.393623:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765824 00000100:00100000:0.0:1786562535.393716:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6260 00000100:00100000:0.0:1786562535.393729:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:49279:x1873345652765824:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786562535.394169:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:49279:x1873345652765824:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 442us (703us total) trans 8589950615 rc 0/0 00000100:00100000:0.0:1786562535.394177:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6260 00000100:00080000:3.0:1786562535.394906:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562535.396653:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.396798:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652765952 00000100:00100000:2.0:1786562535.396810:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652765952 00010000:00010000:2.0:1786562535.396862:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 12 pid: 33140 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.396910:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8593 00000100:00100000:2.0:1786562535.396922:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652765952:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.396940:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.396948:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 12 pid: 33140 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.396962:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 12 pid: 33140 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.396992:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ea49 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc913 expref: 12 pid: 33140 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.397052:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562535.397059:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.397076:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.397086:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.397112:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.397172:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652765952:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 251us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.397179:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8593 00010000:00010000:0.0:1786562535.398578:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398591:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562535.398652:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:0.0:1786562535.398658:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562535.398691:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398706:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398717:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398725:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398731:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398737:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bfd5a800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562535.398742:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398750:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398765:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562535.398768:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562535.398773:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398779:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ea8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398794:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398804:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398810:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398815:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f22600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562535.398818:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398829:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398837:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562535.398839:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562535.398841:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398847:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22600/0x5c655bf66689ea96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398894:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ea88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398910:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.398918:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562535.398920:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562535.398923:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22000, rc 0) 00000100:00100000:0.0:1786562535.398993:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64063:x1873345652765440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 35382us (37466us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.399002:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17076 00000100:00100000:1.0:1786562535.406517:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.406556:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.406587:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.406615:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.406819:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766080 00000100:00100000:3.0:1786562535.406831:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766080 00000100:00100000:3.0:1786562535.406896:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766208 00000100:00100000:3.0:1786562535.406899:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766208 00000100:00100000:3.0:1786562535.406918:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766336 00000100:00100000:3.0:1786562535.406921:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766336 00000100:00100000:3.0:1786562535.406942:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766464 00000100:00100000:3.0:1786562535.406945:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766464 00000100:00100000:3.0:1786562535.406970:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17594 00000100:00100000:3.0:1786562535.406981:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652766080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.407028:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.407053:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689eaa4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc952 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.407126:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654854784:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562535.407224:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439300 going to sleep for 11 seconds 00000100:00100000:3.0:1786562535.407247:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17595 00000100:00100000:3.0:1786562535.407268:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652766208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.407275:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.407284:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689eaab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc959 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.407325:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654854912:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562535.407349:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9884390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562535.407366:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17596 00000100:00100000:3.0:1786562535.407373:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652766336:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.407380:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.407391:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689eab2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc960 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.407414:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689eab2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc960 expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.407442:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb2291b0/0x5c655bf66689eab2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc960 expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.407455:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365a00, rc 0) 00000100:00100000:3.0:1786562535.407481:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652766336:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 109us (894us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562535.407488:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17596 00000100:00100000:3.0:1786562535.407518:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17597 00000100:00100000:3.0:1786562535.407524:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652766464:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.407530:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.407537:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689eab9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc967 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.407561:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654855040:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562535.407590:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.419057:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.419130:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:0.0:1786562535.419332:0:8368:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562533 -> 1786562534 00002000:00010000:0.0:1786562535.419338:0:8368:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562533 -> 1786562534 00002000:00010000:0.0:1786562535.419340:0:8368:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562533 -> 1786562534 00000100:00100000:0.0:1786562535.419365:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654854784:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562535.419413:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689eaa4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc952 expref: 15 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.419440:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689eaa4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc952 expref: 15 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.419453:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:0.0:1786562535.419530:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652766080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 12550us (13036us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562535.419540:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17594 00002000:00010000:0.0:1786562535.420382:0:29966:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562533 -> 1786562534 00002000:00010000:0.0:1786562535.420386:0:29966:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562533 -> 1786562534 00002000:00010000:0.0:1786562535.420388:0:29966:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562533 -> 1786562534 00000100:00100000:0.0:1786562535.420402:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654854912:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562535.420423:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689eaab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc959 expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.420438:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689eaab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc959 expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.420448:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:0.0:1786562535.420478:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652766208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 13226us (13922us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562535.420485:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17595 00010000:00010000:0.0:1786562535.422440:0:6658:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.29@tcp) returned -22 from glimpse AST (req@00000000acc63905 x1873345654855040) - normal race ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 7 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562535.422477:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562533 -> 1786562534 00010000:00010000:0.0:1786562535.422503:0:6658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 7 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.422530:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689e97e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3170304->3993599) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc8a3 expref: 7 pid: 6658 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.422548:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654855040:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562535.422587:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 2) 00010000:00010000:0.0:1786562535.422593:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 2) 00010000:00010000:0.0:1786562535.422604:0:6658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.422615:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.422690:0:6658:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.422708:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654855168:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562535.422808:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562535.429793:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766592 00000100:00100000:2.0:1786562535.429813:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766592 00000100:00100000:2.0:1786562535.429911:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766720 00000100:00100000:2.0:1786562535.429915:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766720 00000100:00100000:0.0:1786562535.430025:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 963 00000100:00100000:0.0:1786562535.430042:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992131850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652766592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.430064:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.430067:0:5808:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 5c655bf66689e97e) 00010000:00010000:0.0:1786562535.430070:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.430162:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992131850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652766592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 126us (11165us total) trans 0 rc 116/116 00000100:00100000:0.0:1786562535.430170:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 963 00010000:00010000:2.0:1786562535.430594:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 13 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.430634:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8594 00000100:00100000:2.0:1786562535.430642:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652766720:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.430654:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1786562535.430688:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562533 -> 1786562534 00002000:00010000:2.0:1786562535.430692:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562533 -> 1786562534 00010000:00010000:2.0:1786562535.430699:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 13 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.430714:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 13 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.430746:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689ea5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3891200->4194303] (req 3891200->3919871) gid 0 flags: 0x44801000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc921 expref: 13 pid: 29964 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.430812:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 3) 00010000:00010000:2.0:1786562535.430818:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 3) 00010000:00010000:2.0:1786562535.430828:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.430841:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.430885:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.430902:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654855296:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562535.431660:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562535.434277:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654855168:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562535.434336:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689eab9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc967 expref: 11 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.434367:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689eab9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc967 expref: 11 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.434381:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:2.0:1786562535.434438:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2350:x1873345652766464:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 26913us (27822us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562535.434447:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17597 00000100:00100000:1.0:1786562535.434816:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.435074:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652766848 00000100:00100000:2.0:1786562535.435083:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652766848 00002000:00100000:2.0:1786562535.435136:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e9a9948a80 x1873345652766848/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.435147:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9948a80 with x1873345652766848 ext(2097152->3145727) 00002000:00010000:2.0:1786562535.435152:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a9948a80 00000100:00100000:2.0:1786562535.435185:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11448 00000100:00100000:2.0:1786562535.435196:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652766848:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.453309:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652766848:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 18086us (18466us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562535.453328:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11448 00002000:00100000:2.0:1786562535.453346:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e9a9948a80 x1873345652766848/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.453358:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9948a80 with x1873345652766848 ext(2097152->3145727) 00002000:00010000:2.0:1786562535.453366:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a9948a80 00000100:00100000:2.0:1786562535.460586:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654855296:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562535.460624:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.460721:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652766720:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 30078us (41587us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.460735:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8594 00000100:00100000:1.0:1786562535.462363:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.462437:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652767104 00000100:00100000:3.0:1786562535.462447:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652767104 00000100:00100000:3.0:1786562535.462609:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17077 00000100:00100000:3.0:1786562535.462622:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64063:x1873345652767104:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.462649:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.462676:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689eac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc96e expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.462807:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.462827:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.462838:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.462880:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.462896:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 9 pid: 33114 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.462913:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654855424:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.466822:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.470328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.470529:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652767360 00000100:00100000:2.0:1786562535.470544:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652767360 00000100:00100000:2.0:1786562535.470621:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17598 00000100:00100000:2.0:1786562535.470632:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+27:64047:x1873345652767360:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562535.470656:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.470686:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc975 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.470723:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 3) 00010000:00010000:2.0:1786562535.470728:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 3) 00010000:00010000:2.0:1786562535.470739:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 28 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.470758:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 28 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.470775:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176f200, rc 0) 00000100:00100000:2.0:1786562535.470864:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+28:64047:x1873345652767360:12345-192.168.204.29@tcp:101:cat.0 Request processed in 234us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.470873:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17598 00000100:00100000:2.0:1786562535.473711:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.473759:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652767744 00000100:00100000:2.0:1786562535.473770:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652767744 00000100:00100000:2.0:1786562535.473835:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17078 00000100:00100000:2.0:1786562535.473847:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+503:64066:x1873345652767744:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562535.473878:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.473904:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ead5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc97c expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474001:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474040:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474052:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474069:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474076:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474088:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474580:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689eaea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474593:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689eaea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474601:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689eaea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562535.474612:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562535.474736:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474747:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474754:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474761:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf65e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562535.474766:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474774:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474790:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562535.474793:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562535.474799:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474805:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eadc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474819:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474825:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474832:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474837:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf64800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562535.474841:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474847:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474855:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479db00) 00010000:00010000:2.0:1786562535.474857:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562535.474860:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474866:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474914:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ead5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc97c expref: 506 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474929:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689eaea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc97c expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.474937:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562535.474939:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786562535.474942:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a99f1c00, rc 0) 00000100:00100000:2.0:1786562535.475037:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+505:64066:x1873345652767744:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1160us (1306us total) trans 8589950616 rc 0/0 00000100:00100000:2.0:1786562535.475046:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17078 00000100:00100000:1.0:1786562535.475762:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.482113:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652767488 00000100:00100000:2.0:1786562535.482135:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652767488 00010000:00010000:2.0:1786562535.482209:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 10 pid: 33114 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.482957:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8595 00000100:00100000:2.0:1786562535.482972:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2350:x1873345652767488:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.482993:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.483001:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 10 pid: 33114 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.483066:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 10 pid: 33114 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.483096:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562535.483102:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.483114:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.483122:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.483147:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.483240:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2350:x1873345652767488:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 272us (7481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.484205:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8595 00010000:00010000:3.0:1786562535.486209:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22000/0x5c655bf66689ea9d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc94b expref: 9 pid: 33114 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.486403:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654855424:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.486436:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.487195:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.487260:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.487288:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652767872 00000100:00100000:1.0:1786562535.487307:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652767872 00000100:00100000:1.0:1786562535.487374:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17599 00000100:00100000:1.0:1786562535.487385:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:64066:x1873345652767872:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562535.487407:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.487430:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc983 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487475:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 11 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487486:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 11 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487559:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487569:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=3s v=(0 3) 00010000:00010000:1.0:1786562535.487575:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 3) 00010000:00010000:1.0:1786562535.487581:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [319488->344063] (req 319488->344063) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487624:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487642:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.487661:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654855552:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.487945:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 11 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.487963:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 11 pid: 29965 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.487974:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654855680:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.488043:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 11 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.488053:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 11 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.488063:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654855808:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562535.488087:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562535.488471:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652767232 00000100:00100000:3.0:1786562535.488477:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652767232 00002000:00100000:3.0:1786562535.488883:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9a9949880 x1873345652767232/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.488895:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9949880 with x1873345652767232 ext(3145728->4194303) 00002000:00010000:3.0:1786562535.488902:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a9949880 00000100:00100000:1.0:1786562535.488940:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.488977:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768000 00000100:00100000:1.0:1786562535.488982:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768000 00000100:00100000:1.0:1786562535.489040:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 964 00000100:00100000:1.0:1786562535.489048:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+505:2348:x1873345652768000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562535.489061:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562535.489089:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1c00/0x5c655bf66689eaea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc97c expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.489110:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562535.489115:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562535.489146:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:2348:x1873345652768000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.489155:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 964 00010000:00010000:0.0:1786562535.489836:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.489846:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562535.489868:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562535.490084:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689eac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.490103:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.490116:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562535.490119:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562535.490121:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:0.0:1786562535.490166:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652767104:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 27547us (27915us total) trans 8589950617 rc 0/0 00000100:00100000:0.0:1786562535.490173:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17077 00000100:00100000:3.0:1786562535.491039:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11449 00000100:00100000:3.0:1786562535.491055:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652767232:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562535.506624:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654855552:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.506648:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654855680:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.506661:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654855808:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.506709:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [319488->344063] (req 319488->344063) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.506736:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:3.0:1786562535.506892:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:64066:x1873345652767872:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 19507us (19638us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562535.506902:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17599 00000100:00100000:2.0:1786562535.525864:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.526042:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.526077:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768256 00000100:00100000:2.0:1786562535.526088:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768256 00010000:00010000:2.0:1786562535.526140:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 12 pid: 29965 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.526188:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8596 00000100:00100000:2.0:1786562535.526201:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652768256:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.526221:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.526264:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 12 pid: 29965 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.526280:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 12 pid: 29965 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.526322:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689e724 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc730 expref: 12 pid: 29965 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.526344:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.526402:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652768256:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 204us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.526410:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8596 00000100:00100000:2.0:1786562535.526472:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.526499:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768512 00000100:00100000:2.0:1786562535.526503:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768512 00010000:00010000:2.0:1786562535.526520:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 14 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.526543:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8597 00000100:00100000:2.0:1786562535.526551:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652768512:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.527631:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.527664:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 14 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.527679:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 14 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.527700:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689e683 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6dc expref: 14 pid: 29963 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.527717:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.527764:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652768512:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1213us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.527774:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8597 00000100:00100000:2.0:1786562535.527850:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.527885:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768384 00000100:00100000:2.0:1786562535.527892:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768384 00010000:00010000:2.0:1786562535.527915:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.527940:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8598 00000100:00100000:2.0:1786562535.527948:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652768384:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.527960:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.527970:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.527986:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.528000:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689e6d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc70d expref: 29 pid: 29966 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.528030:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 3) 00010000:00010000:2.0:1786562535.528036:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 3) 00010000:00010000:2.0:1786562535.528045:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.528056:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.528101:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 28 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.528117:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654855936:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562535.528182:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.529781:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768128 00000100:00100000:0.0:1786562535.529794:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768128 00000100:00100000:0.0:1786562535.529860:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17079 00000100:00100000:0.0:1786562535.529871:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652768128:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562535.529901:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.529925:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22200/0x5c655bf66689eb06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc98a expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.530060:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.530079:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.530088:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.530122:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.530136:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 10 pid: 35929 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.530150:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654856064:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562535.530208:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562535.547736:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652767232:12345-192.168.204.29@tcp:3:cat.0 Request processed in 56667us (60525us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562535.547758:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11449 00002000:00100000:3.0:1786562535.547779:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9a9949880 x1873345652767232/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.547792:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9949880 with x1873345652767232 ext(3145728->4194303) 00002000:00010000:3.0:1786562535.547800:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a9949880 00000100:00100000:2.0:1786562535.552077:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.552247:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768640 00000100:00100000:1.0:1786562535.552269:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768640 00002000:00100000:1.0:1786562535.552343:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b51ad80 x1873345652768640/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.552356:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51ad80 with x1873345652768640 ext(3145728->4194303) 00002000:00010000:1.0:1786562535.552362:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51ad80 00000100:00100000:1.0:1786562535.552395:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11450 00000100:00100000:1.0:1786562535.552406:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652768640:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562535.580524:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.580606:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.580738:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.580786:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.580825:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769152 00000100:00100000:1.0:1786562535.580836:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769152 00000100:00100000:1.0:1786562535.580904:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17600 00000100:00100000:1.0:1786562535.580916:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:64053:x1873345652769152:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.580942:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.580964:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc991 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.581028:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(3 2) 00010000:00010000:1.0:1786562535.581034:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:1.0:1786562535.581045:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.581068:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.581084:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881200, rc 0) 00000100:00100000:1.0:1786562535.581152:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64053:x1873345652769152:12345-192.168.204.29@tcp:101:cat.0 Request processed in 239us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.581160:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17600 00000100:00100000:1.0:1786562535.581369:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654856064:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.581396:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.581827:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769024 00000100:00100000:2.0:1786562535.581832:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769024 00010000:00010000:2.0:1786562535.581863:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 11 pid: 35929 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.581906:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8599 00000100:00100000:2.0:1786562535.581916:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992131450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652769024:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.581929:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.581937:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 11 pid: 35929 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.581950:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 11 pid: 35929 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.581978:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364c00/0x5c655bf66689eac7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc96e expref: 11 pid: 35929 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.581997:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562535.582033:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.582046:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.582054:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.582075:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.582111:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992131450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652769024:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 197us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.582118:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8599 00000100:00100000:2.0:1786562535.582156:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654855936:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562535.582171:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.582191:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652768384:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 54244us (54341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.582197:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8598 00010000:00010000:1.0:1786562535.582329:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.582337:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562535.582393:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562535.582399:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562535.582425:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.582461:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22200/0x5c655bf66689eb06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.582477:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.582489:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562535.582703:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562535.582706:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23a00, rc 0) 00000100:00100000:1.0:1786562535.582740:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652768128:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 52872us (56891us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.582747:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17079 00000100:00100000:0.0:1786562535.586916:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768768 00000100:00100000:0.0:1786562535.586939:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768768 00002000:00100000:1.0:1786562535.587226:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9a994a680 x1873345652768768/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.587240:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a994a680 with x1873345652768768 ext(3145728->4194303) 00002000:00010000:1.0:1786562535.587258:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a994a680 00000100:00100000:1.0:1786562535.587303:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652768896 00000100:00100000:1.0:1786562535.587308:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652768896 00002000:00100000:1.0:1786562535.587335:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x711:0x0] (319488->323583) req@ffff90e9a994b480 x1873345652768896/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.587344:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a994b480 with x1873345652768896 ext(319488->323583) 00002000:00010000:1.0:1786562535.587348:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a994b480 00000100:00100000:1.0:1786562535.587371:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11451 00000100:00100000:1.0:1786562535.587382:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+21:2350:x1873345652768768:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.587585:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11452 00000100:00100000:2.0:1786562535.587596:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652768896:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562535.588030:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652768896:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 413us (7398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.588039:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11452 00002000:00100000:2.0:1786562535.588047:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x711:0x0] (319488->323583) req@ffff90e9a994b480 x1873345652768896/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.588055:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a994b480 with x1873345652768896 ext(319488->323583) 00002000:00010000:2.0:1786562535.588059:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a994b480 00000100:00100000:0.0:1786562535.598094:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.598119:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.598147:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769280 00000100:00100000:0.0:1786562535.598159:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769280 00000100:00100000:0.0:1786562535.598212:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769536 00000100:00100000:0.0:1786562535.598216:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769536 00000100:00100000:0.0:1786562535.598240:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17601 00000100:00100000:0.0:1786562535.598431:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652769280:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562535.598455:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.598480:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc998 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.598555:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654856192:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562535.599594:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17602 00000100:00100000:3.0:1786562535.599611:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652769536:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.599622:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.599637:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689eb22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9a6 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.599677:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654856320:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562535.599891:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.600493:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.600546:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.600622:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.600644:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769792 00000100:00100000:0.0:1786562535.600651:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769792 00000100:00100000:0.0:1786562535.600686:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769408 00000100:00100000:0.0:1786562535.600690:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769408 00000100:00100000:0.0:1786562535.600707:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17603 00000100:00100000:0.0:1786562535.600714:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652769792:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562535.600726:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.600737:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9b4 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.600757:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:0.0:1786562535.600762:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:0.0:1786562535.600774:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 14 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.600794:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 14 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.600809:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23e00, rc 0) 00000100:00100000:0.0:1786562535.600840:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652769792:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.600849:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17603 00000100:00100000:0.0:1786562535.600869:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17604 00000100:00100000:0.0:1786562535.600876:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652769408:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562535.600882:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.600890:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc99f expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.600922:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654856448:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562535.600948:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.600993:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.602616:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769664 00000100:00100000:2.0:1786562535.602628:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769664 00000100:00100000:2.0:1786562535.602681:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17605 00000100:00100000:2.0:1786562535.602689:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652769664:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562535.602703:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.602717:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9ad expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.602737:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(8 3) 00010000:00010000:2.0:1786562535.602741:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 8) 00010000:00010000:2.0:1786562535.602751:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.602769:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.602780:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf64800, rc 0) 00000100:00100000:2.0:1786562535.602820:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652769664:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 133us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.602827:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17605 00000100:00100000:2.0:1786562535.602920:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652768640:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 50516us (50860us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562535.602929:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11450 00002000:00100000:2.0:1786562535.602940:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88b51ad80 x1873345652768640/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.602950:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51ad80 with x1873345652768640 ext(3145728->4194303) 00002000:00010000:2.0:1786562535.602956:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b51ad80 00000100:00100000:1.0:1786562535.608850:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.608920:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.609036:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652769920 00000100:00100000:0.0:1786562535.609050:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652769920 00002000:00100000:0.0:1786562535.609116:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x711:0x0] (339968->344063) req@ffff90e9a9948380 x1873345652769920/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.609129:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9948380 with x1873345652769920 ext(339968->344063) 00002000:00010000:0.0:1786562535.609136:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a9948380 00000100:00100000:0.0:1786562535.609166:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652770048 00000100:00100000:0.0:1786562535.609170:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652770048 00002000:00100000:0.0:1786562535.609188:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9a9948000 x1873345652770048/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.609197:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9948000 with x1873345652770048 ext(3145728->4194303) 00002000:00010000:0.0:1786562535.609202:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a9948000 00000100:00100000:0.0:1786562535.609228:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11453 00000100:00100000:0.0:1786562535.609238:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652769920:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562535.609716:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652769920:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 478us (879us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562535.609726:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11453 00002000:00100000:0.0:1786562535.609735:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x711:0x0] (339968->344063) req@ffff90e9a9948380 x1873345652769920/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562535.609744:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9948380 with x1873345652769920 ext(339968->344063) 00002000:00010000:0.0:1786562535.609748:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a9948380 00000100:00100000:0.0:1786562535.609768:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11454 00000100:00100000:0.0:1786562535.609777:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652770048:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562535.639975:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654856320:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562535.640052:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689eb22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9a6 expref: 14 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.640084:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689eb22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9a6 expref: 14 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.640100:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:2.0:1786562535.640181:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652769536:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 40575us (42059us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562535.640192:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17602 00000100:00100000:2.0:1786562535.642949:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654856448:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562535.642996:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb30 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc99f expref: 12 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.643040:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc99f expref: 12 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.643054:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23c00, rc 0) 00000100:00100000:2.0:1786562535.643135:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652769408:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 42257us (42510us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562535.643146:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17604 00002000:00010000:1.0:1786562535.643721:0:29662:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime: 1786562530 -> 1786562534 00002000:00010000:1.0:1786562535.643726:0:29662:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime: 1786562530 -> 1786562534 00002000:00010000:1.0:1786562535.643728:0:29662:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime: 1786562530 -> 1786562534 00000100:00100000:1.0:1786562535.643745:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654856192:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562535.643785:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc998 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.643801:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc998 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.643810:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22e00, rc 0) 00000100:00100000:1.0:1786562535.643849:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652769280:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 45601us (45772us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562535.643856:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17601 00000100:00100000:2.0:1786562535.653119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.654429:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+21:2350:x1873345652768768:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 67040us (73912us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562535.654447:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11451 00002000:00100000:1.0:1786562535.654465:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9a994a680 x1873345652768768/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.654477:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a994a680 with x1873345652768768 ext(3145728->4194303) 00002000:00010000:1.0:1786562535.654485:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a994a680 00000100:00100000:0.0:1786562535.660864:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652770304 00000100:00100000:0.0:1786562535.660886:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652770304 00000100:00100000:0.0:1786562535.660973:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6261 00000100:00100000:0.0:1786562535.660985:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+504:64066:x1873345652770304:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562535.661643:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+505:64066:x1873345652770304:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 658us (8535us total) trans 8589950618 rc 0/0 00000100:00100000:0.0:1786562535.661654:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6261 00000100:00100000:0.0:1786562535.664098:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.664803:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652770048:12345-192.168.204.29@tcp:3:cat.0 Request processed in 55023us (55878us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562535.664819:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11454 00002000:00100000:2.0:1786562535.664836:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9a9948000 x1873345652770048/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.664848:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9948000 with x1873345652770048 ext(3145728->4194303) 00002000:00010000:2.0:1786562535.664855:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a9948000 00000100:00100000:3.0:1786562535.665888:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652770560 00000100:00100000:3.0:1786562535.665899:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652770560 00000100:00100000:3.0:1786562535.665968:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17080 00000100:00100000:3.0:1786562535.665980:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652770560:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562535.666002:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562535.666043:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689eb3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9bb expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.666174:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.666193:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.666208:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562535.666234:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562535.666901:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689eb3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 12 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.666925:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 11 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.666940:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562535.666943:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562535.666948:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:3.0:1786562535.667039:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64063:x1873345652770560:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1062us (2952us total) trans 8589950619 rc 0/0 00000100:00100000:3.0:1786562535.667047:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17080 00000100:00100000:1.0:1786562535.688656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.689191:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652770944 00000100:00100000:2.0:1786562535.689208:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652770944 00000100:00100000:2.0:1786562535.689324:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17081 00000100:00100000:2.0:1786562535.689338:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64068:x1873345652770944:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562535.689378:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.689407:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eb53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9c2 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689568:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689590:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689601:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689610:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689658:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689673:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 10 pid: 33114 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.689689:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654856576:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562535.689822:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.689832:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 10 pid: 33140 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.689842:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654856704:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562535.689868:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.692635:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.692691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.692721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.692758:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.692794:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652770688 00000100:00100000:1.0:1786562535.692807:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652770688 00000100:00100000:1.0:1786562535.692863:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771200 00000100:00100000:1.0:1786562535.692866:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771200 00000100:00100000:1.0:1786562535.692886:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771456 00000100:00100000:1.0:1786562535.692889:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771456 00000100:00100000:1.0:1786562535.692905:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771072 00000100:00100000:1.0:1786562535.692907:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771072 00000100:00100000:1.0:1786562535.692929:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17606 00000100:00100000:1.0:1786562535.692940:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652770688:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562535.693000:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693061:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 27 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693071:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=1s v=(0 3) 00010000:00010000:1.0:1786562535.693076:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562535.693081:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693124:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 27 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693139:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 27 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693156:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882963480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654856832:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562535.693244:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.693282:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17607 00000100:00100000:1.0:1786562535.693301:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652771200:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562535.693327:0:29964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693339:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 20 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693347:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=1s v=(1 2) 00010000:00010000:1.0:1786562535.693350:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1786562535.693354:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693375:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 20 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693384:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 20 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693396:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882963800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654856960:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562535.693423:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e900 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.693444:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17608 00000100:00100000:1.0:1786562535.693451:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652771456:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562535.693472:0:29966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693491:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693499:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693507:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 13 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693517:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693526:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693534:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 8) 00010000:00010000:1.0:1786562535.693537:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 8) 00010000:00010000:1.0:1786562535.693541:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 8/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693562:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693571:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 10 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693582:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857088:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.693617:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693627:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 27 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693637:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882961880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857216:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.693666:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 13 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693676:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 13 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693686:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882963100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857344:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.693717:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693727:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 10 pid: 6658 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693737:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882961500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857472:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.693774:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.693783:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 10 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.693792:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857600:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562535.693810:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e000 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.693847:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.693920:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.694144:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771328 00000100:00100000:0.0:1786562535.694150:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771328 00000100:00100000:0.0:1786562535.694190:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771584 00000100:00100000:0.0:1786562535.694194:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771584 00000100:00100000:0.0:1786562535.694213:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17609 00000100:00100000:0.0:1786562535.694220:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652771072:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562535.694242:0:29963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694255:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 20 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694262:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=1s v=(2 2) 00010000:00010000:0.0:1786562535.694266:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1786562535.694270:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694305:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 20 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694320:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 20 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.694331:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884116680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654857728:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562535.694372:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99401c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562535.694398:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17610 00000100:00100000:0.0:1786562535.694406:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652771328:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562535.694427:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694440:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694448:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694457:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 10 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694464:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=3s v=(1 1) 00010000:00010000:0.0:1786562535.694467:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562535.694472:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694499:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 10 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694508:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 10 pid: 29662 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.694518:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654857856:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562535.694550:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694561:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 14 pid: 12119 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.694570:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884117100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654857984:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562535.694601:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.694610:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 27 pid: 28861 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.694620:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654858112:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562535.694642:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99482f840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562535.698202:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17611 00000100:00100000:3.0:1786562535.698232:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652771584:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562535.698317:0:12119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698343:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698353:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 13 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698362:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 7 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698370:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1786562535.698376:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1786562535.698380:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698432:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 7 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698445:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 7 pid: 29963 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.698462:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654858240:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.698594:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 13 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698604:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 13 pid: 8368 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.698613:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654858368:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.698646:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 20 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.698655:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 20 pid: 6660 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.698665:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654858496:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.698687:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9884390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.716728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.716774:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.716802:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.716820:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.716849:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771968 00000100:00100000:1.0:1786562535.716860:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771968 00000100:00100000:1.0:1786562535.716920:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772224 00000100:00100000:1.0:1786562535.716923:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772224 00000100:00100000:1.0:1786562535.716950:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17612 00000100:00100000:1.0:1786562535.716961:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652771968:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.716994:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.717050:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689eb8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9c9 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.717138:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654858624:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562535.717238:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e540 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.717682:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17613 00000100:00100000:1.0:1786562535.717693:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652772224:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.717704:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.717717:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689eb92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9d7 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.718081:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882961180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654858752:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562535.718126:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562535.718178:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.720198:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771712 00000100:00100000:0.0:1786562535.720228:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771712 00010000:00010000:0.0:1786562535.720321:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 11 pid: 33114 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.720373:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652771840 00000100:00100000:0.0:1786562535.720378:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652771840 00010000:00010000:0.0:1786562535.720391:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 12 pid: 33140 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.720416:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8600 00000100:00100000:0.0:1786562535.720427:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652771712:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.720444:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.720453:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 12 pid: 33114 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720468:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 12 pid: 33114 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720496:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562535.720502:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720513:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720519:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.720588:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652771712:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 162us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.720599:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8600 00000100:00100000:0.0:1786562535.720623:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8601 00000100:00100000:0.0:1786562535.720630:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652771840:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.720637:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.720642:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 11 pid: 33140 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720651:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 11 pid: 33140 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720662:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562535.720676:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720684:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720693:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.720714:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.720736:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652771840:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 105us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.720742:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8601 00000100:00100000:1.0:1786562535.722154:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882963480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654856832:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.722188:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.722733:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689eb45 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9bb expref: 10 pid: 33114 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.722766:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654856576:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.722780:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689eb0d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc98a expref: 9 pid: 33140 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562535.722791:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654856704:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.722805:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.722813:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.722818:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562535.722845:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562535.723083:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eb53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 14 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.723101:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 13 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.723109:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562535.723112:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562535.723115:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65e00, rc 0) 00000100:00100000:3.0:1786562535.723171:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64068:x1873345652770944:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 33836us (34530us total) trans 8589950620 rc 0/0 00000100:00100000:3.0:1786562535.723185:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17081 00000100:00100000:0.0:1786562535.724125:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882963100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857344:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562535.725111:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.725146:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.725169:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.725234:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884116680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654857728:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562535.725467:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882963800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654856960:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562535.725499:0:29964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.725539:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772352 00000100:00100000:1.0:1786562535.725546:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772352 00002000:00100000:1.0:1786562535.725616:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9887eca80 x1873345652772352/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.725626:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887eca80 with x1873345652772352 ext(4194304->5185535) 00010000:00010000:1.0:1786562535.725636:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 28 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.725656:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 28 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.725664:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9887eca80 00000100:00100000:1.0:1786562535.725694:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772608 00000100:00100000:1.0:1786562535.725697:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772608 00002000:00100000:1.0:1786562535.725713:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x711:0x0] (319488->344063) req@ffff90e9887eea00 x1873345652772608/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.725721:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887eea00 with x1873345652772608 ext(319488->344063) 00010000:00010000:1.0:1786562535.725728:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.725738:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.726390:0:29963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.726494:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654857856:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.728710:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857088:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.728731:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882961880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857216:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.728744:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882961500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857472:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562535.728845:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654857600:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562535.728883:0:29966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.729236:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9887eea00 00000100:00100000:0.0:1786562535.729487:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.729569:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884117100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654857984:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562535.729612:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654858112:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562535.729634:0:29967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.729698:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.729722:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.730453:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772736 00000100:00100000:3.0:1786562535.730463:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772736 00002000:00100000:3.0:1786562535.730533:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1093631) req@ffff90e9887ec380 x1873345652772736/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.730561:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ec380 with x1873345652772736 ext(1048576->1093631) 00010000:00010000:3.0:1786562535.730572:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 21 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.730588:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 21 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562535.730598:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9887ec380 00000100:00100000:3.0:1786562535.730639:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5951 00000100:00100000:3.0:1786562535.730652:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652772352:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562535.731435:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5952 00000100:00100000:1.0:1786562535.731449:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+21:2351:x1873345652772736:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562535.731618:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5953 00000100:00100000:1.0:1786562535.731627:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652772608:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562535.731706:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772480 00000100:00100000:1.0:1786562535.731713:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772480 00010000:00010000:1.0:1786562535.731743:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 15 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.731777:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773248 00000100:00100000:1.0:1786562535.731781:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773248 00010000:00010000:1.0:1786562535.731796:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 16 pid: 12119 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.731815:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773120 00000100:00100000:1.0:1786562535.731818:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773120 00010000:00010000:1.0:1786562535.731831:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 13 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.731844:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8602 00000100:00100000:1.0:1786562535.731851:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2351:x1873345652772480:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562535.731863:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562535.731884:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.731897:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.731924:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eb37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ad expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.731946:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562535.731980:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652772480:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 129us (6872us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.731992:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8602 00000100:00100000:1.0:1786562535.732038:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8603 00000100:00100000:1.0:1786562535.732045:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652773248:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562535.732053:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562535.732065:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 14 pid: 12119 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.732076:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 14 pid: 12119 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.732088:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689e804 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc7d1 expref: 14 pid: 12119 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.732100:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562535.732117:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652773248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 74us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.732124:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8603 00000100:00100000:1.0:1786562535.732136:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8604 00000100:00100000:1.0:1786562535.732142:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652773120:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562535.732153:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562535.732161:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 13 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.732171:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 13 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.732188:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e64181/0x5c655bf66689ea65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc928 expref: 13 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.732198:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562535.732215:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652773120:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 73us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.733032:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.733065:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773376 00000100:00100000:0.0:1786562535.733070:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773376 00010000:00010000:0.0:1786562535.733099:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 32 pid: 28861 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.733123:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8605 00000100:00100000:0.0:1786562535.733130:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652773376:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.733140:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.733155:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 32 pid: 28861 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.733172:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 32 pid: 28861 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.733188:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689e755 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc75a expref: 32 pid: 28861 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.733201:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.733226:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652773376:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.733233:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8605 00000100:00100000:2.0:1786562535.734196:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772096 00000100:00100000:2.0:1786562535.734205:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772096 00000100:00100000:2.0:1786562535.734272:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17614 00000100:00100000:2.0:1786562535.734282:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652772096:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562535.734309:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.734331:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689eba0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9d0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.734399:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654858880:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562535.734478:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562535.734785:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654858240:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562535.734799:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654858368:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562535.734810:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654858496:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562535.734838:0:12119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.739967:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8604 00000100:00100000:1.0:1786562535.740125:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654858624:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562535.740177:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689eb8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c9 expref: 11 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.740211:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689eb8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c9 expref: 11 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.740238:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880600, rc 0) 00000100:00100000:1.0:1786562535.740690:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652771968:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23730us (23885us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562535.740699:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17612 00000100:00100000:1.0:1786562535.740855:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882961180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654858752:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562535.740878:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689eb92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9d7 expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.740895:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689eb92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9d7 expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.740907:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880800, rc 0) 00000100:00100000:1.0:1786562535.740931:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652772224:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23241us (24110us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562535.740939:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17613 00000100:00100000:3.0:1786562535.746236:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.751045:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773760 00000100:00100000:2.0:1786562535.751068:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773760 00010000:00010000:2.0:1786562535.751131:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 10 pid: 29963 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.751185:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8606 00000100:00100000:2.0:1786562535.751198:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992131050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652773760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.751230:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.751274:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 10 pid: 29963 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.751300:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 10 pid: 29963 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.751345:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689eb14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc991 expref: 10 pid: 29963 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.751370:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.751434:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992131050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652773760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 239us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.751443:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8606 00000100:00100000:2.0:1786562535.776591:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.776631:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.776652:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.776679:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.776700:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.776881:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652772352:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46230us (51731us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1786562535.776894:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5951 00002000:00100000:2.0:1786562535.776911:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9887eca80 x1873345652772352/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/440 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.776922:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887eca80 with x1873345652772352 ext(4194304->5185535) 00010000:00010000:2.0:1786562535.776935:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 30 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.776954:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 30 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.776963:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9887eca80 00000100:00100000:2.0:1786562535.777001:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772992 00000100:00100000:2.0:1786562535.777033:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772992 00002000:00100000:2.0:1786562535.777075:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72e:0x0] (1323008->2097151) req@ffff90e88b518000 x1873345652772992/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.777084:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518000 with x1873345652772992 ext(1323008->2097151) 00010000:00010000:2.0:1786562535.777090:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 23 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.777101:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 23 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.777108:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b518000 00000100:00100000:2.0:1786562535.777134:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5954 00000100:00100000:2.0:1786562535.777145:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652772992:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562535.780674:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654858880:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562535.780732:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689eba0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9d0 expref: 8 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.780778:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a337de6/0x5c655bf66689eba0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9d0 expref: 8 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.780796:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0c00, rc 0) 00000100:00100000:0.0:1786562535.780875:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652772096:12345-192.168.204.29@tcp:101:cat.0 Request processed in 46594us (62696us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562535.780886:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17614 00000100:00100000:0.0:1786562535.780938:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773632 00000100:00100000:0.0:1786562535.780946:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773632 00010000:00010000:0.0:1786562535.780981:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 14 pid: 8368 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.781047:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652772864 00000100:00100000:0.0:1786562535.781051:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652772864 00010000:00010000:0.0:1786562535.781069:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 10 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.781090:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773504 00000100:00100000:0.0:1786562535.781093:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773504 00010000:00010000:0.0:1786562535.781109:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 11 pid: 29662 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.781121:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652773888 00000100:00100000:0.0:1786562535.781124:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652773888 00010000:00010000:0.0:1786562535.781139:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 25 pid: 6660 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.781155:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8607 00000100:00100000:0.0:1786562535.781165:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652773632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.781182:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.781200:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 14 pid: 8368 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.781212:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 14 pid: 8368 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782398:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eb29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9b4 expref: 14 pid: 8368 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782420:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.782477:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652773632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1312us (5844us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.782487:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8607 00000100:00100000:0.0:1786562535.782523:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8608 00000100:00100000:0.0:1786562535.782534:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652772864:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.782550:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.782575:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 11 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782590:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 11 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782607:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265b2f75/0x5c655bf66689e794 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc792 expref: 11 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782621:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.782641:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652772864:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 111us (5987us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.782648:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8608 00000100:00100000:0.0:1786562535.782663:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8609 00000100:00100000:0.0:1786562535.782670:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652773504:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.782678:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.782692:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 9 pid: 29662 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782703:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 9 pid: 29662 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782716:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689e77f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc77d expref: 9 pid: 29662 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782727:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562535.782733:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562535.782740:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782766:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782800:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.782820:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652773504:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 151us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.782827:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8609 00000100:00100000:0.0:1786562535.782842:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8610 00000100:00100000:0.0:1786562535.782849:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652773888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562535.782857:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562535.782869:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 25 pid: 6660 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782887:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 25 pid: 6660 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782900:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689ea81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc944 expref: 25 pid: 6660 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782911:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:0.0:1786562535.782914:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 3) 00010000:00010000:0.0:1786562535.782918:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782926:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.782949:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562535.782967:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652773888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 118us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.782973:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8610 00010000:00010000:0.0:1786562535.783032:0:12119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783042:0:12119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783072:0:12119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783082:0:12119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783091:0:12119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783100:0:12119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562535.783105:0:12119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783115:0:12119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783127:0:12119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.783135:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058300657/0x5c655bf66689eb84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.783184:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652771584:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 84969us (89264us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.783192:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17611 00000100:00100000:1.0:1786562535.783430:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652772608:12345-192.168.204.29@tcp:4:cat.0 Request processed in 51801us (58256us total) trans 17179876043 rc 0/0 00000100:00100000:1.0:1786562535.783442:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5953 00002000:00100000:1.0:1786562535.783454:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x711:0x0] (319488->344063) req@ffff90e9887eea00 x1873345652772608/t17179876043(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/448 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.783465:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887eea00 with x1873345652772608 ext(319488->344063) 00010000:00010000:1.0:1786562535.783474:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.783486:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.783495:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9887eea00 00000100:00100000:1.0:1786562535.783995:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652772736:12345-192.168.204.29@tcp:4:cat.0 Request processed in 52550us (54508us total) trans 21474843563 rc 0/0 00000100:00100000:1.0:1786562535.784048:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5952 00002000:00100000:1.0:1786562535.784055:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1093631) req@ffff90e9887ec380 x1873345652772736/t21474843563(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/448 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562535.784064:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ec380 with x1873345652772736 ext(1048576->1093631) 00010000:00010000:1.0:1786562535.784073:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 24 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.784084:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 24 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.784091:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9887ec380 00010000:00010000:2.0:1786562535.784602:0:29967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784615:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784649:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784674:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784682:0:29967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784691:0:29967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f22e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562535.784695:0:29967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784704:0:29967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784725:0:29967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.784733:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689eb7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.784815:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652771328:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 90408us (90965us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.784824:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17610 00000100:00100000:2.0:1786562535.800704:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.800761:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774016 00000100:00100000:2.0:1786562535.800790:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774016 00000100:00100000:2.0:1786562535.800858:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17615 00000100:00100000:2.0:1786562535.800870:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64053:x1873345652774016:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562535.800896:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562535.800921:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9de expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.800959:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 8) 00010000:00010000:2.0:1786562535.800968:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.800977:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(2 8) 00010000:00010000:2.0:1786562535.800984:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [5181440->5242879] (req 5181440->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.801007:0:28862:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.801067:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [5181440->5242879] (req 5181440->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.801090:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:2.0:1786562535.801150:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64053:x1873345652774016:12345-192.168.204.29@tcp:101:cat.0 Request processed in 282us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.801159:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17615 00000100:00100000:2.0:1786562535.805103:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652772992:12345-192.168.204.29@tcp:4:cat.0 Request processed in 27943us (28510us total) trans 21474843564 rc 0/0 00000100:00100000:2.0:1786562535.805121:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5954 00002000:00100000:2.0:1786562535.805138:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72e:0x0] (1323008->2097151) req@ffff90e88b518000 x1873345652772992/t21474843564(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/448 e 0 to 0 dl 1786562546 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.805150:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518000 with x1873345652772992 ext(1323008->2097151) 00010000:00010000:2.0:1786562535.805172:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 24 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.805191:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 24 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562535.805199:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b518000 00000100:00100000:1.0:1786562535.808563:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.808703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.808823:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774272 00000100:00100000:2.0:1786562535.808837:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774272 00010000:00010000:2.0:1786562535.808889:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 24 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.808937:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774144 00000100:00100000:2.0:1786562535.808941:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774144 00010000:00010000:2.0:1786562535.808959:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.809045:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8611 00000100:00100000:2.0:1786562535.809058:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652774272:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.809078:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.809107:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 24 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809122:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 24 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809153:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eef900b/0x5c655bf66689ea7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc93d expref: 24 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809175:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1786562535.809180:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1786562535.809187:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809199:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809229:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.809312:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652774272:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 257us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.809324:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8611 00000100:00100000:2.0:1786562535.809345:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8612 00000100:00100000:2.0:1786562535.809352:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652774144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.809372:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.809389:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809400:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809414:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689eaf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 319488->344063) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc983 expref: 29 pid: 12119 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809424:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562535.809427:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562535.809431:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809439:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.809456:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.809475:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652774144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 124us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.809482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8612 00010000:00010000:1.0:1786562535.811052:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811075:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811119:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811128:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811137:0:29964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811144:0:29964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562535.811150:0:29964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811160:0:29964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811180:0:29964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811188:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689eb68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.811797:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652771200:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 118495us (119093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.811809:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17607 00010000:00010000:1.0:1786562535.811858:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811869:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811893:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811901:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811909:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811916:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562535.811919:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811927:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811941:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.811949:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689eb61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.815023:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652770688:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 122039us (122356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.815046:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17606 00000100:00100000:0.0:1786562535.827727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.827783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.827817:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.827926:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.828189:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774400 00000100:00100000:1.0:1786562535.828202:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774400 00000100:00100000:1.0:1786562535.828302:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17616 00000100:00100000:1.0:1786562535.828314:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:64047:x1873345652774400:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.828338:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.828370:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9e5 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.828407:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:1.0:1786562535.828420:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [5181440->5242879] (req 5181440->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 29 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.828442:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [5181440->5242879] (req 5181440->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 29 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.828460:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881800, rc 0) 00000100:00100000:1.0:1786562535.828533:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:64047:x1873345652774400:12345-192.168.204.29@tcp:101:cat.0 Request processed in 221us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.828542:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17616 00000100:00100000:2.0:1786562535.828902:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774528 00000100:00100000:2.0:1786562535.828908:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774528 00010000:00010000:2.0:1786562535.828938:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 23 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.828971:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774656 00000100:00100000:2.0:1786562535.828974:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774656 00010000:00010000:2.0:1786562535.828999:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 9 pid: 6658 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.829046:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774784 00000100:00100000:2.0:1786562535.829049:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774784 00010000:00010000:2.0:1786562535.829062:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 29 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.829081:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8613 00000100:00100000:2.0:1786562535.829089:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992133c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652774528:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.829101:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.829130:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 23 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829143:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 23 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829175:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009414159e/0x5c655bf66689ea73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc936 expref: 23 pid: 29967 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829192:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562535.829197:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1786562535.829203:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829214:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829253:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.829284:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992133c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652774528:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 196us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.829302:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8613 00000100:00100000:2.0:1786562535.829365:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8614 00000100:00100000:2.0:1786562535.829374:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652774656:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.829383:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.829400:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 9 pid: 6658 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829412:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 9 pid: 6658 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829434:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba5cac98/0x5c655bf66689ea6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc92f expref: 9 pid: 6658 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829445:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.829465:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652774656:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 93us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.829882:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8614 00000100:00100000:2.0:1786562535.829898:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8615 00000100:00100000:2.0:1786562535.829905:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652774784:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562535.829915:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562535.829928:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 29 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829942:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 29 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829957:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014091f0f/0x5c655bf66689eace lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc975 expref: 29 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.829969:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562535.829973:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562535.829979:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830058:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830085:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562535.830111:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652774784:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 207us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.830118:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8615 00010000:00010000:2.0:1786562535.830163:0:29966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830172:0:29966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830201:0:29966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830209:0:29966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830218:0:29966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.830225:0:29966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562535.830229:0:29966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830417:0:29963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830428:0:29963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830448:0:29963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830456:0:29963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830463:0:29963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830470:0:29963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f23c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562535.830473:0:29963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830483:0:29963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830496:0:29963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.830503:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689eb76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562535.830556:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652771072:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 136335us (137797us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.830564:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17609 00010000:00010000:2.0:1786562535.831576:0:29966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.831599:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562535.831603:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562535.831614:0:29966:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.831624:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.831633:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562535.831636:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562535.831642:0:29966:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 27 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.831650:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 27 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.831705:0:29966:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 27 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.831724:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654859008:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562535.831816:0:29966:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.831827:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654859136:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562535.831851:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562535.840573:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654859008:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562535.840597:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654859136:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562535.840632:0:29966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562535.840649:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689eb6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562535.840744:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652771456:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 147292us (148021us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562535.840755:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17608 00000100:00100000:0.0:1786562535.847334:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.847376:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.847410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.847446:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.853498:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652774912 00000100:00100000:1.0:1786562535.853522:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652774912 00000100:00100000:1.0:1786562535.853614:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775168 00000100:00100000:1.0:1786562535.853619:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775168 00000100:00100000:1.0:1786562535.853641:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775424 00000100:00100000:1.0:1786562535.853644:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775424 00000100:00100000:1.0:1786562535.853659:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775040 00000100:00100000:1.0:1786562535.853662:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775040 00000100:00100000:1.0:1786562535.853693:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17617 00000100:00100000:1.0:1786562535.853706:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2348:x1873345652774912:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.853731:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.853773:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9ec expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.853809:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x711:0x0] initial LVB size: 1048576, mtime: 0x6a7cc7e6, atime: 0x6a7cc7e2, ctime: 0x6a7cc7e6, blocks: 0x807 00010000:00010000:1.0:1786562535.853836:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=968s v=(0 0) 00010000:00010000:1.0:1786562535.853842:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.853856:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 9 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.853885:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 9 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.853901:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880800, rc 0) 00000100:00100000:1.0:1786562535.854588:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652774912:12345-192.168.204.29@tcp:101:cat.0 Request processed in 882us (7267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.854599:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17617 00000100:00100000:1.0:1786562535.854631:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17618 00000100:00100000:1.0:1786562535.854641:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652775168:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.854652:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.854666:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9fa expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.854687:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72f:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7e6, atime: 0x6a7cc7e5, ctime: 0x6a7cc7e6, blocks: 0x807 00010000:00010000:1.0:1786562535.854701:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=968s v=(0 0) 00010000:00010000:1.0:1786562535.854706:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.854714:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 10 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.854728:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 10 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.854739:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880600, rc 0) 00000100:00100000:3.0:1786562535.854798:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17619 00000100:00100000:3.0:1786562535.854813:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652775424:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562535.854823:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1786562535.854834:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652775168:12345-192.168.204.29@tcp:101:cat.0 Request processed in 195us (7456us total) trans 0 rc 0/0 00010000:00010000:3.0:1786562535.854837:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca08 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.854847:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17618 00002000:00010000:3.0:1786562535.854861:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x730:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7e5, atime: 0x6a7cc7e6, ctime: 0x6a7cc7e5, blocks: 0x1007 00000100:00100000:1.0:1786562535.854867:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17620 00010000:00010000:3.0:1786562535.854873:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=968s v=(0 0) 00000100:00100000:1.0:1786562535.854879:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652775040:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562535.854880:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.854890:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.854902:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfc9f3 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.854917:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72e:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7e6, atime: 0x6a7cc7e5, ctime: 0x6a7cc7e6, blocks: 0x809 00010000:00010000:1.0:1786562535.854930:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=968s v=(0 0) 00010000:00010000:1.0:1786562535.854934:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.854940:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 11 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.854968:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 11 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.854977:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881000, rc 0) 00000100:00100000:1.0:1786562535.855664:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652775040:12345-192.168.204.29@tcp:101:cat.0 Request processed in 786us (8214us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.855673:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17620 00000100:00100000:1.0:1786562535.855947:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.856622:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775296 00000100:00100000:1.0:1786562535.856633:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775296 00000100:00100000:1.0:1786562535.856701:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17621 00000100:00100000:1.0:1786562535.856712:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652775296:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562535.856730:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562535.856763:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca01 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562535.856792:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x713:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7e3, atime: 0x6a7cc7dd, ctime: 0x6a7cc7e3, blocks: 0x809 00010000:00010000:1.0:1786562535.856809:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=968s v=(0 0) 00010000:00010000:1.0:1786562535.856813:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.856823:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.856841:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.856855:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881c00, rc 0) 00000100:00100000:1.0:1786562535.856890:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652775296:12345-192.168.204.29@tcp:101:cat.0 Request processed in 180us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.856897:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17621 00010000:00010000:3.0:1786562535.858014:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.858044:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562535.858060:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:0.0:1786562535.874162:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652775424:12345-192.168.204.29@tcp:101:cat.0 Request processed in 19334us (26730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.874181:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17619 00000100:00100000:2.0:1786562535.881756:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.881809:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.881826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.881995:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562535.901285:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775552 00000100:00100000:3.0:1786562535.901316:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775552 00000100:00100000:3.0:1786562535.901432:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775680 00000100:00100000:3.0:1786562535.901436:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775680 00000100:00100000:3.0:1786562535.901648:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775808 00000100:00100000:3.0:1786562535.901653:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775808 00000100:00100000:0.0:1786562535.901723:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652775936 00000100:00100000:0.0:1786562535.901729:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652775936 00000100:00100000:0.0:1786562535.901767:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17622 00000100:00100000:0.0:1786562535.901780:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652775552:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562535.901805:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.901829:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca0f expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.901864:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.901870:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.901884:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 30 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904088:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 30 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904120:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22000, rc 0) 00000100:00100000:0.0:1786562535.904254:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652775552:12345-192.168.204.29@tcp:101:cat.0 Request processed in 2475us (22511us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.904265:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17622 00000100:00100000:0.0:1786562535.904330:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17623 00000100:00100000:0.0:1786562535.904345:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652775680:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562535.904362:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.904382:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904406:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.904410:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.904420:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 24 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904432:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 24 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904440:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22400, rc 0) 00000100:00100000:0.0:1786562535.904631:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652775680:12345-192.168.204.29@tcp:101:cat.0 Request processed in 291us (22820us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.904638:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17623 00000100:00100000:0.0:1786562535.904652:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17624 00000100:00100000:0.0:1786562535.904659:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652775808:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562535.904667:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.904674:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca1d expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904687:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.904690:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.904696:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 24 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904706:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 24 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904715:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22200, rc 0) 00000100:00100000:0.0:1786562535.904734:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652775808:12345-192.168.204.29@tcp:101:cat.0 Request processed in 76us (22908us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.904740:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17624 00000100:00100000:0.0:1786562535.904752:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17625 00000100:00100000:0.0:1786562535.904758:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652775936:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562535.904767:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.904776:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca24 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904789:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.904791:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562535.904797:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 30 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904813:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 30 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.904821:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23200, rc 0) 00000100:00100000:0.0:1786562535.904839:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652775936:12345-192.168.204.29@tcp:101:cat.0 Request processed in 81us (22845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562535.904845:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17625 00000100:00100000:1.0:1786562535.905946:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.905992:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652776064 00000100:00100000:1.0:1786562535.906022:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652776064 00000100:00100000:0.0:1786562535.906025:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.906056:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652776704 00000100:00100000:0.0:1786562535.906060:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652776704 00000100:00100000:1.0:1786562535.906083:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17626 00000100:00100000:1.0:1786562535.906096:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652776064:12345-192.168.204.29@tcp:101:cat.0 00000100:00100000:0.0:1786562535.906106:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17082 00010000:00010000:1.0:1786562535.906114:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1786562535.906118:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+505:64071:x1873345652776704:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562535.906132:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca2b expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.906137:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562535.906156:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689ebfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca32 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.906164:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.906170:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562535.906180:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 25 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.906196:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 25 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.906208:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881e00, rc 0) 00010000:00010000:0.0:1786562535.906246:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.906262:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.906273:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.906305:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.906314:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.906322:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562535.908107:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652776064:12345-192.168.204.29@tcp:101:cat.0 Request processed in 2004us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562535.908119:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17626 00000100:00100000:1.0:1786562535.908564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.908607:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652776320 00000100:00100000:1.0:1786562535.908616:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652776320 00000100:00100000:1.0:1786562535.908670:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17083 00000100:00100000:1.0:1786562535.908680:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652776320:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562535.908739:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562535.908772:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689e45a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc593 expref: 9 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562535.908795:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562535.908800:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562535.908840:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64063:x1873345652776320:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 161us (277us total) trans 0 rc -116/-116 00000100:00100000:1.0:1786562535.908850:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17083 00000100:00100000:1.0:1786562535.908921:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562535.909840:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.909863:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.909878:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562535.909975:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562535.910131:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910140:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910148:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910155:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f22e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562535.910159:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910169:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910186:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562535.910189:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562535.910193:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910200:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22e00/0x5c655bf66689ec10 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910220:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910228:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910235:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910240:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f23a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562535.910243:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910250:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910258:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562535.910261:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562535.910265:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910271:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910300:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910307:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910313:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910319:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988f23c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562535.910322:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910328:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910336:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562535.910339:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562535.910342:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910347:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23c00/0x5c655bf66689ec09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910405:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689ebfb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca32 expref: 507 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910416:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562535.910418:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562535.910422:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23600/0x5c655bf66689ebfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca32 expref: 507 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562535.910431:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23600, rc 0) 00000100:00100000:0.0:1786562535.912307:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+506:64071:x1873345652776704:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 6167us (6275us total) trans 8589950621 rc 301/301 00000100:00100000:0.0:1786562535.914634:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17082 00000100:00100000:2.0:1786562535.915231:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652776448 00000100:00100000:2.0:1786562535.915244:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652776448 00002000:00100000:2.0:1786562535.915330:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e9af24ed80 x1873345652776448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.915343:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24ed80 with x1873345652776448 ext(5181440->5185535) 00002000:00010000:2.0:1786562535.915350:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24ed80 00000100:00100000:2.0:1786562535.915382:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11455 00000100:00100000:2.0:1786562535.915392:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652776448:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562535.915884:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652776448:12345-192.168.204.29@tcp:3:cat.0 Request processed in 491us (6959us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562535.918902:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11455 00002000:00100000:2.0:1786562535.918927:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e9af24ed80 x1873345652776448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562535.918940:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24ed80 with x1873345652776448 ext(5181440->5185535) 00002000:00010000:2.0:1786562535.918947:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24ed80 00000100:00100000:1.0:1786562535.928237:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562535.928980:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.930867:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652776960 00000100:00100000:0.0:1786562535.930885:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652776960 00000100:00100000:0.0:1786562535.930961:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6262 00000100:00100000:0.0:1786562535.930974:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9c206a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64063:x1873345652776960:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562535.934361:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9c206a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652776960:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 3371us (6133us total) trans 8589950622 rc 0/0 00000100:00100000:0.0:1786562535.934381:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6262 00000100:00100000:3.0:1786562535.934866:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652777088 00000100:00100000:3.0:1786562535.934878:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652777088 00002000:00100000:3.0:1786562535.934939:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e9af24c380 x1873345652777088/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/0 e 0 to 0 dl 1786562546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.934950:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24c380 with x1873345652777088 ext(5181440->5185535) 00002000:00010000:3.0:1786562535.934957:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24c380 00000100:00100000:3.0:1786562535.934986:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11456 00000100:00100000:3.0:1786562535.934997:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652777088:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562535.935362:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652777088:12345-192.168.204.29@tcp:3:cat.0 Request processed in 366us (6384us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562535.935371:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11456 00002000:00100000:3.0:1786562535.935378:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e9af24c380 x1873345652777088/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:6/0 lens 488/4536 e 0 to 0 dl 1786562546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562535.935386:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24c380 with x1873345652777088 ext(5181440->5185535) 00002000:00010000:3.0:1786562535.935389:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24c380 00000100:00100000:1.0:1786562535.959706:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562535.959935:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652777344 00000100:00100000:0.0:1786562535.959948:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652777344 00000100:00100000:0.0:1786562535.960050:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6263 00000100:00100000:0.0:1786562535.960062:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64063:x1873345652777344:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562535.960920:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64063:x1873345652777344:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 854us (1222us total) trans 8589950623 rc 0/0 00000100:00100000:2.0:1786562535.960932:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6263 00000100:00100000:1.0:1786562535.966767:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562535.971265:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652777600 00000100:00100000:2.0:1786562535.971298:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652777600 00000100:00100000:2.0:1786562535.971414:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6264 00000100:00100000:2.0:1786562535.971428:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+506:64047:x1873345652777600:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:2.0:1786562535.971833:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+507:64047:x1873345652777600:12345-192.168.204.29@tcp:35:cat.0 Request processed in 407us (5081us total) trans 8589950624 rc 0/0 00000100:00100000:2.0:1786562535.971842:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6264 00010000:00010000:1.0:1786562536.166035:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562536.182434:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.182702:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652777728 00000100:00100000:2.0:1786562536.182715:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652777728 00000100:00100000:2.0:1786562536.182797:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17627 00000100:00100000:2.0:1786562536.182810:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64068:x1873345652777728:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562536.182836:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562536.182863:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca39 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.182911:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.182924:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 29 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.182934:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562536.183101:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:2.0:1786562536.183108:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.183157:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 29 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.183173:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 29 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.183191:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654859264:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562536.183330:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.183341:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 11 pid: 28862 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.183359:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654859392:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562536.183388:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562536.196798:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.196905:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.197735:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652777856 00000100:00100000:0.0:1786562536.197749:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652777856 00010000:00010000:0.0:1786562536.197806:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 30 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.197849:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652777984 00000100:00100000:0.0:1786562536.197853:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652777984 00010000:00010000:0.0:1786562536.197867:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 12 pid: 28862 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.197901:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8616 00000100:00100000:0.0:1786562536.197913:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652777856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562536.197934:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562536.197963:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 30 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.197978:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 30 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.198049:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562536.198121:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652777856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 211us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.198130:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8616 00000100:00100000:0.0:1786562536.198154:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8617 00000100:00100000:0.0:1786562536.198161:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652777984:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562536.198169:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562536.198179:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 12 pid: 28862 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.198190:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 12 pid: 28862 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.198206:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:0.0:1786562536.198212:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 8) 00010000:00010000:0.0:1786562536.198221:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.198232:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.198275:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.198306:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654859520:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562536.198370:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99401c240 going to sleep for 11 seconds 00010000:00010000:2.0:1786562536.201804:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689eba7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9de expref: 12 pid: 28862 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.201836:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654859392:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562536.201859:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ebae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9e5 expref: 29 pid: 6659 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.201869:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654859264:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562536.201906:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.201923:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fa00, rc 0) 00000100:00100000:2.0:1786562536.202104:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64068:x1873345652777728:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 19296us (19685us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.202114:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17627 00000100:00100000:2.0:1786562536.210581:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654859520:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562536.210618:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562536.210689:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2348:x1873345652777984:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12527us (13782us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.210704:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8617 00000100:00100000:0.0:1786562536.219095:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.219269:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778112 00000100:00100000:2.0:1786562536.219290:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778112 00002000:00100000:2.0:1786562536.219358:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2465792->2469887) req@ffff90e9887edf80 x1873345652778112/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.219371:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887edf80 with x1873345652778112 ext(2465792->2469887) 00002000:00010000:2.0:1786562536.219379:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887edf80 00000100:00100000:2.0:1786562536.219416:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11457 00000100:00100000:2.0:1786562536.219426:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652778112:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562536.219900:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652778112:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 473us (818us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562536.219910:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11457 00002000:00100000:2.0:1786562536.219917:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2465792->2469887) req@ffff90e9887edf80 x1873345652778112/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/4536 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.219926:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887edf80 with x1873345652778112 ext(2465792->2469887) 00002000:00010000:2.0:1786562536.219931:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887edf80 00000100:00100000:1.0:1786562536.255242:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.255384:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778240 00000100:00100000:2.0:1786562536.255397:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778240 00000100:00100000:2.0:1786562536.255578:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17628 00000100:00100000:2.0:1786562536.255591:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64068:x1873345652778240:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562536.255615:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562536.255638:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca40 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.255677:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.255695:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 24 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.255704:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562536.255709:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562536.255714:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->2383871] (req 2097152->2383871) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 11 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.255759:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 24 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.255774:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 24 pid: 37002 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.255792:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654859648:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562536.255916:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.255926:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 11 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.255935:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654859776:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562536.255961:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867ae600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562536.259843:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.259883:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.259916:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.259948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.260050:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778368 00000100:00100000:0.0:1786562536.260062:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778368 00002000:00100000:0.0:1786562536.260125:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e9af24fb80 x1873345652778368/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.260137:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24fb80 with x1873345652778368 ext(0->1048575) 00002000:00010000:0.0:1786562536.260144:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24fb80 00000100:00100000:0.0:1786562536.260176:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778496 00000100:00100000:0.0:1786562536.260179:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778496 00002000:00100000:0.0:1786562536.260195:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9af24f800 x1873345652778496/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.260204:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24f800 with x1873345652778496 ext(1048576->2097151) 00002000:00010000:0.0:1786562536.260207:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24f800 00000100:00100000:0.0:1786562536.260219:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778624 00000100:00100000:0.0:1786562536.260222:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778624 00002000:00100000:0.0:1786562536.260237:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e9af24e300 x1873345652778624/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.260244:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24e300 with x1873345652778624 ext(1048576->2097151) 00002000:00010000:0.0:1786562536.260247:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24e300 00000100:00100000:0.0:1786562536.260262:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778752 00000100:00100000:0.0:1786562536.260264:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778752 00002000:00100000:0.0:1786562536.260276:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9af24d180 x1873345652778752/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.260296:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24d180 with x1873345652778752 ext(1048576->2097151) 00002000:00010000:0.0:1786562536.260301:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24d180 00000100:00100000:0.0:1786562536.260318:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11458 00000100:00100000:0.0:1786562536.260330:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652778368:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.260540:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11459 00000100:00100000:1.0:1786562536.260550:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652778496:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562536.262352:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11460 00000100:00100000:0.0:1786562536.262371:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652778624:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562536.262580:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11461 00000100:00100000:3.0:1786562536.262593:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652778752:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.271922:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.271994:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.272064:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779008 00000100:00100000:1.0:1786562536.272075:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779008 00010000:00010000:1.0:1786562536.272122:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.272164:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652778880 00000100:00100000:1.0:1786562536.272167:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652778880 00010000:00010000:1.0:1786562536.272181:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 25 pid: 37002 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.272211:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8618 00000100:00100000:1.0:1786562536.272221:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652779008:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562536.272241:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562536.272269:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.272294:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.272334:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562536.272657:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8619 00000100:00100000:0.0:1786562536.272669:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652778880:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562536.272680:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562536.272691:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 25 pid: 37002 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.272703:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 25 pid: 37002 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.272724:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562536.272730:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562536.272739:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.272749:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.272791:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 16 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.272806:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654859904:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562536.272987:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ebf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca2b expref: 25 pid: 37002 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.273034:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654859648:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.273049:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ebc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca08 expref: 16 pid: 28861 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.273057:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654859776:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.273086:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 15 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.273097:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:0.0:1786562536.273753:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99401c240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562536.276535:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64068:x1873345652778240:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 20931us (21293us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.276552:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17628 00000100:00100000:1.0:1786562536.277626:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652779008:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5398us (5711us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562536.277641:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8618 00000100:00100000:2.0:1786562536.299313:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654859904:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562536.299352:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562536.299420:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652778880:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 26753us (27424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.299436:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8619 00000100:00100000:1.0:1786562536.299762:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652778496:12345-192.168.204.29@tcp:3:cat.0 Request processed in 39213us (39876us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562536.299772:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11459 00002000:00100000:1.0:1786562536.299787:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9af24f800 x1873345652778496/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.299797:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24f800 with x1873345652778496 ext(1048576->2097151) 00002000:00010000:1.0:1786562536.299804:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24f800 00000100:00100000:3.0:1786562536.318530:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.318787:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779264 00000100:00100000:0.0:1786562536.318800:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779264 00000100:00100000:0.0:1786562536.318884:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17084 00000100:00100000:0.0:1786562536.318896:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+507:64081:x1873345652779264:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562536.318929:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562536.318957:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca47 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319334:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319353:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319366:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319385:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319392:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319398:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319944:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ec41 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319957:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ec41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.319965:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ec41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562536.319976:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562536.320146:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320155:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320163:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320170:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562536.320175:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320183:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320199:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562536.320202:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562536.320208:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320215:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ec33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320231:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320238:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320244:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320250:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562536.320253:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320259:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320267:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2d00) 00010000:00010000:1.0:1786562536.320269:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562536.320272:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320288:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320341:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23a00/0x5c655bf66689ec2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca47 expref: 510 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320358:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ec41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca47 expref: 509 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.320367:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562536.320369:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562536.320371:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:1.0:1786562536.321964:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+509:64081:x1873345652779264:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3060us (3438us total) trans 8589950625 rc 0/0 00000100:00100000:1.0:1786562536.321979:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17084 00000100:00100000:2.0:1786562536.327431:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652778752:12345-192.168.204.29@tcp:3:cat.0 Request processed in 64824us (67462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562536.327954:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11461 00002000:00100000:2.0:1786562536.327973:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9af24d180 x1873345652778752/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.327984:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24d180 with x1873345652778752 ext(1048576->2097151) 00002000:00010000:2.0:1786562536.327993:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24d180 00000100:00100000:3.0:1786562536.328357:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652778624:12345-192.168.204.29@tcp:3:cat.0 Request processed in 65990us (68438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562536.328366:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11460 00002000:00100000:3.0:1786562536.328373:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e9af24e300 x1873345652778624/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562536.328381:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24e300 with x1873345652778624 ext(1048576->2097151) 00002000:00010000:3.0:1786562536.328385:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24e300 00000100:00100000:0.0:1786562536.329767:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652778368:12345-192.168.204.29@tcp:3:cat.0 Request processed in 69431us (69932us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562536.329779:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11458 00002000:00100000:0.0:1786562536.329790:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e9af24fb80 x1873345652778368/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.329799:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24fb80 with x1873345652778368 ext(0->1048575) 00002000:00010000:0.0:1786562536.329804:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9af24fb80 00000100:00100000:1.0:1786562536.336964:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.337162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.337308:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779520 00000100:00100000:0.0:1786562536.337321:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779520 00000100:00100000:0.0:1786562536.337405:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 965 00000100:00100000:0.0:1786562536.337417:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992132850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+509:2350:x1873345652779520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562536.337436:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562536.337490:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ec41 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca47 expref: 509 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.337519:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562536.337525:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562536.337598:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992132850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+508:2350:x1873345652779520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 184us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.337607:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 965 00000100:00100000:2.0:1786562536.344107:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779392 00000100:00100000:2.0:1786562536.344127:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779392 00002000:00100000:2.0:1786562536.344200:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2379776->2383871) req@ffff90e9af24df80 x1873345652779392/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.344213:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24df80 with x1873345652779392 ext(2379776->2383871) 00002000:00010000:2.0:1786562536.344221:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24df80 00000100:00100000:2.0:1786562536.344259:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11462 00000100:00100000:2.0:1786562536.344271:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652779392:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562536.345158:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652779392:12345-192.168.204.29@tcp:3:cat.0 Request processed in 882us (8201us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562536.345170:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11462 00002000:00100000:2.0:1786562536.345179:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2379776->2383871) req@ffff90e9af24df80 x1873345652779392/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/4536 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.345190:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24df80 with x1873345652779392 ext(2379776->2383871) 00002000:00010000:2.0:1786562536.345195:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24df80 00000100:00100000:0.0:1786562536.355789:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.359181:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.360383:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779648 00000100:00100000:1.0:1786562536.360399:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779648 00000100:00100000:1.0:1786562536.360583:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779776 00000100:00100000:1.0:1786562536.360587:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779776 00000100:00100000:1.0:1786562536.360623:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17629 00000100:00100000:1.0:1786562536.360634:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652779648:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562536.360659:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562536.360681:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689ec4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca4e expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.360761:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654860032:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562536.360867:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562536.360890:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17630 00000100:00100000:1.0:1786562536.360898:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652779776:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562536.360907:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562536.360918:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f96b197/0x5c655bf66689ec56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca55 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.360948:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654860160:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562536.360974:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562536.365321:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.365485:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652779904 00000100:00100000:3.0:1786562536.365497:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652779904 00000100:00100000:3.0:1786562536.365672:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17631 00000100:00100000:3.0:1786562536.365686:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+26:64071:x1873345652779904:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562536.365713:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.365737:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca5c expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.365780:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 9 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.365799:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562536.365804:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562536.365810:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.365855:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 9 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.365872:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 9 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.365971:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654860288:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562536.366102:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439a80 going to sleep for 11 seconds 00002000:00010000:3.0:1786562536.373351:0:29967:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562533 -> 1786562535 00002000:00010000:3.0:1786562536.373365:0:29967:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562534 -> 1786562535 00002000:00010000:3.0:1786562536.373368:0:29967:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562533 -> 1786562535 00000100:00100000:3.0:1786562536.373401:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654860160:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562536.373539:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f96b197/0x5c655bf66689ec56 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca55 expref: 27 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.373583:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f96b197/0x5c655bf66689ec56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca55 expref: 27 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.373606:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269e00, rc 0) 00000100:00100000:3.0:1786562536.373688:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652779776:12345-192.168.204.29@tcp:101:cat.0 Request processed in 12789us (14520us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562536.373699:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17630 00002000:00010000:1.0:1786562536.374217:0:29662:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime: 1786562534 -> 1786562535 00002000:00010000:1.0:1786562536.374222:0:29662:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime: 1786562531 -> 1786562535 00002000:00010000:1.0:1786562536.374225:0:29662:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime: 1786562534 -> 1786562535 00000100:00100000:1.0:1786562536.374242:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654860032:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562536.374267:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689ec4f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca4e expref: 30 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.374294:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689ec4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca4e expref: 30 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.374306:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268000, rc 0) 00000100:00100000:1.0:1786562536.374344:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652779648:12345-192.168.204.29@tcp:101:cat.0 Request processed in 13712us (18573us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562536.374352:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17629 00000100:00100000:3.0:1786562536.376306:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.376612:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780032 00000100:00100000:2.0:1786562536.376624:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780032 00002000:00100000:2.0:1786562536.376690:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (2097152->2383871) req@ffff90e88ac85500 x1873345652780032/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.376703:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac85500 with x1873345652780032 ext(2097152->2383871) 00010000:00010000:2.0:1786562536.376714:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 10 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.376732:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 10 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.376741:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88ac85500 00000100:00100000:2.0:1786562536.376777:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5955 00000100:00100000:2.0:1786562536.376789:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652780032:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562536.378247:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654860288:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562536.378361:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.378383:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:1.0:1786562536.379267:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+25:64071:x1873345652779904:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 13577us (13953us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562536.379290:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17631 00000100:00100000:3.0:1786562536.398628:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652780032:12345-192.168.204.29@tcp:4:cat.0 Request processed in 21823us (22317us total) trans 21474843565 rc 0/0 00000100:00100000:3.0:1786562536.398649:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5955 00002000:00100000:3.0:1786562536.398668:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (2097152->2383871) req@ffff90e88ac85500 x1873345652780032/t21474843565(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/448 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562536.398679:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac85500 with x1873345652780032 ext(2097152->2383871) 00010000:00010000:3.0:1786562536.398691:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 12 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.398710:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 12 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562536.398718:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88ac85500 00000100:00100000:1.0:1786562536.399273:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.399324:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.399355:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.399422:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.399450:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780160 00000100:00100000:1.0:1786562536.399460:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780160 00002000:00100000:1.0:1786562536.399513:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3825663) req@ffff90e882960000 x1873345652780160/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 504/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786562536.399517:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780416 00000100:00100000:0.0:1786562536.399524:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780416 00002000:00100000:1.0:1786562536.399529:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960000 with x1873345652780160 ext(2097152->3825663) 00000100:00100000:2.0:1786562536.399534:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780288 00002000:00010000:1.0:1786562536.399535:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882960000 00000100:00100000:2.0:1786562536.399542:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780288 00002000:00100000:0.0:1786562536.399553:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (2383872->3432447) req@ffff90e882961180 x1873345652780416/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786562536.399563:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780544 00002000:00100000:0.0:1786562536.399566:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961180 with x1873345652780416 ext(2383872->3432447) 00000100:00100000:1.0:1786562536.399569:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780544 00002000:00100000:2.0:1786562536.399575:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (3825664->4194303) req@ffff90e882960700 x1873345652780288/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1786562536.399577:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1786562536.399591:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x730:0x0] (3432448->4194303) req@ffff90e882960a80 x1873345652780544/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.399606:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960700 with x1873345652780288 ext(3825664->4194303) 00002000:00010000:2.0:1786562536.399615:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882960700 00002000:00100000:1.0:1786562536.399621:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960a80 with x1873345652780544 ext(3432448->4194303) 00010000:00010000:0.0:1786562536.399623:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.399631:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562536.399634:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882961180 00000100:00100000:2.0:1786562536.399645:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11463 00010000:00010000:1.0:1786562536.399652:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.399659:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652780160:12345-192.168.204.29@tcp:3:cat.0 00002000:00010000:1.0:1786562536.399665:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882960a80 00000100:00100000:0.0:1786562536.402075:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5956 00000100:00100000:0.0:1786562536.402099:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652780416:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.402121:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5957 00000100:00100000:1.0:1786562536.402133:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652780544:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562536.402386:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11464 00000100:00100000:3.0:1786562536.402401:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652780288:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.432140:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.432183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.432216:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.432327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.439341:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780928 00000100:00100000:0.0:1786562536.439363:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780928 00002000:00100000:1.0:1786562536.440960:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e882961500 x1873345652780928/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.440979:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961500 with x1873345652780928 ext(0->1048575) 00002000:00010000:1.0:1786562536.440988:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882961500 00000100:00100000:1.0:1786562536.441083:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781056 00000100:00100000:1.0:1786562536.441093:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781056 00002000:00100000:1.0:1786562536.441115:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e882961880 x1873345652781056/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.441123:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961880 with x1873345652781056 ext(1048576->2097151) 00002000:00010000:1.0:1786562536.441127:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882961880 00000100:00100000:1.0:1786562536.441147:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780672 00000100:00100000:1.0:1786562536.441151:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780672 00002000:00100000:1.0:1786562536.441168:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e882962a00 x1873345652780672/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.441183:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882962a00 with x1873345652780672 ext(1048576->2097151) 00002000:00010000:1.0:1786562536.441186:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882962a00 00000100:00100000:1.0:1786562536.441208:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652780800 00000100:00100000:1.0:1786562536.441212:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652780800 00002000:00100000:1.0:1786562536.441226:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e882963100 x1873345652780800/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.441234:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963100 with x1873345652780800 ext(1048576->2097151) 00002000:00010000:1.0:1786562536.441238:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882963100 00000100:00100000:1.0:1786562536.441261:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11465 00000100:00100000:1.0:1786562536.441272:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652780928:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562536.442715:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11466 00000100:00100000:0.0:1786562536.442734:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652781056:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.444521:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11467 00000100:00100000:1.0:1786562536.444552:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652780672:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562536.445725:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11468 00000100:00100000:2.0:1786562536.445758:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652780800:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562536.454991:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652780160:12345-192.168.204.29@tcp:3:cat.0 Request processed in 55319us (55705us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562536.455027:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11463 00002000:00100000:2.0:1786562536.455043:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3825663) req@ffff90e882960000 x1873345652780160/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 504/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.455057:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960000 with x1873345652780160 ext(2097152->3825663) 00002000:00010000:2.0:1786562536.455065:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882960000 00000100:00100000:0.0:1786562536.460451:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.460586:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781184 00000100:00100000:3.0:1786562536.460599:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781184 00000100:00100000:3.0:1786562536.460688:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17085 00000100:00100000:3.0:1786562536.460701:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64083:x1873345652781184:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562536.460738:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.460769:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689ec64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca63 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562536.460772:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786562536.460862:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.460879:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.460892:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.460909:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.460916:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.460922:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.461240:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652780544:12345-192.168.204.29@tcp:3:cat.0 Request processed in 59107us (61813us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1786562536.461252:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5957 00002000:00100000:0.0:1786562536.461266:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x730:0x0] (3432448->4194303) req@ffff90e882960a80 x1873345652780544/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.461288:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960a80 with x1873345652780544 ext(3432448->4194303) 00010000:00010000:0.0:1786562536.461301:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 14 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.461320:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 14 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562536.461336:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882960a80 00010000:00010000:3.0:1786562536.461391:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.461406:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.461415:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.461538:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.461552:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 12 pid: 33115 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.461568:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654860416:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562536.461642:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562536.461726:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652780416:12345-192.168.204.29@tcp:3:cat.0 Request processed in 59637us (62401us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562536.461735:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5956 00002000:00100000:3.0:1786562536.461741:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (2383872->3432447) req@ffff90e882961180 x1873345652780416/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562536.461750:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961180 with x1873345652780416 ext(2383872->3432447) 00010000:00010000:3.0:1786562536.461757:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 12 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.461768:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 12 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562536.461775:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882961180 00000100:00100000:2.0:1786562536.462382:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2351:x1873345652780288:12345-192.168.204.29@tcp:3:cat.0 Request processed in 59983us (63021us total) trans 0 rc 368640/368640 00000100:00100000:2.0:1786562536.462391:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11464 00002000:00100000:2.0:1786562536.462398:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3825664->4194303) req@ffff90e882960700 x1873345652780288/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.462409:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960700 with x1873345652780288 ext(3825664->4194303) 00002000:00010000:2.0:1786562536.462413:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882960700 00000100:00100000:2.0:1786562536.469259:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.470691:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652780928:12345-192.168.204.29@tcp:3:cat.0 Request processed in 29412us (38559us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562536.470707:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11465 00002000:00100000:1.0:1786562536.470724:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e882961500 x1873345652780928/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.470736:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961500 with x1873345652780928 ext(0->1048575) 00002000:00010000:1.0:1786562536.470744:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882961500 00000100:00100000:3.0:1786562536.471196:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781312 00000100:00100000:3.0:1786562536.471207:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781312 00000100:00100000:3.0:1786562536.471286:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17632 00000100:00100000:3.0:1786562536.471298:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64077:x1873345652781312:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562536.471318:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.471342:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca6a expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.471380:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562536.471390:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 28 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.471398:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562536.471404:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.479700:0:29966:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 28 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.479746:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.479772:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:2.0:1786562536.479878:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64077:x1873345652781312:12345-192.168.204.29@tcp:101:cat.0 Request processed in 8580us (10636us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.479890:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17632 00000100:00100000:3.0:1786562536.502104:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652781056:12345-192.168.204.29@tcp:3:cat.0 Request processed in 59360us (69903us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562536.502122:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11466 00002000:00100000:3.0:1786562536.502138:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e882961880 x1873345652781056/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562536.502149:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961880 with x1873345652781056 ext(1048576->2097151) 00002000:00010000:3.0:1786562536.502157:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882961880 00000100:00100000:3.0:1786562536.517980:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654860416:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.518059:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.518320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.518907:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652780800:12345-192.168.204.29@tcp:3:cat.0 Request processed in 73168us (86577us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562536.518922:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11468 00002000:00100000:2.0:1786562536.518939:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e882963100 x1873345652780800/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.518951:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963100 with x1873345652780800 ext(1048576->2097151) 00002000:00010000:2.0:1786562536.518958:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882963100 00000100:00100000:2.0:1786562536.519056:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.519093:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781696 00000100:00100000:2.0:1786562536.519103:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781696 00010000:00010000:2.0:1786562536.519143:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.519180:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8620 00000100:00100000:2.0:1786562536.519191:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652781696:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562536.519209:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562536.519235:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.519255:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.519298:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6859f88/0x5c655bf66689ec25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2383871) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca40 expref: 13 pid: 29965 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.519317:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562536.519323:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562536.519333:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 26 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.519345:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 26 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.519395:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 26 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.519408:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 26 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.519807:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652780672:12345-192.168.204.29@tcp:3:cat.0 Request processed in 75270us (87586us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562536.519816:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11467 00002000:00100000:1.0:1786562536.519824:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e882962a00 x1873345652780672/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.519833:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882962a00 with x1873345652780672 ext(1048576->2097151) 00002000:00010000:1.0:1786562536.519838:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882962a00 00000100:00100000:3.0:1786562536.522790:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781568 00000100:00100000:3.0:1786562536.522811:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781568 00000100:00100000:3.0:1786562536.522914:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6265 00000100:00100000:3.0:1786562536.522928:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:56898:x1873345652781568:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786562536.523692:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654860672:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562536.523822:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562536.543079:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654860672:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562536.543120:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562536.543189:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652781696:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23998us (24131us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.543204:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8620 00000100:00100000:0.0:1786562536.547439:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:56898:x1873345652781568:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 24493us (29100us total) trans 8589950626 rc 0/0 00000100:00100000:0.0:1786562536.547459:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6265 00000100:00100000:1.0:1786562536.558326:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.558587:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781824 00000100:00100000:2.0:1786562536.558600:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781824 00002000:00100000:2.0:1786562536.558679:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (2699264->2703359) req@ffff90e882963800 x1873345652781824/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.558693:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963800 with x1873345652781824 ext(2699264->2703359) 00010000:00010000:2.0:1786562536.558705:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.558723:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.558732:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882963800 00000100:00100000:2.0:1786562536.558768:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5958 00000100:00100000:2.0:1786562536.558779:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652781824:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562536.559056:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652781824:12345-192.168.204.29@tcp:3:cat.0 Request processed in 277us (744us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562536.559065:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5958 00002000:00100000:2.0:1786562536.559072:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (2699264->2703359) req@ffff90e882963800 x1873345652781824/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/4536 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.559081:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963800 with x1873345652781824 ext(2699264->2703359) 00010000:00010000:2.0:1786562536.559088:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.559097:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.559104:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882963800 00000100:00100000:1.0:1786562536.571428:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.572079:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652781952 00000100:00100000:2.0:1786562536.572095:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652781952 00002000:00100000:2.0:1786562536.572531:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (2699264->3145727) req@ffff90e882963480 x1873345652781952/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.572545:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963480 with x1873345652781952 ext(2699264->3145727) 00010000:00010000:2.0:1786562536.572559:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.572578:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 25 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.572588:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882963480 00000100:00100000:2.0:1786562536.572629:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5959 00000100:00100000:2.0:1786562536.572642:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652781952:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562536.574181:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.574290:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782208 00000100:00100000:1.0:1786562536.574302:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782208 00000100:00100000:1.0:1786562536.574370:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17633 00000100:00100000:1.0:1786562536.574381:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+29:64071:x1873345652782208:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562536.574402:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562536.574492:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca71 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.574533:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.574544:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=1s v=(3 8) 00010000:00010000:1.0:1786562536.574550:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 8) 00010000:00010000:1.0:1786562536.574556:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->3735551] (req 3145728->3735551) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 30 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.574602:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.574615:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 9 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.574632:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654860800:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562536.574743:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562536.576624:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.577750:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782080 00000100:00100000:2.0:1786562536.577766:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782080 00010000:00010000:2.0:1786562536.577825:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 14 pid: 33115 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.577901:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8621 00000100:00100000:2.0:1786562536.577915:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652782080:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562536.577937:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562536.577947:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 14 pid: 33115 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.577963:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 14 pid: 33115 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.577997:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eb5a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9c2 expref: 14 pid: 33115 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.578061:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562536.578067:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.578079:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.578087:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.578118:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562536.578183:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652782080:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 271us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.578192:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8621 00010000:00010000:1.0:1786562536.578450:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578460:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562536.578520:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562536.578525:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562536.578554:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578568:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578581:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578587:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578594:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578601:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562536.578606:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578617:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578629:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562536.578632:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562536.578636:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578644:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364a00/0x5c655bf66689ec6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578658:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578663:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578669:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578674:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562536.578677:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578682:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578692:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46abd00) 00010000:00010000:1.0:1786562536.578695:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562536.578699:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578709:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689ec72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578754:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689ec64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578769:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 11 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.578776:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562536.578779:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562536.578781:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:1.0:1786562536.578824:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64083:x1873345652781184:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 118126us (118389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562536.578832:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17085 00000100:00100000:1.0:1786562536.596728:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654860800:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562536.596786:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->3735551] (req 3145728->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 30 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.596821:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:1.0:1786562536.596891:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+30:64071:x1873345652782208:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 22511us (22721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562536.596903:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17633 00000100:00100000:0.0:1786562536.598175:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.598230:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782336 00000100:00100000:0.0:1786562536.598240:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782336 00000100:00100000:0.0:1786562536.598318:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17634 00000100:00100000:0.0:1786562536.598330:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+30:64081:x1873345652782336:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562536.598352:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562536.598375:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca78 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.598413:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 8) 00010000:00010000:0.0:1786562536.601321:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 8) 00010000:00010000:0.0:1786562536.601354:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 31 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.601384:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 31 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.601407:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38000, rc 0) 00000100:00100000:0.0:1786562536.601609:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:64081:x1873345652782336:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3277us (3439us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.601624:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17634 00000100:00100000:0.0:1786562536.608935:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.609646:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782464 00000100:00100000:1.0:1786562536.609661:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782464 00002000:00100000:1.0:1786562536.609731:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2465792->3145727) req@ffff90e9887ed500 x1873345652782464/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.609744:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ed500 with x1873345652782464 ext(2465792->3145727) 00010000:00010000:1.0:1786562536.609756:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 10 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.609773:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 10 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562536.609781:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9887ed500 00000100:00100000:1.0:1786562536.609831:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5960 00000100:00100000:1.0:1786562536.609842:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652782464:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562536.611514:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.611550:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782592 00000100:00100000:0.0:1786562536.611560:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782592 00000100:00100000:0.0:1786562536.611622:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17635 00000100:00100000:0.0:1786562536.611632:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652782592:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562536.611651:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562536.611671:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca7f expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.611700:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562536.611705:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562536.611717:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.611720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562536.611740:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.611746:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652783488 00000100:00100000:1.0:1786562536.611749:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652783488 00010000:00010000:0.0:1786562536.611757:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38600, rc 0) 00000100:00100000:1.0:1786562536.611782:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17086 00000100:00100000:1.0:1786562536.611789:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64085:x1873345652783488:12345-192.168.204.29@tcp:101:multiop.0 00000100:00100000:0.0:1786562536.611793:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652782592:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.611799:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17635 00010000:00010000:1.0:1786562536.611804:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562536.611818:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcaa9 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562536.611826:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562536.612501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.612531:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.612553:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.612575:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.612594:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782720 00000100:00100000:3.0:1786562536.612599:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782720 00000100:00100000:3.0:1786562536.612635:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782848 00000100:00100000:3.0:1786562536.612639:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782848 00000100:00100000:3.0:1786562536.612660:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652782976 00000100:00100000:3.0:1786562536.612662:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652782976 00000100:00100000:3.0:1786562536.612678:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652783104 00000100:00100000:3.0:1786562536.612680:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652783104 00000100:00100000:3.0:1786562536.612699:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17636 00000100:00100000:3.0:1786562536.612707:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652782720:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562536.612718:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.612731:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca86 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612748:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786562536.612752:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562536.612760:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612774:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612785:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365a00, rc 0) 00000100:00100000:3.0:1786562536.612816:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652782720:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.612822:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17636 00000100:00100000:3.0:1786562536.612837:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17637 00000100:00100000:3.0:1786562536.612857:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652782848:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562536.612864:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.612871:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca8d expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612884:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786562536.612887:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562536.612893:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612904:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612912:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:3.0:1786562536.612932:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652782848:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 77us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.612939:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17637 00000100:00100000:3.0:1786562536.612952:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17638 00000100:00100000:3.0:1786562536.612959:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652782976:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562536.612965:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.612975:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca94 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.612993:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786562536.612996:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562536.613002:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.613029:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.613039:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:3.0:1786562536.613060:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652782976:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 102us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.613065:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17638 00000100:00100000:3.0:1786562536.613077:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17639 00000100:00100000:3.0:1786562536.613083:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652783104:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562536.613089:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.613097:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689ecb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfca9b expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.613148:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654860928:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562536.613209:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562536.613245:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.613952:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652783232 00000100:00100000:0.0:1786562536.613959:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652783232 00000100:00100000:0.0:1786562536.614028:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17640 00000100:00100000:0.0:1786562536.614036:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652783232:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562536.614047:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562536.614057:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ecbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcaa2 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.614096:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884116300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654861056:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562536.614134:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bb0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1786562536.614150:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786562536.614331:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.614351:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 10 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.614366:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.614393:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 10 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.614405:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 10 pid: 33115 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.614416:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654861184:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562536.614445:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562536.624192:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652781952:12345-192.168.204.29@tcp:4:cat.0 Request processed in 51538us (52763us total) trans 21474843566 rc 0/0 00000100:00100000:2.0:1786562536.624213:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5959 00002000:00100000:2.0:1786562536.624230:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (2699264->3145727) req@ffff90e882963480 x1873345652781952/t21474843566(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/448 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.624241:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963480 with x1873345652781952 ext(2699264->3145727) 00010000:00010000:2.0:1786562536.624255:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.624290:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.624300:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882963480 00000100:00100000:2.0:1786562536.640089:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652782464:12345-192.168.204.29@tcp:4:cat.0 Request processed in 30232us (31153us total) trans 17179876044 rc 0/0 00000100:00100000:2.0:1786562536.640107:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5960 00002000:00100000:2.0:1786562536.640123:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (2465792->3145727) req@ffff90e9887ed500 x1873345652782464/t17179876044(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/448 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.640135:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ed500 with x1873345652782464 ext(2465792->3145727) 00010000:00010000:2.0:1786562536.640259:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.640289:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.640299:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9887ed500 00000100:00100000:2.0:1786562536.642841:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884116300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654861056:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562536.642907:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ecbf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa2 expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.642940:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ecbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa2 expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.642956:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39600, rc 0) 00000100:00100000:2.0:1786562536.643040:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652783232:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 29004us (29792us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562536.643052:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17640 00000100:00100000:1.0:1786562536.643416:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654860928:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562536.643441:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689ecb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca9b expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.643456:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8898bc9/0x5c655bf66689ecb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca9b expref: 13 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.643467:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:1.0:1786562536.643500:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652783104:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 30417us (30925us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562536.643507:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17639 00000100:00100000:1.0:1786562536.649572:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.649778:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654861184:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562536.649814:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.655110:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.657824:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.658129:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652783616 00000100:00100000:2.0:1786562536.658142:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652783616 00000100:00100000:1.0:1786562536.660987:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652783744 00000100:00100000:1.0:1786562536.661017:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652783744 00010000:00010000:1.0:1786562536.661087:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.661238:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8622 00000100:00100000:1.0:1786562536.661251:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652783744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562536.661283:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562536.661314:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.661330:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.661359:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689ec5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca5c expref: 27 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.661382:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(3 0) 00010000:00010000:1.0:1786562536.661387:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562536.661399:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.661411:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.661463:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.661501:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654861312:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562536.661633:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00010000:00010000:1.0:1786562536.661904:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 11 pid: 33115 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.662604:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.662628:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652784000 00000100:00100000:0.0:1786562536.662635:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652784000 00000100:00100000:0.0:1786562536.662684:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17087 00000100:00100000:0.0:1786562536.662695:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64083:x1873345652784000:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562536.662717:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562536.662739:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39800/0x5c655bf66689eccd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcab0 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.662811:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39800/0x5c655bf66689eccd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcab0 expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.662832:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39800/0x5c655bf66689eccd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcab0 expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.662853:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562536.662857:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562536.662861:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39800, rc 0) 00000100:00100000:0.0:1786562536.662924:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64083:x1873345652784000:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 230us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.662931:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17087 00000100:00100000:3.0:1786562536.668824:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652783872 00000100:00100000:3.0:1786562536.668849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652783872 00010000:00010000:3.0:1786562536.669000:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.669077:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8623 00000100:00100000:3.0:1786562536.669091:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652783616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562536.669109:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562536.669120:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 12 pid: 33115 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669135:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 12 pid: 33115 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669163:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689ec79 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca63 expref: 12 pid: 33115 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669182:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562536.669188:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669200:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669209:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669238:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562536.669325:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652783616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 236us (19768us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.669334:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8623 00000100:00100000:3.0:1786562536.669360:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8624 00000100:00100000:3.0:1786562536.669367:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652783872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562536.669378:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562536.669405:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669417:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669435:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ec1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca39 expref: 12 pid: 6660 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669450:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 8) 00010000:00010000:3.0:1786562536.669455:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 8) 00010000:00010000:3.0:1786562536.669464:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 30 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669555:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 30 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669566:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 8) 00010000:00010000:3.0:1786562536.669569:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 8) 00010000:00010000:3.0:1786562536.669575:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669582:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.669623:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.669640:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654861440:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562536.669717:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 30 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.669728:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654861568:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562536.669752:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00010000:00010000:0.0:1786562536.670207:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.670217:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562536.670243:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562536.670461:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689ec9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.670498:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.670508:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562536.670511:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562536.670514:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269e00, rc 0) 00000100:00100000:0.0:1786562536.670563:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64085:x1873345652783488:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 58774us (58842us total) trans 8589950627 rc 0/0 00000100:00100000:0.0:1786562536.670577:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17086 00000100:00100000:0.0:1786562536.670673:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.675947:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654861312:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562536.675986:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562536.676092:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652784256 00000100:00100000:3.0:1786562536.676102:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652784256 00000100:00100000:3.0:1786562536.676254:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17088 00000100:00100000:3.0:1786562536.676265:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64083:x1873345652784256:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562536.676302:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.676326:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ecdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcab7 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676420:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676436:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676449:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676470:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676477:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676484:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676948:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ecf0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676961:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ecf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.676969:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ecf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562536.676981:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562536.677119:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677127:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677135:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677142:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a0514600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562536.677147:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677159:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677173:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562536.677176:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562536.677180:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677187:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514600/0x5c655bf66689ece2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677201:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677207:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677213:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677218:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26fc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562536.677221:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677226:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677232:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab000) 00010000:00010000:3.0:1786562536.677234:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562536.677236:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677247:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ece9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677315:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a800/0x5c655bf66689ecdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcab7 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.677330:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ecf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcab7 expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.677337:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652783744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 16083us (22236us total) trans 0 rc 0/0 00010000:00010000:3.0:1786562536.677343:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562536.677347:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562536.677350:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e600, rc 0) 00000100:00100000:1.0:1786562536.677354:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8622 00000100:00100000:3.0:1786562536.677393:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64083:x1873345652784256:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 1129us (6719us total) trans 8589950628 rc 0/0 00000100:00100000:3.0:1786562536.677402:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17088 00000100:00100000:0.0:1786562536.692518:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.692770:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652784384 00000100:00100000:2.0:1786562536.692785:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652784384 00002000:00100000:2.0:1786562536.692860:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e884116680 x1873345652784384/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.692954:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884116680 with x1873345652784384 ext(2097152->3145727) 00002000:00010000:2.0:1786562536.692963:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884116680 00000100:00100000:2.0:1786562536.693057:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11469 00000100:00100000:2.0:1786562536.693070:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652784384:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562536.706085:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.706347:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654861440:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562536.706398:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654861568:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562536.706428:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562536.706488:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652783872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 37120us (48678us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.706503:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8624 00000100:00100000:1.0:1786562536.706818:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652784640 00000100:00100000:1.0:1786562536.706828:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652784640 00000100:00100000:1.0:1786562536.706960:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17089 00000100:00100000:1.0:1786562536.706971:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64083:x1873345652784640:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562536.707041:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562536.707069:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ecfe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcabe expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.707291:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.707313:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.707323:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.707373:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.707389:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 14 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.707405:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654861696:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562536.707489:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562536.709641:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652784384:12345-192.168.204.29@tcp:3:cat.0 Request processed in 16559us (17125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562536.709660:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11469 00002000:00100000:2.0:1786562536.709676:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e884116680 x1873345652784384/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.709690:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884116680 with x1873345652784384 ext(2097152->3145727) 00002000:00010000:2.0:1786562536.709698:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884116680 00000100:00100000:0.0:1786562536.743069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.745110:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652784768 00000100:00100000:2.0:1786562536.745130:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652784768 00002000:00100000:2.0:1786562536.745214:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e884116300 x1873345652784768/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.745228:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884116300 with x1873345652784768 ext(2097152->3145727) 00002000:00010000:2.0:1786562536.745235:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884116300 00000100:00100000:2.0:1786562536.745292:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11470 00000100:00100000:2.0:1786562536.745304:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652784768:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.752055:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654861696:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562536.752109:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.755789:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.755888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.755967:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652785024 00000100:00100000:1.0:1786562536.755979:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652785024 00002000:00100000:1.0:1786562536.756065:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3731456->3735551) req@ffff90e883179c00 x1873345652785024/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.756077:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883179c00 with x1873345652785024 ext(3731456->3735551) 00002000:00010000:1.0:1786562536.756085:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e883179c00 00000100:00100000:1.0:1786562536.756122:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11471 00000100:00100000:1.0:1786562536.756132:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+33:2349:x1873345652785024:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562536.756394:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+33:2349:x1873345652785024:12345-192.168.204.29@tcp:3:cat.0 Request processed in 263us (504us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562536.756408:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11471 00002000:00100000:1.0:1786562536.756416:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3731456->3735551) req@ffff90e883179c00 x1873345652785024/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/4536 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.756424:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883179c00 with x1873345652785024 ext(3731456->3735551) 00002000:00010000:1.0:1786562536.756427:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e883179c00 00000100:00100000:1.0:1786562536.760478:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652784896 00000100:00100000:1.0:1786562536.760499:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652784896 00010000:00010000:1.0:1786562536.760569:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 15 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562536.767282:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8625 00000100:00100000:1.0:1786562536.767316:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652784896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562536.767347:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562536.767363:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 15 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.767386:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 15 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.767419:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689ecc6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaa9 expref: 15 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.767443:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562536.767449:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770252:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770286:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770348:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562536.770438:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652784896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3133us (14655us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562536.770450:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8625 00010000:00010000:1.0:1786562536.770563:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770573:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770603:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770610:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770619:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770625:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562536.770630:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770638:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770657:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562536.770661:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562536.770666:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770672:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689ed05 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770735:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ecfe lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcabe expref: 14 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770747:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562536.770751:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562536.770754:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ecfe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcabe expref: 14 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.770765:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269a00, rc 0) 00000100:00100000:1.0:1786562536.770795:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64083:x1873345652784640:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 63826us (64729us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562536.770803:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17089 00000100:00100000:1.0:1786562536.773415:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.773495:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652785152 00000100:00100000:3.0:1786562536.773507:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652785152 00000100:00100000:3.0:1786562536.773585:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17641 00000100:00100000:3.0:1786562536.773598:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64077:x1873345652785152:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562536.773624:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.773650:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcac5 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.774101:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 32 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.774114:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 8) 00010000:00010000:3.0:1786562536.774120:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:3.0:1786562536.774126:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 12 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.774174:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 32 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.774192:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 32 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.774212:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654861824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562536.774338:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562536.817713:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654861824:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.817769:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 12 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.817800:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fc00, rc 0) 00000100:00100000:3.0:1786562536.817984:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64077:x1873345652785152:12345-192.168.204.29@tcp:101:cat.0 Request processed in 44387us (44580us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.817996:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17641 00000100:00100000:2.0:1786562536.820466:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.820581:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652785408 00000100:00100000:0.0:1786562536.820593:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652785408 00000100:00100000:0.0:1786562536.820660:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6266 00000100:00100000:0.0:1786562536.820672:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64083:x1873345652785408:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:0.0:1786562536.821104:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64083:x1873345652785408:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 432us (647us total) trans 8589950629 rc 0/0 00000100:00100000:0.0:1786562536.821113:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6266 00000100:00100000:2.0:1786562536.833276:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.833750:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652785664 00000100:00100000:1.0:1786562536.833763:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652785664 00000100:00100000:1.0:1786562536.833845:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6267 00000100:00100000:1.0:1786562536.833859:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+508:64071:x1873345652785664:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562536.834404:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+509:64071:x1873345652785664:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 548us (1151us total) trans 8589950630 rc 0/0 00000100:00100000:1.0:1786562536.834419:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6267 00000100:00100000:0.0:1786562536.834651:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652784768:12345-192.168.204.29@tcp:3:cat.0 Request processed in 89349us (91598us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562536.834661:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11470 00002000:00100000:0.0:1786562536.834672:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e884116300 x1873345652784768/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.834683:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884116300 with x1873345652784768 ext(2097152->3145727) 00002000:00010000:0.0:1786562536.834690:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884116300 00000100:00100000:1.0:1786562536.838703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.851200:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652785792 00000100:00100000:2.0:1786562536.851223:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652785792 00002000:00100000:2.0:1786562536.851317:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3145728->3735551) req@ffff90e88317ad80 x1873345652785792/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.851331:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317ad80 with x1873345652785792 ext(3145728->3735551) 00010000:00010000:2.0:1786562536.851343:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 31 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.851365:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 31 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562536.851375:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88317ad80 00000100:00100000:2.0:1786562536.851421:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5961 00000100:00100000:2.0:1786562536.851432:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652785792:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562536.867720:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.868525:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652785920 00000100:00100000:1.0:1786562536.868550:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652785920 00000100:00100000:1.0:1786562536.868625:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17642 00000100:00100000:1.0:1786562536.868638:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+26:64081:x1873345652785920:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562536.868662:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562536.868687:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcacc expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.868724:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562536.868729:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:1.0:1786562536.868740:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.868759:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.868775:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:1.0:1786562536.868844:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+27:64081:x1873345652785920:12345-192.168.204.29@tcp:101:cat.0 Request processed in 209us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562536.868852:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17642 00000100:00100000:1.0:1786562536.894518:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+33:2349:x1873345652785792:12345-192.168.204.29@tcp:4:cat.0 Request processed in 43068us (55814us total) trans 17179876045 rc 0/0 00000100:00100000:1.0:1786562536.894538:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5961 00002000:00100000:1.0:1786562536.894569:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3145728->3735551) req@ffff90e88317ad80 x1873345652785792/t17179876045(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/448 e 0 to 0 dl 1786562547 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.894581:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317ad80 with x1873345652785792 ext(3145728->3735551) 00010000:00010000:1.0:1786562536.894594:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 33 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562536.894620:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 33 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562536.894630:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88317ad80 00000100:00100000:3.0:1786562536.895303:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.898759:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786048 00000100:00100000:1.0:1786562536.898779:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786048 00002000:00100000:1.0:1786562536.900081:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e889f56680 x1873345652786048/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.900100:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f56680 with x1873345652786048 ext(2097152->3145727) 00002000:00010000:1.0:1786562536.900108:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889f56680 00000100:00100000:1.0:1786562536.901164:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11472 00000100:00100000:1.0:1786562536.901189:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652786048:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562536.904408:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.915380:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786176 00000100:00100000:0.0:1786562536.915405:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786176 00010000:00010000:0.0:1786562536.915474:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 33 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.915524:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8626 00000100:00100000:0.0:1786562536.915535:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992133050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652786176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562536.915554:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562536.915582:0:35896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562535 -> 1786562536 00002000:00010000:0.0:1786562536.915587:0:35896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562535 -> 1786562536 00010000:00010000:0.0:1786562536.915594:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 33 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.915613:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 33 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.915644:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5a83e9/0x5c655bf66689ec87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca71 expref: 33 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.915667:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:0.0:1786562536.915673:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:0.0:1786562536.915684:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.915696:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562536.915752:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562536.915772:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654861952:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562536.915900:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9856bb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562536.923440:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652786048:12345-192.168.204.29@tcp:3:cat.0 Request processed in 22245us (28122us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562536.923460:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11472 00002000:00100000:2.0:1786562536.923479:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e889f56680 x1873345652786048/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.923491:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f56680 with x1873345652786048 ext(2097152->3145727) 00002000:00010000:2.0:1786562536.923499:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889f56680 00000100:00100000:0.0:1786562536.929506:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654861952:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562536.929549:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562536.929625:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992133050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2351:x1873345652786176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 14089us (25229us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.929641:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8626 00000100:00100000:1.0:1786562536.933126:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.936620:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786304 00000100:00100000:3.0:1786562536.936644:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786304 00000100:00100000:3.0:1786562536.936760:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17643 00000100:00100000:3.0:1786562536.936774:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64085:x1873345652786304:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562536.936833:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.936857:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcad3 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.936901:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.936913:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.936922:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 31 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.936932:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562536.936938:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562536.936943:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [913408->1048575] (req 913408->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.936995:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 31 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.937061:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 31 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.937079:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654862080:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.937208:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 11 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.937218:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 11 pid: 28861 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.937228:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654862208:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.937262:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.937286:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 13 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.937296:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654862336:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562536.937332:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:1.0:1786562536.951919:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.951958:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.951984:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.952037:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.952064:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.952113:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786432 00000100:00100000:1.0:1786562536.952113:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786944 00000100:00100000:2.0:1786562536.952126:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786432 00000100:00100000:1.0:1786562536.952127:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786944 00010000:00010000:2.0:1786562536.952184:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 12 pid: 28861 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.952229:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786560 00000100:00100000:2.0:1786562536.952232:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786560 00010000:00010000:2.0:1786562536.952248:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 32 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.952277:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786688 00000100:00100000:2.0:1786562536.952281:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786688 00010000:00010000:2.0:1786562536.952294:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 15 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.952317:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8627 00000100:00100000:2.0:1786562536.952329:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652786432:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562536.952349:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562536.952382:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 12 pid: 28861 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952397:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 12 pid: 28861 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952432:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1786562536.952471:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e883178a80 x1873345652786944/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.952484:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883178a80 with x1873345652786944 ext(3145728->4194303) 00002000:00010000:1.0:1786562536.952490:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e883178a80 00000100:00100000:2.0:1786562536.952500:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652786432:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 172us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.952511:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8627 00000100:00100000:1.0:1786562536.952516:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11473 00000100:00100000:1.0:1786562536.952529:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652786944:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562536.952539:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8628 00000100:00100000:2.0:1786562536.952549:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652786560:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562536.952559:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562536.952569:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 32 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952581:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 32 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952596:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562536.952621:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652786560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 74us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562536.952628:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8628 00000100:00100000:2.0:1786562536.952642:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8629 00000100:00100000:2.0:1786562536.952651:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652786688:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562536.952659:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562536.952669:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 16 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952681:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 16 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952697:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562536.952703:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562536.952712:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952723:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562536.952768:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562536.952786:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654862464:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562536.952857:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562536.952958:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562536.952988:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787072 00000100:00100000:2.0:1786562536.952993:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787072 00002000:00100000:2.0:1786562536.953058:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9a99f8700 x1873345652787072/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.953075:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8700 with x1873345652787072 ext(3145728->4194303) 00002000:00010000:2.0:1786562536.953081:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99f8700 00000100:00100000:2.0:1786562536.953106:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11474 00000100:00100000:2.0:1786562536.953114:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652787072:12345-192.168.204.29@tcp:3:multiop.0 00010000:00010000:3.0:1786562536.955161:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004df9615/0x5c655bf66689ebd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca0f expref: 31 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.955194:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654862080:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.955212:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689ec95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca7f expref: 11 pid: 28861 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.955224:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654862208:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.955241:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689ebb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9ec expref: 16 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562536.955256:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654862336:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562536.955306:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.955329:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fa00, rc 0) 00000100:00100000:3.0:1786562536.955414:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64085:x1873345652786304:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 18642us (22300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.955424:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17643 00000100:00100000:3.0:1786562536.955466:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652786816 00000100:00100000:3.0:1786562536.955473:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652786816 00000100:00100000:3.0:1786562536.955525:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17644 00000100:00100000:3.0:1786562536.955535:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+31:64081:x1873345652786816:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562536.955552:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562536.955689:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcada expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.955723:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:3.0:1786562536.955728:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:3.0:1786562536.955739:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 32 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.955757:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 32 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562536.955766:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e000, rc 0) 00000100:00100000:3.0:1786562536.955788:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+32:64081:x1873345652786816:12345-192.168.204.29@tcp:101:cat.0 Request processed in 256us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562536.955795:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17644 00000100:00100000:0.0:1786562536.969394:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654862464:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562536.969432:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562536.970254:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652786688:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 17597us (18262us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562536.970282:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8629 00000100:00100000:2.0:1786562536.977240:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562536.982236:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652786944:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 29693us (30153us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562536.982253:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11473 00002000:00100000:1.0:1786562536.982283:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e883178a80 x1873345652786944/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.982296:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883178a80 with x1873345652786944 ext(3145728->4194303) 00002000:00010000:1.0:1786562536.982304:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e883178a80 00000100:00100000:1.0:1786562536.982343:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787200 00000100:00100000:1.0:1786562536.982352:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787200 00002000:00100000:1.0:1786562536.982392:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x711:0x0] (913408->917503) req@ffff90e9a99f9500 x1873345652787200/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562536.982402:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f9500 with x1873345652787200 ext(913408->917503) 00002000:00010000:1.0:1786562536.982406:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a99f9500 00000100:00100000:0.0:1786562536.983842:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11475 00000100:00100000:0.0:1786562536.983867:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652787200:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562536.984350:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652787200:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 493us (7125us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562536.984362:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11475 00002000:00100000:0.0:1786562536.984372:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x711:0x0] (913408->917503) req@ffff90e9a99f9500 x1873345652787200/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/4536 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.984384:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f9500 with x1873345652787200 ext(913408->917503) 00002000:00010000:0.0:1786562536.984391:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9a99f9500 00000100:00100000:2.0:1786562536.987036:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652787072:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 33881us (34036us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562536.987053:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11474 00002000:00100000:2.0:1786562536.987068:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9a99f8700 x1873345652787072/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562536.987080:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a99f8700 with x1873345652787072 ext(3145728->4194303) 00002000:00010000:2.0:1786562536.987088:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a99f8700 00000100:00100000:3.0:1786562536.989641:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562536.989690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562536.989815:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787328 00000100:00100000:0.0:1786562536.989827:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787328 00002000:00100000:0.0:1786562536.989901:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e889f57100 x1873345652787328/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.990100:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f57100 with x1873345652787328 ext(3145728->4194303) 00002000:00010000:0.0:1786562536.990106:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f57100 00000100:00100000:0.0:1786562536.990132:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787456 00000100:00100000:0.0:1786562536.990136:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787456 00002000:00100000:0.0:1786562536.990155:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e889f54700 x1873345652787456/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/0 e 0 to 0 dl 1786562547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562536.990162:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f54700 with x1873345652787456 ext(3145728->4194303) 00002000:00010000:0.0:1786562536.990165:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889f54700 00000100:00100000:0.0:1786562536.990183:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11476 00000100:00100000:0.0:1786562536.990191:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652787328:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562536.992642:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11477 00000100:00100000:2.0:1786562536.992676:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652787456:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562537.004329:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.004384:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.004537:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787712 00000100:00100000:1.0:1786562537.004551:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787712 00000100:00100000:1.0:1786562537.004648:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17645 00000100:00100000:1.0:1786562537.004663:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64085:x1873345652787712:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562537.004692:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.004714:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcae8 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.004754:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.004765:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 11 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.004775:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 28 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.004784:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562537.004789:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562537.004795:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.005422:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 28 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.005442:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 28 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.005462:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654862592:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.005635:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 11 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.005646:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 11 pid: 29967 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.005657:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654862720:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.005693:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.005703:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.005714:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654862848:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562537.005738:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.005850:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787584 00000100:00100000:0.0:1786562537.005857:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787584 00000100:00100000:0.0:1786562537.005925:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17090 00000100:00100000:0.0:1786562537.005936:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64088:x1873345652787584:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562537.005957:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.005979:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcae1 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006083:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006098:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006110:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006146:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006153:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006161:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006603:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006616:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006625:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562537.006670:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:0.0:1786562537.006676:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562537.006701:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006714:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006724:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006731:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006742:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006749:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562537.006753:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006762:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006777:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562537.006780:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562537.006785:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006792:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006805:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006811:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006818:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006823:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562537.006826:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006836:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006843:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562537.006846:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562537.006849:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006855:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006892:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006905:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 15 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.006913:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562537.006916:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562537.006919:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00080000:2.0:1786562537.007695:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562537.009659:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64088:x1873345652787584:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 3707us (5328us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.009677:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17090 00000100:00100000:2.0:1786562537.026118:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652787456:12345-192.168.204.29@tcp:3:cat.0 Request processed in 33444us (36410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562537.026136:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11477 00002000:00100000:2.0:1786562537.026155:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e889f54700 x1873345652787456/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562537.026167:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f54700 with x1873345652787456 ext(3145728->4194303) 00002000:00010000:2.0:1786562537.028118:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e889f54700 00000100:00100000:3.0:1786562537.031291:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654862592:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562537.031318:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654862720:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562537.031347:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654862848:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562537.031362:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562537.031396:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.031411:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562537.031428:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881200, rc 0) 00000100:00100000:3.0:1786562537.031502:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64085:x1873345652787712:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 26843us (27116us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562537.031513:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17645 00000100:00100000:2.0:1786562537.031980:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.033137:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787840 00000100:00100000:0.0:1786562537.033152:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787840 00010000:00010000:0.0:1786562537.034044:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 27 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.034107:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788096 00000100:00100000:0.0:1786562537.034112:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788096 00010000:00010000:0.0:1786562537.034130:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.034150:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652787968 00000100:00100000:0.0:1786562537.034153:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652787968 00010000:00010000:0.0:1786562537.034165:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 12 pid: 29967 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.034187:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8630 00000100:00100000:0.0:1786562537.034199:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652787840:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.034219:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.034249:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 27 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034279:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 27 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034309:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ca9acc/0x5c655bf66689ebdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca16 expref: 27 pid: 6658 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034330:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562537.034396:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345652787840:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 199us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.034408:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8630 00000100:00100000:0.0:1786562537.034432:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8631 00000100:00100000:0.0:1786562537.034439:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652788096:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.034447:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.034456:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034466:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034481:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689ebca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9f3 expref: 13 pid: 29662 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034491:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562537.034510:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652788096:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 72us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.034516:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8631 00000100:00100000:0.0:1786562537.034528:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8632 00000100:00100000:0.0:1786562537.034534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652787968:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.034542:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.034550:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 12 pid: 29967 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034561:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 12 pid: 29967 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034574:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689eca3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca86 expref: 12 pid: 29967 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034586:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562537.034591:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562537.034600:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 11 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034611:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 11 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.034659:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 11 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.034676:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654862976:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562537.034748:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562537.034885:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.035521:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788224 00000100:00100000:0.0:1786562537.035530:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788224 00000100:00100000:1.0:1786562537.036375:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652787328:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46175us (46742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562537.036388:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11476 00002000:00100000:1.0:1786562537.036404:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e889f57100 x1873345652787328/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:7/0 lens 488/440 e 0 to 0 dl 1786562547 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.036416:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f57100 with x1873345652787328 ext(3145728->4194303) 00002000:00010000:1.0:1786562537.036421:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f57100 00000100:00080000:2.0:1786562537.036509:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562537.036515:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1786562537.040107:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e889f55500 x1873345652788224/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.040250:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55500 with x1873345652788224 ext(4194304->5185535) 00002000:00010000:0.0:1786562537.040259:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f55500 00000100:00100000:0.0:1786562537.040315:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11478 00000100:00100000:0.0:1786562537.040351:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652788224:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562537.043362:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.044306:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788608 00000100:00100000:3.0:1786562537.044786:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.045082:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788352 00000100:00100000:2.0:1786562537.045092:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788352 00000100:00100000:2.0:1786562537.045169:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17646 00000100:00100000:2.0:1786562537.045182:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652788352:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562537.045208:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.045232:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff7e28a2/0x5c655bf66689ed4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcaef expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.045320:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654863104:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562537.045428:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.046986:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788608 00000100:00100000:0.0:1786562537.047099:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17091 00000100:00080000:2.0:1786562537.047143:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562537.047591:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+509:64090:x1873345652788608:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562537.047636:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.047664:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689ed52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcaf6 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.047764:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.047783:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.047797:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.047816:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.047824:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.047831:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.050795:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.050832:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.050851:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562537.050989:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562537.052227:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052244:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052253:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052260:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562537.052273:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052282:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052300:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562537.052303:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562537.052308:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052314:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689ed59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052691:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052703:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052709:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052714:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562537.052717:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052723:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052733:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562537.052736:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562537.052739:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052745:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689ed60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052824:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689ed52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 512 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052840:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 511 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.052849:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562537.052852:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562537.052856:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc1c00, rc 0) 00000100:00100000:0.0:1786562537.053276:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+511:64090:x1873345652788608:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 6155us (9916us total) trans 8589950631 rc 0/0 00000100:00100000:0.0:1786562537.053288:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17091 00000100:00100000:2.0:1786562537.065656:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.065708:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788736 00000100:00100000:2.0:1786562537.065720:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788736 00000100:00100000:2.0:1786562537.065787:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17647 00000100:00100000:2.0:1786562537.065799:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652788736:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562537.065824:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.065848:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689ed75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcafd expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.066513:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654863232:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562537.066783:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.067000:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654862976:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562537.067084:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562537.067187:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652787968:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 32648us (35205us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.067200:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8632 00000100:00100000:2.0:1786562537.068578:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.069067:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788864 00000100:00100000:0.0:1786562537.069078:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788864 00000100:00100000:2.0:1786562537.069082:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.069150:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652788992 00000100:00100000:0.0:1786562537.069154:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652788992 00000100:00100000:0.0:1786562537.069192:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17648 00000100:00100000:0.0:1786562537.069205:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652788864:12345-192.168.204.29@tcp:101:mirror_io.0 00002000:00010000:2.0:1786562537.069221:0:6658:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime: 1786562534 -> 1786562536 00002000:00010000:2.0:1786562537.069227:0:6658:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime: 1786562530 -> 1786562536 00010000:00010000:0.0:1786562537.069229:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1786562537.069231:0:6658:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime: 1786562534 -> 1786562536 00010000:00010000:0.0:1786562537.069255:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb04 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.069260:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654863104:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562537.069305:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:0.0:1786562537.069311:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:2.0:1786562537.069317:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff7e28a2/0x5c655bf66689ed4b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaef expref: 14 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.069332:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 14 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.069344:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff7e28a2/0x5c655bf66689ed4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaef expref: 14 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.069357:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 13 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.069361:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38400, rc 0) 00010000:00010000:0.0:1786562537.069378:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562537.069422:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652788352:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 24243us (24640us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562537.069431:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17646 00000100:00100000:2.0:1786562537.069452:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17649 00000100:00100000:2.0:1786562537.069460:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652788992:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562537.069518:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.069531:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb0b expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.069549:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562537.069553:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562537.069560:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 14 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.069573:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 14 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.069582:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39000, rc 0) 00000100:00100000:2.0:1786562537.077862:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652788992:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 8383us (8763us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.077871:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652788864:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 8646us (9278us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.077881:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17649 00000100:00100000:0.0:1786562537.078040:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17648 00002000:00010000:2.0:1786562537.078247:0:12119:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562534 -> 1786562536 00002000:00010000:2.0:1786562537.078252:0:12119:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562533 -> 1786562536 00002000:00010000:2.0:1786562537.078255:0:12119:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562534 -> 1786562536 00000100:00100000:1.0:1786562537.078281:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652788224:12345-192.168.204.29@tcp:3:cat.0 Request processed in 37946us (43394us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562537.078299:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11478 00002000:00100000:1.0:1786562537.078312:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e889f55500 x1873345652788224/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.078444:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55500 with x1873345652788224 ext(4194304->5185535) 00002000:00010000:1.0:1786562537.078452:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f55500 00000100:00100000:2.0:1786562537.079879:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654863232:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562537.080124:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689ed75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcafd expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.080160:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689ed75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcafd expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.080176:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38e00, rc 0) 00000100:00100000:2.0:1786562537.080247:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652788736:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 14450us (14617us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562537.080257:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17647 00000100:00100000:2.0:1786562537.087045:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.087294:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652789120 00000100:00100000:0.0:1786562537.087309:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652789120 00002000:00100000:0.0:1786562537.087378:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x72e:0x0] (1503232->1507327) req@ffff90e98825fb80 x1873345652789120/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.087392:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825fb80 with x1873345652789120 ext(1503232->1507327) 00002000:00010000:0.0:1786562537.087399:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825fb80 00000100:00100000:0.0:1786562537.087445:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11479 00000100:00100000:0.0:1786562537.087456:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652789120:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562537.087738:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652789120:12345-192.168.204.29@tcp:3:cat.0 Request processed in 281us (816us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562537.087748:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11479 00002000:00100000:0.0:1786562537.087756:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x72e:0x0] (1503232->1507327) req@ffff90e98825fb80 x1873345652789120/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/4536 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.087765:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825fb80 with x1873345652789120 ext(1503232->1507327) 00002000:00010000:0.0:1786562537.087769:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825fb80 00000100:00100000:3.0:1786562537.095896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.095967:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.097406:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652789248 00000100:00100000:1.0:1786562537.097423:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652789248 00000100:00100000:1.0:1786562537.097528:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652789376 00000100:00100000:1.0:1786562537.097531:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652789376 00000100:00080000:2.0:1786562537.097611:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562537.098758:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17650 00000100:00100000:0.0:1786562537.098785:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652789248:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.098812:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.098840:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ed8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb12 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.099081:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17651 00000100:00100000:1.0:1786562537.099093:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+26:2351:x1873345652789376:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562537.099104:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1786562537.099289:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654863360:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562537.099407:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786562537.100711:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689ed91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb19 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.100793:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654863488:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562537.100888:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562537.105042:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.107078:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652789632 00000100:00100000:0.0:1786562537.107099:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652789632 00000100:00100000:0.0:1786562537.107366:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6268 00000100:00100000:0.0:1786562537.107380:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9c2068850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:64085:x1873345652789632:12345-192.168.204.29@tcp:35:multiop.0 00000100:00080000:2.0:1786562537.107697:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562537.113433:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9c2068850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64085:x1873345652789632:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 6031us (8414us total) trans 8589950632 rc 0/0 00000100:00100000:1.0:1786562537.113452:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6268 00000100:00100000:0.0:1786562537.113551:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654863360:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562537.113606:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ed8a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb12 expref: 33 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.113634:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ed8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb12 expref: 33 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.113650:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:1.0:1786562537.115995:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654863488:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562537.116072:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689ed91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb19 expref: 27 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562537.116416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.116748:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652789248:12345-192.168.204.29@tcp:101:cat.0 Request processed in 17972us (20865us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562537.116761:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17650 00000100:00100000:2.0:1786562537.117069:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652789888 00000100:00100000:2.0:1786562537.117081:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652789888 00000100:00100000:2.0:1786562537.117140:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17092 00000100:00100000:2.0:1786562537.117150:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64088:x1873345652789888:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562537.117174:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.117198:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39600/0x5c655bf66689ed98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb20 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117340:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117359:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117369:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 510 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117378:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 5/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117420:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 510 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117434:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 510 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.117449:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654863616:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562537.117528:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.117538:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 16 pid: 36756 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.117548:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654863744:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562537.117572:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aee40 going to sleep for 11 seconds 00010000:00010000:1.0:1786562537.120273:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689ed91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb19 expref: 27 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.120327:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:1.0:1786562537.120432:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+26:2351:x1873345652789376:12345-192.168.204.29@tcp:101:cat.0 Request processed in 21336us (24456us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562537.120444:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17651 00000100:00100000:2.0:1786562537.127062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.127103:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.127300:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652790016 00000100:00100000:1.0:1786562537.127312:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652790016 00010000:00010000:1.0:1786562537.127379:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 511 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.127415:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652790144 00000100:00100000:1.0:1786562537.127418:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652790144 00010000:00010000:1.0:1786562537.127432:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 17 pid: 36756 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.127622:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8633 00000100:00100000:1.0:1786562537.127638:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992132050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+511:2350:x1873345652790016:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562537.127659:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562537.127667:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 511 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.127682:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 511 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.127719:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.127724:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.127735:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.127742:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562537.127807:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992132050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+511:2350:x1873345652790016:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 173us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.128292:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8634 00000100:00100000:2.0:1786562537.128305:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2350:x1873345652790144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.128494:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1c00/0x5c655bf66689ed67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcaf6 expref: 511 pid: 33114 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.128519:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654863616:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562537.128545:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654863744:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562537.128575:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129042:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562537.129053:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 17 pid: 36756 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129068:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 17 pid: 36756 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129091:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf66689ed44 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae1 expref: 17 pid: 36756 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129195:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562537.129202:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129213:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129223:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.129257:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562537.129315:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2350:x1873345652790144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1013us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.129450:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8634 00010000:00010000:0.0:1786562537.130278:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.130292:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562537.130442:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562537.131232:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39600/0x5c655bf66689ed98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb20 expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.131260:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb20 expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.131283:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562537.131286:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562537.131290:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39200, rc 0) 00000100:00100000:0.0:1786562537.131383:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64088:x1873345652789888:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 14233us (14967us total) trans 8589950633 rc 0/0 00000100:00100000:0.0:1786562537.131393:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17092 00000100:00100000:1.0:1786562537.134642:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8633 00000100:00100000:2.0:1786562537.148185:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.148313:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652790528 00000100:00100000:1.0:1786562537.148429:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652790528 00000100:00100000:1.0:1786562537.149165:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17093 00000100:00100000:1.0:1786562537.149181:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64088:x1873345652790528:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562537.149220:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.149223:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562537.149259:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689ed9f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb20 expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.149297:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.149303:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562537.149331:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689edad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb27 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150003:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150066:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150078:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150098:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150390:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150401:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150408:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562537.150413:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150421:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150433:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.150437:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562537.150440:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150447:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edb4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150625:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689edad lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb27 expref: 16 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150638:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.150640:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562537.150644:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689edad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb27 expref: 16 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.150654:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:1.0:1786562537.150762:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64088:x1873345652790528:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 1585us (2659us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562537.150772:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17093 00000100:00100000:2.0:1786562537.153823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.155149:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652790272 00000100:00100000:2.0:1786562537.155165:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652790272 00002000:00100000:2.0:1786562537.155244:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e98825e300 x1873345652790272/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562537.155257:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825e300 with x1873345652790272 ext(4194304->5185535) 00002000:00010000:2.0:1786562537.155274:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825e300 00000100:00100000:2.0:1786562537.155312:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11480 00000100:00100000:2.0:1786562537.155324:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+32:2351:x1873345652790272:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562537.174429:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+32:2351:x1873345652790272:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 19086us (20600us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562537.174446:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11480 00002000:00100000:1.0:1786562537.174464:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e98825e300 x1873345652790272/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 991232/991232 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.174477:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825e300 with x1873345652790272 ext(4194304->5185535) 00002000:00010000:1.0:1786562537.174485:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825e300 00000100:00100000:3.0:1786562537.175429:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.177759:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652790784 00000100:00100000:1.0:1786562537.177781:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652790784 00000100:00100000:1.0:1786562537.177864:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6269 00000100:00100000:1.0:1786562537.177894:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64088:x1873345652790784:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:1.0:1786562537.178291:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64088:x1873345652790784:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 414us (2866us total) trans 8589950634 rc 0/0 00000100:00100000:1.0:1786562537.178302:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6269 00010000:00010000:1.0:1786562537.190518:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562537.198835:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.199400:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652790912 00000100:00100000:1.0:1786562537.199416:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652790912 00000100:00100000:2.0:1786562537.199681:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.199706:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17652 00000100:00100000:1.0:1786562537.199724:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+32:64090:x1873345652790912:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562537.199748:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.199774:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb2e expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.199817:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.199829:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.199836:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.199846:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:1.0:1786562537.199851:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:1.0:1786562537.199858:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3817472->3993599] (req 3817472->3993599) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 33 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.199901:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.199917:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.199935:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654863872:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.200083:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.200093:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 11 pid: 6660 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.200104:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654864000:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.200135:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.200144:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.200153:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654864128:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562537.200175:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562537.211288:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.218411:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791040 00000100:00100000:0.0:1786562537.218436:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791040 00000100:00100000:1.0:1786562537.218651:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17653 00000100:00100000:1.0:1786562537.218666:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+34:2351:x1873345652791040:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562537.218695:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.218724:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689edc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb35 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.218820:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654864256:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562537.218956:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990558780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562537.226923:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.226968:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.227036:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791424 00000100:00100000:0.0:1786562537.227048:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791424 00010000:00010000:0.0:1786562537.227108:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 12 pid: 8368 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.227159:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791296 00000100:00100000:0.0:1786562537.227163:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791296 00010000:00010000:0.0:1786562537.227176:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 12 pid: 6660 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.227200:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8635 00000100:00100000:0.0:1786562537.227209:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652791424:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.227227:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.227258:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 12 pid: 8368 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.227551:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 12 pid: 8368 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.227589:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562537.227660:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652791424:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 451us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.227669:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8635 00000100:00100000:0.0:1786562537.227693:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8636 00000100:00100000:0.0:1786562537.227701:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652791296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.227710:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.227720:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 12 pid: 6660 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.227735:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 12 pid: 6660 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.227749:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562537.227766:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652791296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 67us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.227773:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8636 00000100:00100000:0.0:1786562537.228269:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791168 00000100:00100000:0.0:1786562537.228276:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791168 00000100:00100000:0.0:1786562537.228324:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17654 00000100:00100000:0.0:1786562537.228332:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652791168:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.228349:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.228366:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbc1385b/0x5c655bf66689edc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb3c expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.228423:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654864384:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562537.232924:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562537.235222:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654863872:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.235254:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ed7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb04 expref: 11 pid: 6660 timeout: 1069 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.235288:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654864000:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.235304:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6859f88/0x5c655bf66689ed0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcac5 expref: 11 pid: 8368 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.235314:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654864128:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.235357:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3817472->3993599] (req 3817472->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 35 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.235379:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:1.0:1786562537.236105:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+35:64090:x1873345652790912:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 36382us (37283us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562537.236296:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17652 00000100:00100000:2.0:1786562537.251300:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654864384:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562537.251372:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbc1385b/0x5c655bf66689edc9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb3c expref: 27 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.251411:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbc1385b/0x5c655bf66689edc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb3c expref: 27 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.251426:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562537.251499:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652791168:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23166us (40234us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562537.251510:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17654 00000100:00100000:1.0:1786562537.251716:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654864256:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562537.251742:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689edc2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb35 expref: 34 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.251763:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006a016c/0x5c655bf66689edc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb35 expref: 34 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.251773:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880c00, rc 0) 00000100:00100000:1.0:1786562537.251809:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652791040:12345-192.168.204.29@tcp:101:cat.0 Request processed in 33147us (52129us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562537.251816:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17653 00000100:00100000:0.0:1786562537.273377:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.273541:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791680 00000100:00100000:1.0:1786562537.273554:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791680 00000100:00100000:1.0:1786562537.273636:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6270 00000100:00100000:1.0:1786562537.273650:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+510:64081:x1873345652791680:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1786562537.274097:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+511:64081:x1873345652791680:12345-192.168.204.29@tcp:35:cat.0 Request processed in 447us (734us total) trans 8589950635 rc 0/0 00000100:00100000:1.0:1786562537.274107:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6270 00000100:00100000:2.0:1786562537.276458:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.276513:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.276550:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.276598:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792064 00000100:00100000:3.0:1786562537.276612:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792064 00000100:00100000:3.0:1786562537.276678:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791936 00000100:00100000:3.0:1786562537.276682:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791936 00000100:00100000:3.0:1786562537.276705:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 427 00000100:00100000:3.0:1786562537.276716:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652792064:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562537.276734:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652791808 00000100:00100000:0.0:1786562537.276740:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652791808 00000100:00100000:0.0:1786562537.276778:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 242 00000100:00100000:0.0:1786562537.276787:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+16:2349:x1873345652791808:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562537.276808:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652792064:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562537.276817:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 427 00000100:00100000:0.0:1786562537.276823:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+16:2349:x1873345652791808:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.276836:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 242 00000100:00100000:3.0:1786562537.276840:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 428 00000100:00100000:3.0:1786562537.276850:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652791936:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562537.277131:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652791936:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 281us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562537.277138:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 428 00000100:00100000:3.0:1786562537.284437:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.285884:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792192 00000100:00100000:2.0:1786562537.285900:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792192 00000100:00100000:2.0:1786562537.285992:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17655 00000100:00100000:2.0:1786562537.286042:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652792192:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562537.286073:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.286099:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689edd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb43 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.286134:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:2.0:1786562537.286200:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689edd0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb43 expref: 12 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.286230:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000931b48b6/0x5c655bf66689edd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb43 expref: 12 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.286250:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38600, rc 0) 00000100:00100000:2.0:1786562537.286332:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652792192:12345-192.168.204.29@tcp:101:cat.0 Request processed in 330us (1913us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562537.286341:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17655 00000100:00100000:2.0:1786562537.317943:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.318053:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792320 00000100:00100000:3.0:1786562537.318068:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792320 00010000:00010000:3.0:1786562537.318126:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562537.318180:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8637 00000100:00100000:3.0:1786562537.318193:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652792320:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562537.318214:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562537.318246:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562537.318276:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562537.318309:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000376ba8cd/0x5c655bf66689ed21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcada expref: 33 pid: 37002 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562537.318340:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:3.0:1786562537.318346:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:3.0:1786562537.318357:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 32 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562537.318369:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 32 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562537.318420:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 32 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562537.318445:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654864512:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562537.318560:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562537.323168:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654864512:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562537.323208:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562537.323301:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652792320:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5109us (5371us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562537.323315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8637 00000100:00100000:0.0:1786562537.323601:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.323811:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792448 00000100:00100000:1.0:1786562537.323821:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792448 00002000:00100000:1.0:1786562537.323882:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (3817472->3821567) req@ffff90e9bf8dce00 x1873345652792448/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.323893:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dce00 with x1873345652792448 ext(3817472->3821567) 00002000:00010000:1.0:1786562537.323900:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dce00 00000100:00100000:1.0:1786562537.323936:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11481 00000100:00100000:1.0:1786562537.323947:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652792448:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562537.324232:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652792448:12345-192.168.204.29@tcp:3:cat.0 Request processed in 286us (631us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562537.324241:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11481 00002000:00100000:1.0:1786562537.324248:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (3817472->3821567) req@ffff90e9bf8dce00 x1873345652792448/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/4536 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.324266:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dce00 with x1873345652792448 ext(3817472->3821567) 00002000:00010000:1.0:1786562537.324271:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dce00 00000100:00100000:0.0:1786562537.342801:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.342914:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792576 00000100:00100000:3.0:1786562537.342928:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792576 00002000:00100000:3.0:1786562537.342998:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (3989504->3993599) req@ffff90e9bf8dfb80 x1873345652792576/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562537.343058:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dfb80 with x1873345652792576 ext(3989504->3993599) 00002000:00010000:3.0:1786562537.343067:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dfb80 00000100:00100000:3.0:1786562537.343099:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11482 00000100:00100000:3.0:1786562537.343112:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652792576:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562537.343878:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652792576:12345-192.168.204.29@tcp:3:cat.0 Request processed in 763us (1088us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562537.343889:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11482 00002000:00100000:3.0:1786562537.343899:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (3989504->3993599) req@ffff90e9bf8dfb80 x1873345652792576/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/4536 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562537.343909:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dfb80 with x1873345652792576 ext(3989504->3993599) 00002000:00010000:3.0:1786562537.343914:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dfb80 00000100:00100000:2.0:1786562537.347915:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.347969:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.347997:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.348234:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793088 00000100:00100000:1.0:1786562537.348247:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793088 00000100:00100000:1.0:1786562537.348332:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6271 00000100:00100000:1.0:1786562537.348346:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+511:64090:x1873345652793088:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562537.348721:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+512:64090:x1873345652793088:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 377us (720us total) trans 8589950636 rc 0/0 00000100:00100000:1.0:1786562537.348730:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6271 00000100:00100000:0.0:1786562537.348948:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792704 00000100:00100000:0.0:1786562537.348954:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792704 00002000:00100000:0.0:1786562537.348996:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (0->913407) req@ffff90e98825df80 x1873345652792704/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.349038:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825df80 with x1873345652792704 ext(0->913407) 00002000:00010000:0.0:1786562537.349045:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825df80 00000100:00100000:0.0:1786562537.349063:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652792832 00000100:00100000:0.0:1786562537.349066:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652792832 00002000:00100000:0.0:1786562537.349084:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72e:0x0] (1507328->2097151) req@ffff90e98825d180 x1873345652792832/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.349092:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825d180 with x1873345652792832 ext(1507328->2097151) 00002000:00010000:0.0:1786562537.349096:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825d180 00000100:00100000:0.0:1786562537.349113:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11483 00000100:00100000:0.0:1786562537.349121:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652792704:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562537.349841:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11484 00000100:00100000:0.0:1786562537.349854:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652792832:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562537.364400:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.364741:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793344 00000100:00100000:1.0:1786562537.364755:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793344 00000100:00100000:1.0:1786562537.364930:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17094 00000100:00100000:1.0:1786562537.364945:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64098:x1873345652793344:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562537.364979:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.365042:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb4a expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.365180:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.365198:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.365217:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562537.365231:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562537.365424:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689edd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.365450:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.365471:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.365475:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562537.365480:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881000, rc 0) 00000100:00100000:1.0:1786562537.365567:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64098:x1873345652793344:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 626us (1183us total) trans 8589950637 rc 0/0 00000100:00100000:1.0:1786562537.365577:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17094 00000100:00100000:0.0:1786562537.382403:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652792704:12345-192.168.204.29@tcp:3:cat.0 Request processed in 33267us (34487us total) trans 0 rc 913408/913408 00000100:00100000:0.0:1786562537.382420:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11483 00002000:00100000:0.0:1786562537.382435:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (0->913407) req@ffff90e98825df80 x1873345652792704/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.382452:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825df80 with x1873345652792704 ext(0->913407) 00002000:00010000:0.0:1786562537.382465:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825df80 00000100:00100000:0.0:1786562537.393886:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652792832:12345-192.168.204.29@tcp:3:cat.0 Request processed in 44018us (45899us total) trans 0 rc 589824/589824 00000100:00100000:0.0:1786562537.393904:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11484 00002000:00100000:0.0:1786562537.393921:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x72e:0x0] (1507328->2097151) req@ffff90e98825d180 x1873345652792832/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 589824/589824 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.393933:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825d180 with x1873345652792832 ext(1507328->2097151) 00002000:00010000:0.0:1786562537.393940:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825d180 00000100:00100000:2.0:1786562537.436123:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.436222:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793472 00000100:00100000:0.0:1786562537.436235:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793472 00000100:00100000:0.0:1786562537.436315:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17656 00000100:00100000:0.0:1786562537.436337:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64097:x1873345652793472:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.436363:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.436387:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb51 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.436425:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:0.0:1786562537.436430:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:0.0:1786562537.436443:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.436475:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.436498:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc1c00, rc 0) 00000100:00100000:0.0:1786562537.436578:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64097:x1873345652793472:12345-192.168.204.29@tcp:101:cat.0 Request processed in 252us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.436587:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17656 00000100:00100000:2.0:1786562537.447277:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.447554:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793600 00000100:00100000:3.0:1786562537.447571:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793600 00002000:00100000:3.0:1786562537.447883:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e98825ea00 x1873345652793600/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562537.447896:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ea00 with x1873345652793600 ext(2097152->3145727) 00002000:00010000:3.0:1786562537.447903:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825ea00 00000100:00100000:3.0:1786562537.448080:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11485 00000100:00100000:3.0:1786562537.448098:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652793600:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562537.465919:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2348:x1873345652793600:12345-192.168.204.29@tcp:3:cat.0 Request processed in 17811us (18650us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562537.465938:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11485 00002000:00100000:0.0:1786562537.465954:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e98825ea00 x1873345652793600/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562537.465965:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ea00 with x1873345652793600 ext(2097152->3145727) 00002000:00010000:0.0:1786562537.465973:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825ea00 00000100:00100000:3.0:1786562537.483516:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.483811:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793728 00000100:00100000:0.0:1786562537.483824:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793728 00000100:00100000:0.0:1786562537.483902:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17657 00000100:00100000:0.0:1786562537.483914:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64097:x1873345652793728:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.483943:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.483968:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb58 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.484050:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 31 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.484063:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(6 8) 00010000:00010000:0.0:1786562537.484070:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:0.0:1786562537.484076:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 13 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.484120:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 31 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.484134:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 31 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.484152:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654864640:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562537.484272:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.487854:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654864640:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562537.487913:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 13 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.487942:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb3f7a00, rc 0) 00000100:00100000:0.0:1786562537.488063:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64097:x1873345652793728:12345-192.168.204.29@tcp:101:cat.0 Request processed in 4150us (4563us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.488075:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17657 00000100:00100000:3.0:1786562537.491362:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.495740:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793856 00000100:00100000:1.0:1786562537.495761:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793856 00002000:00100000:1.0:1786562537.495842:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (3817472->3993599) req@ffff90e889f55180 x1873345652793856/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.495856:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55180 with x1873345652793856 ext(3817472->3993599) 00010000:00010000:1.0:1786562537.495868:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 32 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.495891:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 32 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562537.495908:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e889f55180 00000100:00100000:1.0:1786562537.496048:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5962 00000100:00100000:1.0:1786562537.496061:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652793856:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562537.514465:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345652793856:12345-192.168.204.29@tcp:4:cat.0 Request processed in 18379us (23089us total) trans 17179876046 rc 0/0 00000100:00100000:1.0:1786562537.514486:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5962 00002000:00100000:1.0:1786562537.514505:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x714:0x0] (3817472->3993599) req@ffff90e889f55180 x1873345652793856/t17179876046(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/448 e 0 to 0 dl 1786562548 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.514517:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55180 with x1873345652793856 ext(3817472->3993599) 00010000:00010000:1.0:1786562537.514741:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 34 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.514768:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 34 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562537.514778:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e889f55180 00000100:00100000:3.0:1786562537.527480:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.527630:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652793984 00000100:00100000:0.0:1786562537.527645:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652793984 00010000:00010000:0.0:1786562537.527701:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 34 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.527758:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8638 00000100:00100000:0.0:1786562537.527773:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:2351:x1873345652793984:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.527794:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.527824:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 34 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.527843:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 34 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.527877:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689edbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3817472->18446744073709551615] (req 3817472->3993599) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb2e expref: 34 pid: 29964 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.527901:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:0.0:1786562537.527907:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:0.0:1786562537.527918:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 12 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.527931:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 12 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.527986:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 12 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.528075:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654864768:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562537.528188:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.551567:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654864768:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562537.551611:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562537.551703:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652793984:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23932us (24248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.551716:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8638 00000100:00100000:3.0:1786562537.560581:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.561047:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652794112 00000100:00100000:1.0:1786562537.561061:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652794112 00002000:00100000:1.0:1786562537.561134:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e889f55f80 x1873345652794112/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.561216:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55f80 with x1873345652794112 ext(3145728->4194303) 00002000:00010000:1.0:1786562537.561224:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f55f80 00000100:00100000:1.0:1786562537.561279:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11486 00000100:00100000:1.0:1786562537.561292:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652794112:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562537.593316:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652794112:12345-192.168.204.29@tcp:3:cat.0 Request processed in 32007us (32734us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562537.593343:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11486 00002000:00100000:1.0:1786562537.593361:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e889f55f80 x1873345652794112/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.593372:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f55f80 with x1873345652794112 ext(3145728->4194303) 00002000:00010000:1.0:1786562537.593379:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f55f80 00000100:00100000:3.0:1786562537.645227:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.647652:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652794368 00000100:00100000:2.0:1786562537.647675:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652794368 00000100:00100000:2.0:1786562537.647782:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17095 00000100:00100000:2.0:1786562537.647796:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+512:64104:x1873345652794368:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562537.647834:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.647863:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689edfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb5f expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.647970:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.647991:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.648071:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.648092:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.648101:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.648108:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656197:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689ee0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656227:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656242:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562537.656277:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562537.656407:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656415:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656421:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656427:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf64800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562537.656432:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656444:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656458:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562537.656462:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562537.656467:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656473:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689ee01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656487:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656493:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656499:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656505:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf65600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562537.656507:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656513:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656519:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479db00) 00010000:00010000:2.0:1786562537.656521:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562537.656524:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656535:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689ee08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656594:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689edfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb5f expref: 515 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656609:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb5f expref: 514 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.656617:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562537.656619:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786562537.656622:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562537.656707:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+514:64104:x1873345652794368:12345-192.168.204.29@tcp:101:cat.0 Request processed in 8914us (11495us total) trans 8589950638 rc 0/0 00000100:00100000:2.0:1786562537.656716:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17095 00000100:00100000:0.0:1786562537.660708:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.667814:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652794496 00000100:00100000:2.0:1786562537.667837:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652794496 00002000:00100000:2.0:1786562537.667917:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bf8df800 x1873345652794496/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562537.667931:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8df800 with x1873345652794496 ext(4194304->5185535) 00002000:00010000:2.0:1786562537.667938:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8df800 00000100:00100000:2.0:1786562537.667977:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11487 00000100:00100000:2.0:1786562537.667987:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652794496:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562537.685409:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.685748:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.685782:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.685810:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.685868:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652794880 00000100:00100000:0.0:1786562537.685881:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652794880 00000100:00100000:0.0:1786562537.685940:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652794752 00000100:00100000:0.0:1786562537.685944:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652794752 00000100:00100000:0.0:1786562537.685966:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795008 00000100:00100000:0.0:1786562537.685969:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795008 00000100:00100000:0.0:1786562537.685993:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17658 00000100:00100000:0.0:1786562537.686038:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345652794880:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.686065:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.686088:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057c3353c/0x5c655bf66689ee1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb6d expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.686168:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654864896:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562537.686285:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.686309:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17659 00000100:00100000:0.0:1786562537.686316:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+34:2349:x1873345652794752:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.686326:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.686338:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689ee24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb66 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.686380:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654865024:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562537.686407:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b300 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.686426:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17660 00000100:00100000:0.0:1786562537.686434:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+35:2349:x1873345652795008:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.686441:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.686451:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb74 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.686467:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(7 8) 00010000:00010000:0.0:1786562537.686473:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:0.0:1786562537.686487:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 36 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.686509:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 36 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.686523:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39c00, rc 0) 00000100:00100000:0.0:1786562537.686551:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652795008:12345-192.168.204.29@tcp:101:cat.0 Request processed in 118us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.686558:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17660 00000100:00100000:2.0:1786562537.693527:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652794624 00000100:00100000:2.0:1786562537.693550:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652794624 00000100:00100000:2.0:1786562537.693662:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 966 00000100:00100000:2.0:1786562537.693674:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+514:2349:x1873345652794624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562537.693694:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562537.693728:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689ee0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb5f expref: 514 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.693754:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562537.693759:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562537.693834:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+513:2349:x1873345652794624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 163us (8440us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.693842:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 966 00000100:00100000:3.0:1786562537.714732:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.714970:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652794496:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46980us (54275us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1786562537.714986:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11487 00002000:00100000:2.0:1786562537.715002:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bf8df800 x1873345652794496/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562537.715043:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8df800 with x1873345652794496 ext(4194304->5185535) 00002000:00010000:2.0:1786562537.715051:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8df800 00000100:00100000:1.0:1786562537.715261:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795264 00000100:00100000:1.0:1786562537.715272:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795264 00000100:00100000:1.0:1786562537.715341:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17096 00000100:00100000:1.0:1786562537.715351:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+513:64105:x1873345652795264:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562537.715380:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.715404:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689ee32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb7b expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.715491:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.715507:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.715520:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.715535:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.715546:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.715552:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716074:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689ee47 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716086:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689ee47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716095:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689ee47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562537.716108:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562537.716273:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716282:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716289:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716295:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562537.716300:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716308:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716329:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562537.716332:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562537.716337:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716344:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716361:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716367:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716373:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716378:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562537.716380:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716385:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716392:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2d00) 00010000:00010000:1.0:1786562537.716394:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562537.716396:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716401:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716457:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689ee32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb7b expref: 516 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716472:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689ee47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb7b expref: 515 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.716481:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.716483:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562537.716486:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880a00, rc 0) 00000100:00100000:1.0:1786562537.716549:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+515:64105:x1873345652795264:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1199us (1832us total) trans 8589950639 rc 0/0 00000100:00100000:1.0:1786562537.716558:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17096 00000100:00100000:1.0:1786562537.720283:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654864896:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562537.720352:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000057c3353c/0x5c655bf66689ee1d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb6d expref: 27 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.720382:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057c3353c/0x5c655bf66689ee1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb6d expref: 27 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.720398:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38c00, rc 0) 00000100:00100000:1.0:1786562537.720738:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345652794880:12345-192.168.204.29@tcp:101:cat.0 Request processed in 34732us (34988us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562537.720748:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17658 00000100:00100000:0.0:1786562537.726237:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654865024:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562537.726308:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689ee24 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb66 expref: 35 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.726354:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689ee24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb66 expref: 35 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.726369:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39200, rc 0) 00000100:00100000:0.0:1786562537.726455:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+34:2349:x1873345652794752:12345-192.168.204.29@tcp:101:cat.0 Request processed in 40131us (40663us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562537.726466:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17659 00000100:00100000:0.0:1786562537.733100:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.733248:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795392 00000100:00100000:1.0:1786562537.733274:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795392 00000100:00100000:1.0:1786562537.733360:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 967 00000100:00100000:1.0:1786562537.733372:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992130450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+515:2350:x1873345652795392:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562537.733393:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562537.733426:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689ee47 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb7b expref: 515 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.733460:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.733466:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562537.733552:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992130450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+514:2350:x1873345652795392:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 182us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562537.733562:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 967 00000100:00100000:1.0:1786562537.741568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.741712:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795520 00000100:00100000:2.0:1786562537.741724:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795520 00000100:00100000:2.0:1786562537.741794:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17661 00000100:00100000:2.0:1786562537.741806:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:64104:x1873345652795520:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562537.741829:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.741853:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb82 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.741903:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.741914:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562537.741920:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562537.741925:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.741968:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.741984:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 12 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.742000:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654865152:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562537.742136:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867ae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562537.756313:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654865152:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562537.756373:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.756400:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562537.756508:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+35:64104:x1873345652795520:12345-192.168.204.29@tcp:101:cat.0 Request processed in 14704us (14953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.756527:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17661 00000100:00100000:0.0:1786562537.757486:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.757655:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795648 00000100:00100000:1.0:1786562537.757666:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795648 00002000:00100000:1.0:1786562537.757727:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x711:0x0] (913408->1048575) req@ffff90e9bf8df480 x1873345652795648/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.757738:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8df480 with x1873345652795648 ext(913408->1048575) 00010000:00010000:1.0:1786562537.757749:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 13 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.757767:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 13 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562537.757776:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bf8df480 00000100:00100000:1.0:1786562537.757816:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5963 00000100:00100000:1.0:1786562537.757829:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652795648:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562537.808502:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652795648:12345-192.168.204.29@tcp:4:cat.0 Request processed in 50656us (51002us total) trans 17179876047 rc 0/0 00000100:00100000:1.0:1786562537.808529:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5963 00002000:00100000:1.0:1786562537.808549:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x711:0x0] (913408->1048575) req@ffff90e9bf8df480 x1873345652795648/t17179876047(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:8/0 lens 488/448 e 0 to 0 dl 1786562548 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.808561:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8df480 with x1873345652795648 ext(913408->1048575) 00010000:00010000:1.0:1786562537.808576:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.808598:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562537.808605:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9bf8df480 00000100:00100000:3.0:1786562537.826128:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.827957:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795776 00000100:00100000:2.0:1786562537.827979:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795776 00000100:00100000:2.0:1786562537.828100:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17662 00000100:00100000:2.0:1786562537.828113:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+26:64105:x1873345652795776:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562537.828139:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562537.828166:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb89 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828210:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828222:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 11 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828231:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828239:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(3 0) 00010000:00010000:2.0:1786562537.828245:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562537.828262:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3211264->3645439] (req 3211264->3645439) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828312:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828337:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.828357:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654865280:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562537.828490:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 11 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828502:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 11 pid: 6658 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.828523:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654865408:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562537.828557:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.828567:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 11 pid: 29966 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.828578:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654865536:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562537.828603:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867ae3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562537.848132:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.848219:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.848264:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652795904 00000100:00100000:0.0:1786562537.848275:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652795904 00010000:00010000:0.0:1786562537.848340:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.848383:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796032 00000100:00100000:0.0:1786562537.848387:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796032 00010000:00010000:0.0:1786562537.848404:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 12 pid: 6658 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.848429:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8639 00000100:00100000:0.0:1786562537.848441:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652795904:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562537.848466:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562537.848498:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.848527:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.848559:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009873a059/0x5c655bf66689ed1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcad3 expref: 15 pid: 37002 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.848582:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562537.848587:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562537.848597:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 34 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.848729:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8640 00000100:00100000:2.0:1786562537.848742:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652796032:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562537.848756:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562537.848775:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 12 pid: 6658 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.848793:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 12 pid: 6658 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.848812:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562537.848885:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652796032:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 147us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.848894:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8640 00000100:00100000:1.0:1786562537.849377:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654865280:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.849392:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689ed83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb0b expref: 11 pid: 6658 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.849405:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654865408:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562537.849416:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654865536:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.849450:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3211264->3645439] (req 3211264->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 27 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.849468:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:1.0:1786562537.849506:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+27:64105:x1873345652795776:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 21398us (23396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562537.849525:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17662 00010000:00010000:0.0:1786562537.849984:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 34 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.850056:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 34 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562537.850074:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654865664:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562537.850145:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99482f840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562537.901079:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.901113:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562537.901143:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.901310:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796416 00000100:00100000:1.0:1786562537.901336:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796416 00000100:00100000:1.0:1786562537.901404:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17097 00000100:00100000:1.0:1786562537.901415:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64107:x1873345652796416:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:1.0:1786562537.901462:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562537.901488:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb90 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.901582:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.901599:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.901612:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.901629:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.901637:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.901643:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.902233:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.902263:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.902273:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.902996:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.903031:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 16 pid: 36756 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.903052:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654865792:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562537.905811:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.905982:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796160 00000100:00100000:2.0:1786562537.905996:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796160 00000100:00100000:3.0:1786562537.906034:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796544 00000100:00100000:3.0:1786562537.906038:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796544 00010000:00010000:2.0:1786562537.906064:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1786562537.906080:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e882960380 x1873345652796544/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562537.906091:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960380 with x1873345652796544 ext(0->1048575) 00002000:00010000:3.0:1786562537.906096:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882960380 00000100:00100000:2.0:1786562537.906104:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796288 00000100:00100000:2.0:1786562537.906107:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796288 00000100:00100000:3.0:1786562537.906117:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11488 00010000:00010000:2.0:1786562537.906121:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 12 pid: 29966 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562537.906127:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652796544:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562537.906139:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8641 00000100:00100000:2.0:1786562537.906942:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652796160:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562537.906960:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562537.906989:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907033:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907068:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf66689ed13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcacc expref: 27 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907091:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562537.907396:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654865664:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562537.907425:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562537.907490:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652795904:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 59050us (59375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562537.907499:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8639 00000100:00100000:2.0:1786562537.907543:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652796160:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 607us (6478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.907551:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8641 00000100:00100000:2.0:1786562537.907584:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8642 00000100:00100000:2.0:1786562537.907596:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652796288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562537.907608:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562537.907621:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 12 pid: 29966 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907634:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 12 pid: 29966 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907650:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7d6a94a/0x5c655bf66689ec80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca6a expref: 12 pid: 29966 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907662:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562537.907667:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1786562537.907676:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907692:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562537.907738:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 25 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562537.907756:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654865920:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562537.907822:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9923c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1786562537.909215:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562537.930285:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562537.930467:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654865920:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562537.930499:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562537.931846:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652796288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 24241us (30722us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562537.931863:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8642 00000100:00100000:1.0:1786562537.932285:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796672 00000100:00100000:1.0:1786562537.932297:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796672 00002000:00100000:1.0:1786562537.932369:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (3211264->3215359) req@ffff90e882961c00 x1873345652796672/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/0 e 0 to 0 dl 1786562548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.932393:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961c00 with x1873345652796672 ext(3211264->3215359) 00002000:00010000:1.0:1786562537.932403:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882961c00 00000100:00100000:1.0:1786562537.932459:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11489 00000100:00100000:1.0:1786562537.932475:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652796672:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562537.936457:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652796672:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 3970us (6172us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562537.936474:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11489 00002000:00100000:1.0:1786562537.936487:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (3211264->3215359) req@ffff90e882961c00 x1873345652796672/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/4536 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.936499:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961c00 with x1873345652796672 ext(3211264->3215359) 00002000:00010000:1.0:1786562537.936506:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882961c00 00000100:00100000:1.0:1786562537.946108:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654865792:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562537.946155:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562537.952047:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843559 is committed 00000001:00080000:1.0:1786562537.952086:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843563 is committed 00000001:00080000:1.0:1786562537.952096:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843562 is committed 00000001:00080000:1.0:1786562537.952109:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843566 is committed 00000001:00080000:1.0:1786562537.952122:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843565 is committed 00000100:00100000:0.0:1786562537.978715:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.980492:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652796800 00000100:00100000:1.0:1786562537.980510:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652796800 00010000:00010000:1.0:1786562537.980585:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 17 pid: 36756 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562537.980645:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8643 00000100:00100000:1.0:1786562537.980657:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652796800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562537.980678:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562537.980687:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 17 pid: 36756 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980703:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 17 pid: 36756 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980731:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689edde lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb4a expref: 17 pid: 36756 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980755:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.980761:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980773:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980782:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980814:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562537.980886:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2350:x1873345652796800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 230us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562537.980895:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8643 00010000:00010000:1.0:1786562537.980936:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.980944:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562537.981001:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:1.0:1786562537.981055:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562537.981083:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981096:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981107:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981114:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981120:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981126:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562537.981130:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981137:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981147:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562537.981150:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562537.981155:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981161:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689ee6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981172:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981179:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981185:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981190:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562537.981193:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981200:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981208:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2d00) 00010000:00010000:1.0:1786562537.981211:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562537.981214:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981220:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689ee71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981277:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689ee63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981299:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562537.981306:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562537.981309:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562537.981311:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880400, rc 0) 00000100:00100000:1.0:1786562537.981544:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64107:x1873345652796416:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 80130us (80400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562537.981553:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17097 00000100:00100000:1.0:1786562537.986771:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652796544:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 80627us (80956us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562537.986790:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11488 00002000:00100000:1.0:1786562537.986811:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e882960380 x1873345652796544/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:8/0 lens 488/440 e 0 to 0 dl 1786562548 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562537.986823:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882960380 with x1873345652796544 ext(0->1048575) 00002000:00010000:1.0:1786562537.986831:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e882960380 00000100:00100000:1.0:1786562537.986948:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562537.986997:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797056 00000100:00100000:1.0:1786562537.987030:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797056 00000100:00100000:1.0:1786562537.987087:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6272 00000100:00100000:1.0:1786562537.987097:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+514:64105:x1873345652797056:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562537.987456:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+515:64105:x1873345652797056:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 359us (508us total) trans 8589950640 rc 0/0 00000100:00100000:1.0:1786562537.987464:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6272 00000100:00100000:1.0:1786562537.991693:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562537.991846:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797184 00000100:00100000:0.0:1786562537.991860:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797184 00000100:00100000:0.0:1786562537.991931:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17663 00000100:00100000:0.0:1786562537.991944:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2348:x1873345652797184:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562537.991972:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562537.991996:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb97 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.992054:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562537.992059:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562537.992072:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 15 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.992092:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 15 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562537.992107:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23a00, rc 0) 00000100:00100000:0.0:1786562537.992231:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652797184:12345-192.168.204.29@tcp:101:cat.0 Request processed in 289us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562537.992239:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17663 00000100:00100000:0.0:1786562538.022153:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.022202:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.022225:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.022284:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797312 00000100:00100000:0.0:1786562538.022297:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797312 00000100:00100000:0.0:1786562538.022366:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797440 00000100:00100000:0.0:1786562538.022369:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797440 00000100:00100000:0.0:1786562538.022403:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797696 00000100:00100000:0.0:1786562538.022406:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797696 00000100:00100000:0.0:1786562538.022429:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17664 00000100:00100000:0.0:1786562538.022446:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+7:2348:x1873345652797312:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562538.022474:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.022500:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689ee86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcb9e expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.022968:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17665 00000100:00100000:2.0:1786562538.022982:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652797440:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562538.022993:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.023035:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcba5 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.023069:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562538.023074:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562538.023087:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 13 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.023113:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 13 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.023128:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562538.023193:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652797440:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 215us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.023201:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17665 00000100:00100000:2.0:1786562538.023225:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17666 00000100:00100000:2.0:1786562538.023232:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652797696:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562538.023239:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.023262:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbb3 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.023276:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:2.0:1786562538.023279:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:2.0:1786562538.023287:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 13 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.023298:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 13 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.023308:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65e00, rc 0) 00000100:00100000:2.0:1786562538.023346:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652797696:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 114us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.023356:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17666 00000100:00100000:0.0:1786562538.023746:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654866048:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562538.023817:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00080000:0.0:1786562538.023839:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562538.023898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.023923:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.023944:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797568 00000100:00100000:0.0:1786562538.023951:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797568 00000100:00100000:0.0:1786562538.023994:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797824 00000100:00100000:0.0:1786562538.023998:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797824 00000100:00100000:0.0:1786562538.024038:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17667 00000100:00100000:0.0:1786562538.024046:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652797568:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562538.024056:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.024068:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689ee9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbac expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.024103:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654866176:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562538.024129:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988a00180 going to sleep for 11 seconds 00000100:00080000:0.0:1786562538.024140:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562538.024152:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17668 00000100:00100000:0.0:1786562538.024159:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652797824:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:0.0:1786562538.024168:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.024176:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d758f5/0x5c655bf66689eea2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbba expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.024205:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654866304:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562538.024232:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:2.0:1786562538.029109:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.031921:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652797952 00000100:00100000:0.0:1786562538.031940:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652797952 00000100:00100000:0.0:1786562538.032084:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17669 00000100:00100000:0.0:1786562538.032098:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+14:64104:x1873345652797952:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562538.032125:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.032150:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbc1 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.032198:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 8 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.032209:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562538.032214:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562538.032220:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.032294:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 8 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.032314:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 8 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.032348:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654866432:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562538.032470:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562538.036505:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.036891:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652798080 00000100:00100000:3.0:1786562538.036903:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652798080 00002000:00100000:3.0:1786562538.036968:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->1507327) req@ffff90e882963b80 x1873345652798080/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.036981:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963b80 with x1873345652798080 ext(1048576->1507327) 00010000:00010000:3.0:1786562538.036993:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.037032:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.037041:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882963b80 00000100:00100000:3.0:1786562538.037071:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5964 00000100:00100000:3.0:1786562538.037082:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652798080:12345-192.168.204.29@tcp:4:cat.0 00002000:00010000:0.0:1786562538.040499:0:6658:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562535 -> 1786562537 00002000:00010000:0.0:1786562538.040523:0:6658:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562535 -> 1786562537 00002000:00010000:0.0:1786562538.040526:0:6658:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562535 -> 1786562537 00000100:00100000:0.0:1786562538.040560:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654866304:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562538.040621:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051d758f5/0x5c655bf66689eea2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbba expref: 14 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.040653:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d758f5/0x5c655bf66689eea2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbba expref: 14 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.040847:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22600, rc 0) 00000100:00100000:0.0:1786562538.040944:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652797824:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 16783us (17017us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562538.040955:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17668 00002000:00010000:0.0:1786562538.041421:0:29965:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562536 -> 1786562537 00000100:00100000:0.0:1786562538.041436:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654866176:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562538.045033:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689ee9b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbac expref: 12 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.045074:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a70ccd3/0x5c655bf66689ee9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbac expref: 12 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.045099:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22e00, rc 0) 00000100:00100000:0.0:1786562538.045187:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652797568:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 21140us (21288us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562538.045198:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17667 00000100:00100000:0.0:1786562538.045303:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654866432:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562538.045324:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 15 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.045336:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23e00, rc 0) 00000100:00100000:0.0:1786562538.045356:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:64104:x1873345652797952:12345-192.168.204.29@tcp:101:cat.0 Request processed in 13263us (16265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.045364:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17669 00000100:00100000:0.0:1786562538.045427:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654866048:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562538.045448:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689ee86 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb9e expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.045461:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c87604/0x5c655bf66689ee86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb9e expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.045469:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23c00, rc 0) 00000100:00100000:0.0:1786562538.045491:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2348:x1873345652797312:12345-192.168.204.29@tcp:101:cat.0 Request processed in 23054us (23355us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562538.045497:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17664 00000100:00100000:3.0:1786562538.060994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.070017:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652798336 00000100:00100000:2.0:1786562538.070042:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652798336 00000100:00100000:1.0:1786562538.070333:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652798080:12345-192.168.204.29@tcp:4:cat.0 Request processed in 33243us (33832us total) trans 21474843567 rc 0/0 00000100:00100000:1.0:1786562538.070350:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5964 00002000:00100000:1.0:1786562538.070368:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->1507327) req@ffff90e882963b80 x1873345652798080/t21474843567(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/448 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.070381:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882963b80 with x1873345652798080 ext(1048576->1507327) 00010000:00010000:1.0:1786562538.070393:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.070414:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562538.070424:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e882963b80 00000100:00080000:1.0:1786562538.075077:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562538.075335:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17098 00000100:00100000:2.0:1786562538.075357:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64107:x1873345652798336:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:2.0:1786562538.075386:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.075416:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eeb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbc8 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.075680:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.075699:0:36756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.075710:0:36756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.075756:0:36756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.075769:0:36756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 18 pid: 33115 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.075786:0:36756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654866560:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562538.084383:0:36756:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9923c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786562538.084613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.084748:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.085899:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652798464 00000100:00100000:1.0:1786562538.085915:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652798464 00002000:00100000:1.0:1786562538.085987:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e9887edc00 x1873345652798464/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.085999:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887edc00 with x1873345652798464 ext(0->1048575) 00002000:00010000:1.0:1786562538.086039:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887edc00 00000100:00100000:1.0:1786562538.086073:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11490 00000100:00100000:1.0:1786562538.086083:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652798464:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562538.087049:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652798592 00000100:00100000:2.0:1786562538.087061:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652798592 00010000:00010000:2.0:1786562538.087100:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.087132:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8644 00000100:00100000:2.0:1786562538.087140:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2350:x1873345652798592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562538.087155:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562538.087182:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.087198:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.087228:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feda40b3/0x5c655bf66689ed28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcae8 expref: 9 pid: 29662 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.087257:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562538.087262:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562538.087271:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.087281:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.087328:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.087346:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654866688:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562538.087417:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227300 going to sleep for 11 seconds 00000100:00100000:2.0:1786562538.090210:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654866560:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562538.090261:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562538.126299:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.126412:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652798720 00000100:00100000:1.0:1786562538.126425:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652798720 00010000:00010000:1.0:1786562538.126488:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 19 pid: 33115 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.126551:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8645 00000100:00100000:1.0:1786562538.126563:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992130050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652798720:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.126584:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562538.126592:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 19 pid: 33115 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.126610:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 19 pid: 33115 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.126639:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689ee78 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb90 expref: 19 pid: 33115 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.126663:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562538.126681:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.126693:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.126701:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.126741:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.126818:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992130050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652798720:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 256us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.126826:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8645 00010000:00010000:3.0:1786562538.127527:0:36756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.127540:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562538.127567:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562538.127788:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64800/0x5c655bf66689eeb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc8 expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.127809:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc8 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.127818:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562538.127822:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562538.127825:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf65600, rc 0) 00000100:00100000:3.0:1786562538.127880:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64107:x1873345652798336:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 52533us (66904us total) trans 8589950641 rc 0/0 00000100:00100000:3.0:1786562538.127888:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17098 00000100:00100000:3.0:1786562538.130078:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.130258:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652798848 00000100:00100000:0.0:1786562538.130270:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652798848 00002000:00100000:0.0:1786562538.130331:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9887ef800 x1873345652798848/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562538.130344:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ef800 with x1873345652798848 ext(1048576->2097151) 00002000:00010000:0.0:1786562538.130351:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887ef800 00000100:00100000:0.0:1786562538.130388:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11491 00000100:00100000:0.0:1786562538.130398:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652798848:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562538.132711:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652798464:12345-192.168.204.29@tcp:3:cat.0 Request processed in 46614us (48090us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562538.132728:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11490 00002000:00100000:1.0:1786562538.132744:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x711:0x0] (0->1048575) req@ffff90e9887edc00 x1873345652798464/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.132757:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887edc00 with x1873345652798464 ext(0->1048575) 00002000:00010000:1.0:1786562538.132763:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9887edc00 00000100:00100000:0.0:1786562538.142563:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.148102:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652799104 00000100:00100000:3.0:1786562538.148124:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652799104 00000100:00100000:3.0:1786562538.148225:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17099 00000100:00100000:3.0:1786562538.148239:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64107:x1873345652799104:12345-192.168.204.29@tcp:101:mirror_io.0 00010000:00010000:3.0:1786562538.148286:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562538.148291:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562538.148326:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eeb7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc8 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148350:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562538.148356:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562538.148373:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38a00/0x5c655bf66689eec5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbcf expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148517:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148534:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148544:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148560:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148566:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148572:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148579:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bfe39200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562538.148584:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148591:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148599:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562538.148602:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562538.148607:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148613:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39200/0x5c655bf66689eecc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148648:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38a00/0x5c655bf66689eec5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbcf expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148657:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562538.148660:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562538.148663:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38a00/0x5c655bf66689eec5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbcf expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.148685:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38a00, rc 0) 00000100:00100000:3.0:1786562538.148766:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64107:x1873345652799104:12345-192.168.204.29@tcp:101:mirror_io.0 Request processed in 530us (6219us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562538.148774:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17099 00000100:00100000:2.0:1786562538.149147:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654866688:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562538.149173:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562538.149202:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652798592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 62064us (64455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.149211:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8644 00000100:00100000:3.0:1786562538.161753:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.161877:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.162266:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652798848:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 31866us (32198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562538.162281:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11491 00002000:00100000:2.0:1786562538.162299:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9887ef800 x1873345652798848/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.162311:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ef800 with x1873345652798848 ext(1048576->2097151) 00002000:00010000:2.0:1786562538.162318:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887ef800 00000100:00100000:1.0:1786562538.162461:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652799232 00000100:00100000:1.0:1786562538.162471:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652799232 00000100:00100000:1.0:1786562538.162522:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17670 00000100:00100000:1.0:1786562538.162533:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64110:x1873345652799232:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562538.162553:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562538.162575:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbd6 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.162610:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562538.162616:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562538.162625:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.162644:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.162660:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880400, rc 0) 00000100:00100000:1.0:1786562538.162687:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64110:x1873345652799232:12345-192.168.204.29@tcp:101:cat.0 Request processed in 156us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.162697:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17670 00000100:00100000:1.0:1786562538.162722:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652799488 00000100:00100000:1.0:1786562538.162726:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652799488 00000100:00100000:1.0:1786562538.162755:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6273 00000100:00100000:1.0:1786562538.162763:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64107:x1873345652799488:12345-192.168.204.29@tcp:35:mirror_io.0 00000100:00100000:1.0:1786562538.163038:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64107:x1873345652799488:12345-192.168.204.29@tcp:35:mirror_io.0 Request processed in 274us (1160us total) trans 8589950642 rc 0/0 00000100:00100000:1.0:1786562538.163046:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6273 00000100:00100000:3.0:1786562538.166427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.166570:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652799616 00000100:00100000:2.0:1786562538.166583:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652799616 00000100:00100000:2.0:1786562538.166653:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17671 00000100:00100000:2.0:1786562538.166665:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64098:x1873345652799616:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562538.166690:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.166716:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbdd expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.166757:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 16 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.166767:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 12 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.166776:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 34 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.166785:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:2.0:1786562538.166791:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:2.0:1786562538.166797:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.166842:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 34 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.166857:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 34 pid: 6660 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.166875:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654866816:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562538.166987:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 12 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.167044:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 12 pid: 8368 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.167057:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654866944:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562538.167092:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 16 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.167102:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 16 pid: 29967 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.167111:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654867072:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562538.167134:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227540 going to sleep for 11 seconds 00010000:00010000:1.0:1786562538.213432:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562538.214913:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.214951:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.214993:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.215106:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652799872 00000100:00100000:1.0:1786562538.215118:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652799872 00010000:00010000:1.0:1786562538.215173:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 13 pid: 8368 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.215219:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652799744 00000100:00100000:1.0:1786562538.215223:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652799744 00010000:00010000:1.0:1786562538.215237:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 35 pid: 6660 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.215268:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800000 00000100:00100000:1.0:1786562538.215271:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800000 00010000:00010000:1.0:1786562538.215286:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 17 pid: 29967 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.215308:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8646 00000100:00100000:1.0:1786562538.215319:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652799872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.215342:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562538.215374:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 13 pid: 8368 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215388:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 13 pid: 8368 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215421:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.215497:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652799872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 178us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.215506:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8646 00000100:00100000:1.0:1786562538.215530:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8647 00000100:00100000:1.0:1786562538.215537:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652799744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.215546:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562538.215555:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 35 pid: 6660 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215567:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 35 pid: 6660 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215581:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.215601:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652799744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 64us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.215608:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8647 00000100:00100000:1.0:1786562538.215621:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8648 00000100:00100000:1.0:1786562538.215628:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652800000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.215636:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562538.215645:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 17 pid: 29967 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215655:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 17 pid: 29967 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215671:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:1.0:1786562538.215677:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:1.0:1786562538.215688:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215700:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.215747:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.215765:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654867200:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562538.215830:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1786562538.216591:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689ee2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb74 expref: 34 pid: 6660 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.216620:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654866816:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562538.216636:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09a548d/0x5c655bf66689ee94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbb3 expref: 12 pid: 8368 timeout: 1070 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.216646:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654866944:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562538.216658:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007307b82a/0x5c655bf66689edf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb58 expref: 17 pid: 29967 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.216675:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654867072:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562538.216707:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.216719:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bbf64800, rc 0) 00000100:00100000:2.0:1786562538.216765:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64098:x1873345652799616:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 50103us (50352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.216775:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17671 00000100:00100000:3.0:1786562538.230672:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.230722:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.230870:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800128 00000100:00100000:1.0:1786562538.230880:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800256 00000100:00100000:2.0:1786562538.230884:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800128 00000100:00100000:1.0:1786562538.230884:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800256 00002000:00100000:2.0:1786562538.230949:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9887ef480 x1873345652800128/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.230949:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88ac84700 x1873345652800256/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.230962:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ef480 with x1873345652800128 ext(1048576->2097151) 00002000:00100000:1.0:1786562538.230968:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84700 with x1873345652800256 ext(2097152->3145727) 00002000:00010000:2.0:1786562538.230969:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887ef480 00002000:00010000:1.0:1786562538.230972:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88ac84700 00000100:00100000:2.0:1786562538.231031:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11492 00000100:00100000:1.0:1786562538.231037:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11493 00000100:00100000:2.0:1786562538.231041:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652800128:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562538.231043:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652800256:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562538.238544:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654867200:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562538.238585:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.238688:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2350:x1873345652800000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23058us (23691us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.238702:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8648 00000100:00100000:3.0:1786562538.273974:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.274821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.275140:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800512 00000100:00100000:2.0:1786562538.275155:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800512 00000100:00100000:2.0:1786562538.275233:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17100 00000100:00100000:2.0:1786562538.275259:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+515:64114:x1873345652800512:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562538.275294:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.275329:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbe4 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.275648:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.275667:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.275680:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.275699:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.275707:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.275714:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.276060:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800640 00000100:00100000:0.0:1786562538.276069:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800640 00000100:00100000:0.0:1786562538.276115:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17672 00000100:00100000:0.0:1786562538.276124:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64098:x1873345652800640:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562538.276138:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.276152:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbeb expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.276180:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 16 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.276190:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562538.276195:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1786562538.276201:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->3993599] (req 3145728->3993599) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 12 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.276214:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.276225:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.276232:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562538.276257:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562538.276258:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 16 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.276276:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 16 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.276292:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654867328:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562538.276405:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562538.276521:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652800256:12345-192.168.204.29@tcp:3:cat.0 Request processed in 45476us (45797us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562538.276532:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11493 00002000:00100000:0.0:1786562538.276544:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88ac84700 x1873345652800256/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562538.276556:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88ac84700 with x1873345652800256 ext(2097152->3145727) 00010000:00010000:0.0:1786562538.276563:0:14017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 15 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.276577:0:14017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 15 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562538.276584:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88ac84700 00010000:00010000:1.0:1786562538.276877:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276887:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276896:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276905:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bbf65600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562538.276910:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276918:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276933:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562538.276936:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562538.276942:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276949:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65600/0x5c655bf66689eee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276965:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276972:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276978:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276984:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26fa00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562538.276987:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.276993:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.277001:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479db00) 00010000:00010000:1.0:1786562538.277048:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562538.277052:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.277058:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fa00/0x5c655bf66689eeef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.277116:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65e00/0x5c655bf66689eee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 518 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.277135:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 517 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.277143:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562538.277146:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562538.277148:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e000, rc 0) 00000100:00100000:0.0:1786562538.277318:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652800128:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 46278us (46661us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562538.277327:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11492 00002000:00100000:0.0:1786562538.277335:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x72e:0x0] (1048576->2097151) req@ffff90e9887ef480 x1873345652800128/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562538.277352:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ef480 with x1873345652800128 ext(1048576->2097151) 00002000:00010000:0.0:1786562538.277356:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887ef480 00000100:00100000:2.0:1786562538.284854:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.284908:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800768 00000100:00100000:2.0:1786562538.284920:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800768 00002000:00100000:2.0:1786562538.284986:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3211264->3645439) req@ffff90e98825c000 x1873345652800768/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.284999:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825c000 with x1873345652800768 ext(3211264->3645439) 00010000:00010000:2.0:1786562538.285066:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 15 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.285086:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 15 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562538.285095:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e98825c000 00000100:00100000:2.0:1786562538.285126:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5965 00000100:00100000:2.0:1786562538.285138:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652800768:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562538.285709:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654867328:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562538.285751:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->3993599] (req 3145728->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.285780:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176f200, rc 0) 00000100:00100000:3.0:1786562538.288814:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64098:x1873345652800640:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 12676us (13983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562538.288831:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17672 00000100:00100000:3.0:1786562538.289777:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.300625:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+517:64114:x1873345652800512:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 25349us (26644us total) trans 8589950643 rc 0/0 00000100:00100000:1.0:1786562538.300644:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17100 00000100:00100000:1.0:1786562538.301120:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652800896 00000100:00100000:1.0:1786562538.301133:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652800896 00000100:00100000:1.0:1786562538.301200:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17673 00000100:00100000:1.0:1786562538.301211:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:64104:x1873345652800896:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562538.301235:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562538.302566:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbf2 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.302622:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 14 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.302634:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 8) 00010000:00010000:1.0:1786562538.302641:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 8) 00010000:00010000:1.0:1786562538.302648:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.302703:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 14 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.302717:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 14 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.304101:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654867456:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562538.304248:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562538.333760:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654867456:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562538.333817:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.333846:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881800, rc 0) 00000100:00100000:1.0:1786562538.333943:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+35:64104:x1873345652800896:12345-192.168.204.29@tcp:101:cat.0 Request processed in 32734us (44174us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.333954:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17673 00000100:00100000:3.0:1786562538.342359:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.344077:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801024 00000100:00100000:1.0:1786562538.344099:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801024 00002000:00100000:1.0:1786562538.344176:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (4005888->4194303) req@ffff90e9af24f480 x1873345652801024/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.344190:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24f480 with x1873345652801024 ext(4005888->4194303) 00010000:00010000:1.0:1786562538.344202:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 15 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.344226:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 15 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562538.344234:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9af24f480 00000100:00100000:1.0:1786562538.344288:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5966 00000100:00100000:1.0:1786562538.344300:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652801024:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:2.0:1786562538.351409:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.351705:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801152 00000100:00100000:1.0:1786562538.351719:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801152 00000100:00100000:1.0:1786562538.351797:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17674 00000100:00100000:1.0:1786562538.351809:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64110:x1873345652801152:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562538.351833:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562538.351858:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcbf9 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.351899:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562538.351905:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 0) 00010000:00010000:1.0:1786562538.351913:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 11 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.351928:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 11 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.351945:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881e00, rc 0) 00000100:00100000:1.0:1786562538.352062:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64110:x1873345652801152:12345-192.168.204.29@tcp:101:cat.0 Request processed in 255us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.352070:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17674 00000100:00100000:2.0:1786562538.365046:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.365160:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801280 00000100:00100000:0.0:1786562538.365172:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801280 00000100:00100000:0.0:1786562538.365263:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17675 00000100:00100000:0.0:1786562538.365277:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+35:64114:x1873345652801280:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562538.365306:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.365332:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc00 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.365373:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 8) 00010000:00010000:0.0:1786562538.365384:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.365393:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(8 8) 00010000:00010000:0.0:1786562538.365399:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->3698687] (req 3289088->3698687) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 36 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.365468:0:6658:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.365487:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->3698687] (req 3289088->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 36 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.365504:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99176fe00, rc 0) 00000100:00100000:0.0:1786562538.365586:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+36:64114:x1873345652801280:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 312us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.365603:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17675 00000100:00100000:0.0:1786562538.376529:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652800768:12345-192.168.204.29@tcp:4:cat.0 Request processed in 91376us (91675us total) trans 21474843568 rc 0/0 00000100:00100000:0.0:1786562538.376547:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5965 00002000:00100000:0.0:1786562538.376565:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3211264->3645439) req@ffff90e98825c000 x1873345652800768/t21474843568(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/448 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562538.376576:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825c000 with x1873345652800768 ext(3211264->3645439) 00010000:00010000:0.0:1786562538.376591:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 17 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.376612:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 17 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562538.376622:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e98825c000 00000100:00100000:2.0:1786562538.385389:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2349:x1873345652801024:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 41072us (43026us total) trans 17179876048 rc 0/0 00000100:00100000:2.0:1786562538.385412:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5966 00002000:00100000:2.0:1786562538.385744:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (4005888->4194303) req@ffff90e9af24f480 x1873345652801024/t17179876048(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/448 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.385757:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24f480 with x1873345652801024 ext(4005888->4194303) 00010000:00010000:2.0:1786562538.385772:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.385790:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562538.385800:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e9af24f480 00000100:00100000:3.0:1786562538.390042:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.390169:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.390371:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801408 00000100:00100000:1.0:1786562538.390385:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801408 00010000:00010000:1.0:1786562538.390452:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 17 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.390821:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801536 00000100:00100000:0.0:1786562538.390827:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801536 00010000:00010000:0.0:1786562538.390852:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.390947:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8649 00000100:00100000:0.0:1786562538.390959:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652801408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562538.390979:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562538.391043:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 17 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391060:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 17 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391089:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51850bf/0x5c655bf66689ee5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3211264->3645439) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb89 expref: 17 pid: 29963 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391109:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1786562538.391114:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1786562538.391125:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391134:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391144:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1786562538.391146:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1786562538.391151:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391158:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.391203:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 10 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.391226:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654867712:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562538.391351:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.391363:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654867840:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562538.391389:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562538.392260:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8650 00000100:00100000:1.0:1786562538.392277:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652801536:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.392294:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562538.392393:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562536 -> 1786562537 00002000:00010000:1.0:1786562538.392397:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562536 -> 1786562537 00010000:00010000:1.0:1786562538.392405:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.392784:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.392811:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff6e389/0x5c655bf66689eeda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4005888->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbdd expref: 17 pid: 8368 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.392832:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 8) 00010000:00010000:1.0:1786562538.392837:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 8) 00010000:00010000:1.0:1786562538.392846:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.392861:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.392905:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 35 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.392921:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 35 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.392934:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654867968:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562538.393052:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562538.399892:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654867968:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562538.399899:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654867712:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562538.399909:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654867840:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562538.399930:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562538.399930:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.399998:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2350:x1873345652801536:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 7726us (9827us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.399998:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652801408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 9039us (9993us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.400031:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8650 00000100:00100000:0.0:1786562538.400035:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8649 00000100:00100000:1.0:1786562538.418195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.418392:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801664 00000100:00100000:3.0:1786562538.418405:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801664 00002000:00100000:3.0:1786562538.418483:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e883178000 x1873345652801664/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.418497:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883178000 with x1873345652801664 ext(3145728->4194303) 00010000:00010000:3.0:1786562538.418516:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.418536:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.418546:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e883178000 00000100:00100000:3.0:1786562538.418581:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5967 00000100:00100000:3.0:1786562538.418728:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652801664:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562538.422110:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.422981:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801792 00000100:00100000:1.0:1786562538.422997:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801792 00002000:00100000:1.0:1786562538.423086:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e98825ed80 x1873345652801792/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.423099:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ed80 with x1873345652801792 ext(2097152->3145727) 00002000:00010000:1.0:1786562538.423106:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825ed80 00000100:00100000:1.0:1786562538.423151:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11494 00000100:00100000:1.0:1786562538.423163:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652801792:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562538.428963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.429406:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652801920 00000100:00100000:1.0:1786562538.429420:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652801920 00002000:00100000:1.0:1786562538.429497:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x730:0x0] (3989504->3993599) req@ffff90e88b518380 x1873345652801920/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.429519:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518380 with x1873345652801920 ext(3989504->3993599) 00002000:00010000:1.0:1786562538.429526:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b518380 00000100:00100000:1.0:1786562538.429560:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11495 00000100:00100000:1.0:1786562538.429571:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652801920:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562538.429956:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652801920:12345-192.168.204.29@tcp:3:cat.0 Request processed in 383us (1008us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562538.429966:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11495 00002000:00100000:1.0:1786562538.429974:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x730:0x0] (3989504->3993599) req@ffff90e88b518380 x1873345652801920/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/4536 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.429983:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b518380 with x1873345652801920 ext(3989504->3993599) 00002000:00010000:1.0:1786562538.429987:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88b518380 00000100:00100000:3.0:1786562538.450995:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652801664:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 32388us (32805us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562538.451038:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5967 00002000:00100000:3.0:1786562538.451054:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e883178000 x1873345652801664/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.451066:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e883178000 with x1873345652801664 ext(3145728->4194303) 00010000:00010000:3.0:1786562538.451079:0:16203:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.451100:0:16203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.451109:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e883178000 00000100:00100000:1.0:1786562538.451265:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652801792:12345-192.168.204.29@tcp:3:cat.0 Request processed in 28103us (29261us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562538.451276:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11494 00002000:00100000:1.0:1786562538.451283:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e98825ed80 x1873345652801792/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.451293:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ed80 with x1873345652801792 ext(2097152->3145727) 00002000:00010000:1.0:1786562538.451298:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825ed80 00000100:00100000:2.0:1786562538.451411:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.451530:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802176 00000100:00100000:1.0:1786562538.451541:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802176 00000100:00100000:1.0:1786562538.451741:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6274 00000100:00100000:1.0:1786562538.451753:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9884c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64098:x1873345652802176:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562538.452251:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9884c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64098:x1873345652802176:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 499us (839us total) trans 8589950644 rc 0/0 00000100:00100000:1.0:1786562538.452260:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6274 00000100:00100000:0.0:1786562538.474328:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.474510:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.475370:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802304 00000100:00100000:2.0:1786562538.475386:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802304 00000100:00100000:2.0:1786562538.475598:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802432 00000100:00100000:2.0:1786562538.475603:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802432 00000100:00100000:1.0:1786562538.475646:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17676 00000100:00100000:1.0:1786562538.475660:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:64104:x1873345652802304:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562538.475700:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562538.475726:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc07 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.475770:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.475782:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 0) 00010000:00010000:1.0:1786562538.475788:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1786562538.475794:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.475838:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.476949:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17677 00000100:00100000:0.0:1786562538.476970:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64110:x1873345652802432:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562538.476987:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.477022:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc0e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.477049:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 8) 00010000:00010000:0.0:1786562538.477058:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->3698687] (req 3289088->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.477065:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(9 8) 00010000:00010000:0.0:1786562538.477070:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 17 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.477107:0:6659:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->3698687] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.477122:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 17 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.477139:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:0.0:1786562538.477317:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64110:x1873345652802432:12345-192.168.204.29@tcp:101:cat.0 Request processed in 356us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.477326:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17677 00000100:00100000:3.0:1786562538.480748:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.481221:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802560 00000100:00100000:0.0:1786562538.481248:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802560 00010000:00010000:0.0:1786562538.481304:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.481351:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8651 00000100:00100000:0.0:1786562538.481363:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345652802560:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562538.481384:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562538.481415:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.481490:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.481572:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689ef0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf2 expref: 36 pid: 12119 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.481650:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:0.0:1786562538.481656:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:0.0:1786562538.481826:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.481841:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60080000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.481896:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.481911:0:35896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x70000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562538.481927:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654868352:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562538.482070:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92d80 going to sleep for 11 seconds 00010000:00010000:1.0:1786562538.487349:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 10 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.487373:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654868096:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562538.487511:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562538.491929:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.492122:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b51b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654868352:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562538.492157:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562538.492247:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+35:2349:x1873345652802560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10876us (11504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.492262:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8651 00000100:00100000:0.0:1786562538.494469:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654868096:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562538.494533:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.494561:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880800, rc 0) 00000100:00100000:0.0:1786562538.494660:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:64104:x1873345652802304:12345-192.168.204.29@tcp:101:cat.0 Request processed in 19004us (20348us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.497458:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17676 00000100:00100000:3.0:1786562538.498690:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802688 00000100:00100000:3.0:1786562538.498707:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802688 00002000:00100000:3.0:1786562538.498777:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3289088->3293183) req@ffff90e88b51b100 x1873345652802688/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.498790:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b100 with x1873345652802688 ext(3289088->3293183) 00010000:00010000:3.0:1786562538.498802:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.498820:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.498829:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b51b100 00000100:00100000:3.0:1786562538.498857:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5968 00000100:00100000:3.0:1786562538.498868:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+35:2348:x1873345652802688:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562538.499170:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+35:2348:x1873345652802688:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 301us (7257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562538.499177:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5968 00002000:00100000:3.0:1786562538.499185:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3289088->3293183) req@ffff90e88b51b100 x1873345652802688/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/4536 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.499193:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b100 with x1873345652802688 ext(3289088->3293183) 00010000:00010000:3.0:1786562538.499199:0:29461:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.499208:0:29461:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.499215:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b51b100 00000100:00100000:0.0:1786562538.499562:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.500756:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802816 00000100:00100000:2.0:1786562538.500771:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802816 00002000:00100000:2.0:1786562538.500833:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3993599) req@ffff90e88b51a300 x1873345652802816/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.500846:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51a300 with x1873345652802816 ext(3145728->3993599) 00010000:00010000:2.0:1786562538.500856:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 11 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.500872:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 11 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562538.500880:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b51a300 00000100:00100000:2.0:1786562538.500915:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5969 00000100:00100000:2.0:1786562538.500926:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652802816:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562538.528989:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652802816:12345-192.168.204.29@tcp:4:cat.0 Request processed in 28046us (29410us total) trans 21474843569 rc 0/0 00000100:00100000:3.0:1786562538.529053:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5969 00002000:00100000:3.0:1786562538.529072:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3993599) req@ffff90e88b51a300 x1873345652802816/t21474843569(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/448 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.529084:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51a300 with x1873345652802816 ext(3145728->3993599) 00010000:00010000:3.0:1786562538.529097:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 13 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.529123:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 13 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.529132:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88b51a300 00000100:00100000:0.0:1786562538.533088:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.533857:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652802944 00000100:00100000:3.0:1786562538.533874:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652802944 00002000:00100000:3.0:1786562538.533952:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3694592->3698687) req@ffff90e88b51b480 x1873345652802944/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.533965:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b480 with x1873345652802944 ext(3694592->3698687) 00010000:00010000:3.0:1786562538.533977:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.533996:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.534033:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b51b480 00000100:00100000:3.0:1786562538.534075:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5970 00000100:00100000:3.0:1786562538.534087:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652802944:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562538.534749:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652802944:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 659us (1673us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562538.534762:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5970 00002000:00100000:3.0:1786562538.534772:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3694592->3698687) req@ffff90e88b51b480 x1873345652802944/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/4536 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.534789:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b51b480 with x1873345652802944 ext(3694592->3698687) 00010000:00010000:3.0:1786562538.534798:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.534810:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.534819:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b51b480 00000100:00100000:2.0:1786562538.536635:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.541245:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803072 00000100:00100000:3.0:1786562538.541266:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803072 00010000:00010000:3.0:1786562538.541327:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 13 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562538.541386:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8652 00000100:00100000:3.0:1786562538.541400:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992132c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652803072:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562538.541421:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562538.541465:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 13 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.541483:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 13 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.541526:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014091f0f/0x5c655bf66689eef6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbeb expref: 13 pid: 28861 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.541556:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1786562538.541562:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1786562538.541572:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.541585:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.541638:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 16 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562538.541656:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654868480:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562538.541875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.541923:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.542174:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:2.0:1786562538.542842:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803200 00000100:00100000:2.0:1786562538.542852:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803200 00002000:00100000:2.0:1786562538.542911:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (3289088->3698687) req@ffff90e88b519880 x1873345652803200/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.542923:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519880 with x1873345652803200 ext(3289088->3698687) 00010000:00010000:2.0:1786562538.542932:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.542950:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 35 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562538.542958:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b519880 00000100:00100000:2.0:1786562538.542990:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5971 00000100:00100000:2.0:1786562538.543029:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+35:2350:x1873345652803200:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:1.0:1786562538.543834:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803456 00000100:00100000:1.0:1786562538.543843:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803456 00000100:00100000:1.0:1786562538.543892:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6275 00000100:00100000:1.0:1786562538.543901:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+517:64114:x1873345652803456:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562538.544213:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+518:64114:x1873345652803456:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 312us (2287us total) trans 8589950645 rc 0/0 00000100:00100000:1.0:1786562538.544221:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6275 00000100:00100000:0.0:1786562538.555079:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654868480:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562538.555118:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562538.555173:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992132c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652803072:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13777us (18552us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.555187:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8652 00000100:00100000:3.0:1786562538.561620:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+37:2350:x1873345652803200:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 18603us (19730us total) trans 17179876049 rc 0/0 00000100:00100000:3.0:1786562538.561640:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5971 00002000:00100000:3.0:1786562538.561655:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (3289088->3698687) req@ffff90e88b519880 x1873345652803200/t17179876049(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/448 e 0 to 0 dl 1786562549 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.561668:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519880 with x1873345652803200 ext(3289088->3698687) 00010000:00010000:3.0:1786562538.561681:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 37 pid: 6658 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.561705:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 37 pid: 6658 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562538.561716:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88b519880 00000100:00100000:3.0:1786562538.566539:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.566593:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.566695:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803584 00000100:00100000:2.0:1786562538.566707:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803584 00002000:00100000:2.0:1786562538.566770:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9af24dc00 x1873345652803584/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562538.566783:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24dc00 with x1873345652803584 ext(3145728->4194303) 00002000:00010000:2.0:1786562538.566790:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24dc00 00000100:00100000:2.0:1786562538.566829:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11496 00000100:00100000:2.0:1786562538.566840:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652803584:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562538.568187:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803712 00000100:00100000:1.0:1786562538.568204:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803712 00010000:00010000:1.0:1786562538.568262:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 37 pid: 6658 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.568305:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8653 00000100:00100000:1.0:1786562538.568316:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+37:2348:x1873345652803712:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.568332:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562538.568359:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x60000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 37 pid: 6658 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.568377:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 37 pid: 6658 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.568417:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689ef19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3289088->18446744073709551615] (req 3289088->3698687) gid 0 flags: 0x44801000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc00 expref: 37 pid: 6658 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.568438:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(10 8) 00010000:00010000:1.0:1786562538.568444:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:1.0:1786562538.568455:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.568467:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.568516:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.568533:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654868608:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562538.568627:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562538.588989:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873345654868608:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562538.589067:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.589136:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+36:2348:x1873345652803712:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 20820us (22609us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.589150:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8653 00000100:00100000:0.0:1786562538.589369:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652803584:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 22529us (22773us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562538.589380:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11496 00002000:00100000:0.0:1786562538.589397:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9af24dc00 x1873345652803584/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562538.589409:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9af24dc00 with x1873345652803584 ext(3145728->4194303) 00002000:00010000:0.0:1786562538.589417:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9af24dc00 00000100:00100000:3.0:1786562538.600255:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.600355:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803840 00000100:00100000:0.0:1786562538.600368:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803840 00000100:00100000:0.0:1786562538.600455:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17678 00000100:00100000:0.0:1786562538.600467:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+36:64104:x1873345652803840:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562538.600490:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.600525:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc15 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.600563:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:0.0:1786562538.600569:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:0.0:1786562538.600580:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 37 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.600598:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 37 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.600615:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562538.600703:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+37:64104:x1873345652803840:12345-192.168.204.29@tcp:101:cat.0 Request processed in 239us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.600712:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17678 00000100:00100000:2.0:1786562538.604571:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.604866:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652803968 00000100:00100000:1.0:1786562538.604879:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652803968 00002000:00100000:1.0:1786562538.604947:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e98825ce00 x1873345652803968/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.604962:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ce00 with x1873345652803968 ext(3145728->4194303) 00002000:00010000:1.0:1786562538.604968:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825ce00 00000100:00100000:1.0:1786562538.605055:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11497 00000100:00100000:1.0:1786562538.605067:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652803968:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562538.631774:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.632108:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652803968:12345-192.168.204.29@tcp:3:cat.0 Request processed in 27039us (27548us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562538.632123:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11497 00002000:00100000:1.0:1786562538.632142:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e98825ce00 x1873345652803968/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.632154:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ce00 with x1873345652803968 ext(3145728->4194303) 00002000:00010000:1.0:1786562538.632161:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825ce00 00000100:00100000:1.0:1786562538.632199:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652804096 00000100:00100000:1.0:1786562538.632208:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652804096 00002000:00100000:1.0:1786562538.632261:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e98825f800 x1873345652804096/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.632270:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825f800 with x1873345652804096 ext(4194304->5185535) 00002000:00010000:1.0:1786562538.632274:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825f800 00000100:00100000:1.0:1786562538.632301:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11498 00000100:00100000:1.0:1786562538.632311:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+37:2348:x1873345652804096:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562538.663395:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.665695:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562538.666185:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652804480 00000100:00100000:0.0:1786562538.666198:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652804480 00000100:00100000:0.0:1786562538.666287:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17679 00000100:00100000:0.0:1786562538.666298:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64110:x1873345652804480:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562538.666336:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562538.666361:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc23 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.666404:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(6 0) 00010000:00010000:0.0:1786562538.666410:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562538.666421:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.666454:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562538.666470:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39600, rc 0) 00000100:00100000:0.0:1786562538.666539:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64110:x1873345652804480:12345-192.168.204.29@tcp:101:cat.0 Request processed in 244us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562538.666547:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17679 00000100:00100000:1.0:1786562538.667654:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652804352 00000100:00100000:1.0:1786562538.668548:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652804352 00000100:00100000:1.0:1786562538.668934:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17101 00000100:00100000:1.0:1786562538.668948:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:64118:x1873345652804352:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562538.668983:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562538.669034:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689ef3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc1c expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.669166:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.669185:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 517 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.669194:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.669248:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 517 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.669262:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 517 pid: 34450 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.669278:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654868736:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562538.669844:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+37:2348:x1873345652804096:12345-192.168.204.29@tcp:3:cat.0 Request processed in 37528us (38079us total) trans 0 rc 991232/991232 00000100:00100000:0.0:1786562538.669859:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11498 00002000:00100000:0.0:1786562538.669872:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e98825f800 x1873345652804096/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562538.669883:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825f800 with x1873345652804096 ext(4194304->5185535) 00002000:00010000:0.0:1786562538.669890:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825f800 00000100:00100000:1.0:1786562538.671105:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562538.679558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.682924:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654868736:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562538.682971:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562538.683687:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652804608 00000100:00100000:3.0:1786562538.683699:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652804608 00010000:00010000:3.0:1786562538.683756:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 518 pid: 34450 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562538.683803:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8654 00000100:00100000:3.0:1786562538.683816:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+518:2351:x1873345652804608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562538.683839:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562538.683848:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 518 pid: 34450 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.683864:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 518 pid: 34450 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.683900:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e000/0x5c655bf66689eefd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbe4 expref: 518 pid: 34450 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.683923:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562538.683928:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.683941:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.683950:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.683988:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562538.684113:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+517:2351:x1873345652804608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 299us (4570us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562538.684123:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8654 00010000:00010000:1.0:1786562538.684735:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.684752:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562538.684779:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562538.684985:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689ef3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.685038:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.685047:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562538.685050:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562538.685054:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880e00, rc 0) 00000100:00100000:1.0:1786562538.685114:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:64118:x1873345652804352:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 16170us (21732us total) trans 8589950646 rc 0/0 00000100:00100000:1.0:1786562538.685122:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17101 00000100:00100000:3.0:1786562538.685893:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.686465:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652804864 00000100:00100000:1.0:1786562538.686477:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652804864 00000100:00100000:1.0:1786562538.686549:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6276 00000100:00100000:1.0:1786562538.686559:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+517:64104:x1873345652804864:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1786562538.687031:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+518:64104:x1873345652804864:12345-192.168.204.29@tcp:35:cat.0 Request processed in 447us (1117us total) trans 8589950647 rc 0/0 00000100:00100000:1.0:1786562538.687040:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6276 00000100:00100000:0.0:1786562538.696045:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.696468:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652804992 00000100:00100000:3.0:1786562538.696482:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652804992 00002000:00100000:3.0:1786562538.696743:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9bf8ddc00 x1873345652804992/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562538.696757:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8ddc00 with x1873345652804992 ext(3145728->4194303) 00002000:00010000:3.0:1786562538.696765:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bf8ddc00 00000100:00100000:3.0:1786562538.696806:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11499 00000100:00100000:3.0:1786562538.696818:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652804992:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562538.724097:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652804992:12345-192.168.204.29@tcp:3:cat.0 Request processed in 27261us (28088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562538.724115:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11499 00002000:00100000:1.0:1786562538.724134:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9bf8ddc00 x1873345652804992/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.724146:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8ddc00 with x1873345652804992 ext(3145728->4194303) 00002000:00010000:1.0:1786562538.724154:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bf8ddc00 00000100:00100000:0.0:1786562538.775480:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.775603:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652805120 00000100:00100000:1.0:1786562538.775616:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652805120 00002000:00100000:1.0:1786562538.775695:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bf8dc380 x1873345652805120/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/0 e 0 to 0 dl 1786562549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.775707:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dc380 with x1873345652805120 ext(4194304->5185535) 00002000:00010000:1.0:1786562538.775715:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dc380 00000100:00100000:1.0:1786562538.775750:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11500 00000100:00100000:1.0:1786562538.775761:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652805120:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562538.794024:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654868992:0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794128:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562538.794181:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654869504:0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794212:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562538.794258:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786562538.794264:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654869120:0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794293:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562538.794312:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654869632:0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794332:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562538.794365:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654868992 00000100:00100000:2.0:1786562538.794374:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654868992 00000100:00100000:2.0:1786562538.794432:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1786562538.794442:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654868992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794503:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654868992:12345-0@lo:400:kworker.0 Request processed in 62us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.794511:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1786562538.794552:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654869504 00000100:00100000:2.0:1786562538.794556:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654869504 00000100:00100000:2.0:1786562538.794596:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1786562538.794602:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654869504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794638:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654869504:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.794645:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1786562538.794685:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654868992:0@lo:400:kworker.0 00000100:00100000:2.0:1786562538.794698:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876033 gen 2 00000004:00080000:2.0:1786562538.794703:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6300, transno 17179876007 00000004:00080000:2.0:1786562538.794713:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f7b80, transno 17179876008 00000004:00080000:2.0:1786562538.794716:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6a00, transno 17179876009 00000004:00080000:2.0:1786562538.794719:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4700, transno 17179876010 00000004:00080000:2.0:1786562538.794722:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f5f80, transno 17179876011 00000004:00080000:2.0:1786562538.794725:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f7480, transno 17179876012 00000004:00080000:2.0:1786562538.794728:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4000, transno 17179876013 00000004:00080000:2.0:1786562538.794731:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6680, transno 17179876014 00000004:00080000:2.0:1786562538.794734:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf05c00, transno 17179876015 00000004:00080000:2.0:1786562538.794736:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5e300, transno 17179876016 00000004:00080000:2.0:1786562538.794739:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5c700, transno 17179876017 00000004:00080000:2.0:1786562538.794742:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5df80, transno 17179876018 00000004:00080000:2.0:1786562538.794744:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5f480, transno 17179876019 00000004:00080000:2.0:1786562538.794747:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5ea00, transno 17179876020 00000004:00080000:2.0:1786562538.794749:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5c380, transno 17179876021 00000004:00080000:2.0:1786562538.794752:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88ac87b80, transno 17179876022 00000004:00080000:2.0:1786562538.794755:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5d180, transno 17179876023 00000004:00080000:2.0:1786562538.794758:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf5c000, transno 17179876024 00000004:00080000:2.0:1786562538.794760:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88be21880, transno 17179876025 00000004:00080000:2.0:1786562538.794762:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88be21c00, transno 17179876026 00000004:00080000:2.0:1786562538.794766:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88ac84a80, transno 17179876027 00000004:00080000:2.0:1786562538.794768:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88be20e00, transno 17179876028 00000004:00080000:2.0:1786562538.794771:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88be22300, transno 17179876029 00000004:00080000:2.0:1786562538.794774:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88be23100, transno 17179876030 00000004:00080000:2.0:1786562538.794776:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88be20700, transno 17179876031 00000004:00080000:2.0:1786562538.794779:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88ac84380, transno 17179876032 00000004:00080000:2.0:1786562538.794781:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fed80, transno 17179876033 00000100:00100000:2.0:1786562538.794786:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654869504:0@lo:400:kworker.0 00000004:00080000:2.0:1786562538.795509:0:33137:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 27 done 00000100:00100000:3.0:1786562538.797189:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654869120 00000100:00100000:3.0:1786562538.797201:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654869120 00000100:00100000:3.0:1786562538.797274:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654869632 00000100:00100000:3.0:1786562538.797279:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654869632 00000100:00100000:3.0:1786562538.797322:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1786562538.797333:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654869120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562538.797448:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654869120:12345-0@lo:400:kworker.0 Request processed in 118us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562538.797456:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1786562538.797473:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1786562538.797480:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654869632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562538.797509:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654869632:12345-0@lo:400:kworker.0 Request processed in 31us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562538.797515:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1786562538.797742:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654869120:0@lo:400:kworker.0 00000100:00100000:3.0:1786562538.797757:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654869632:0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.799151:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654868864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562538.799246:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562538.799299:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654869376:0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.799324:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562538.799350:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786562538.799357:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654869248:0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.799385:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562538.799405:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654869760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562538.799425:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786562538.799464:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562538.799472:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562538.799490:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654869376 00000100:00100000:1.0:1786562538.799498:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654869376 00000100:00100000:1.0:1786562538.799563:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1786562538.799571:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654869376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.799641:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654869376:12345-0@lo:400:kworker.0 Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.799648:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1786562538.799687:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654869248 00000100:00100000:1.0:1786562538.799691:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654869248 00000100:00100000:1.0:1786562538.799723:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786562538.799729:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654869248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.799761:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654869248:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.799767:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786562538.799790:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654868864 00000100:00100000:1.0:1786562538.799794:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654868864 00000100:00100000:1.0:1786562538.799814:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654869760 00000100:00100000:1.0:1786562538.799817:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654869760 00000100:00100000:1.0:1786562538.799832:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1786562538.799838:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654868864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562538.799875:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 628817920 pending 5111808 free 3828350976 avail 3826253824 00000100:00100000:1.0:1786562538.799911:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654868864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.799918:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1786562538.799930:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1786562538.799936:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654869760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562538.799962:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 523304960 pending 15335424 free 3829399552 avail 3827302400 00000100:00100000:1.0:1786562538.799989:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654869760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.799998:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:1.0:1786562538.800067:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562538.800071:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562538.800099:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654869248:0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.800121:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654869760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562538.800133:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654868864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562538.800141:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654869376:0@lo:400:kworker.0 00000100:00100000:1.0:1786562538.800396:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652805120:12345-192.168.204.29@tcp:3:cat.0 Request processed in 24634us (24927us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562538.800406:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11500 00002000:00100000:1.0:1786562538.800417:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bf8dc380 x1873345652805120/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:9/0 lens 488/440 e 0 to 0 dl 1786562549 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562538.800428:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dc380 with x1873345652805120 ext(4194304->5185535) 00002000:00010000:1.0:1786562538.800434:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bf8dc380 00000100:00100000:3.0:1786562538.890964:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.891111:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652805376 00000100:00100000:2.0:1786562538.891124:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652805376 00000100:00100000:2.0:1786562538.891194:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17102 00000100:00100000:2.0:1786562538.891205:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+518:64122:x1873345652805376:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562538.891249:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.891276:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ef51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc2a expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891372:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891389:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891402:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891417:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891431:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891438:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891875:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ef66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891887:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ef66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.891895:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ef66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562538.891906:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562538.892056:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892065:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892073:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892079:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562538.892084:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892093:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892107:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562538.892111:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562538.892115:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892127:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892142:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892147:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892155:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892160:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ee00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562538.892163:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892169:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892175:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d800) 00010000:00010000:2.0:1786562538.892177:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562538.892180:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892185:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892243:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ef51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc2a expref: 521 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892263:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ef66 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc2a expref: 520 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.892271:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562538.892274:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786562538.892277:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ea00, rc 0) 00000100:00100000:2.0:1786562538.892353:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+520:64122:x1873345652805376:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1149us (1402us total) trans 8589950648 rc 0/0 00000100:00100000:2.0:1786562538.892361:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17102 00000100:00100000:1.0:1786562538.900823:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562538.907168:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652805504 00000100:00100000:3.0:1786562538.907192:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652805504 00000100:00100000:3.0:1786562538.907328:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 968 00000100:00100000:3.0:1786562538.907341:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+520:2349:x1873345652805504:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562538.907362:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562538.907401:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ea00/0x5c655bf66689ef66 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc2a expref: 520 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562538.907439:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562538.907445:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562538.907537:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+519:2349:x1873345652805504:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 199us (6730us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562538.907546:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 968 00000100:00100000:3.0:1786562538.953479:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562538.954098:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652805632 00000100:00100000:2.0:1786562538.954112:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652805632 00000100:00100000:2.0:1786562538.954199:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17103 00000100:00100000:2.0:1786562538.954213:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:64123:x1873345652805632:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562538.954259:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562538.954286:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ef74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc31 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954382:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954401:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954417:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954435:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954444:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954451:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954880:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954896:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954905:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954954:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.954973:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 18 pid: 33115 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.954991:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654869888:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562538.955147:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f613900 going to sleep for 11 seconds 00000100:00100000:0.0:1786562538.980945:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654869888:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562538.980986:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562538.993646:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562538.994598:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652805760 00000100:00100000:1.0:1786562538.994617:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652805760 00010000:00010000:1.0:1786562538.994700:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 19 pid: 33115 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562538.994756:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8655 00000100:00100000:1.0:1786562538.994773:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:2350:x1873345652805760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562538.994797:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562538.994809:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 19 pid: 33115 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.994828:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 19 pid: 33115 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.995645:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689ef43 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc1c expref: 19 pid: 33115 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.996111:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562538.996119:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.996134:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.996143:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562538.996192:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562538.996288:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2350:x1873345652805760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1519us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562538.996311:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8655 00010000:00010000:2.0:1786562538.997123:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997136:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562538.997212:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:2.0:1786562538.997218:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562538.997258:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997276:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997291:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997307:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997316:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997323:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ee00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562538.997328:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997337:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997352:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562538.997356:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562538.997361:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997368:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689ef7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997389:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997396:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997401:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997406:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562538.997408:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997414:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997421:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d800) 00010000:00010000:2.0:1786562538.997424:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562538.997427:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997432:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689ef82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997477:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26fc00/0x5c655bf66689ef74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997494:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562538.997507:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562538.997509:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562538.997512:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e800, rc 0) 00000100:00100000:2.0:1786562538.997596:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64123:x1873345652805632:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 43386us (44131us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562538.997605:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17103 00000100:00100000:2.0:1786562539.018704:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.018741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.020603:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652805888 00000100:00100000:0.0:1786562539.020631:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652805888 00000100:00100000:0.0:1786562539.020719:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652806016 00000100:00100000:0.0:1786562539.020724:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652806016 00000100:00100000:0.0:1786562539.020756:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17680 00000100:00100000:0.0:1786562539.020770:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652805888:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562539.020798:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.021213:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc38 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.021265:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1786562539.021273:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562539.021288:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 12 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.021323:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 12 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.021342:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38800, rc 0) 00000100:00100000:0.0:1786562539.021466:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652805888:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 695us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.021480:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17680 00000100:00100000:0.0:1786562539.021525:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17681 00000100:00100000:0.0:1786562539.021539:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2350:x1873345652806016:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562539.021553:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.021571:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc3f expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.021633:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:0.0:1786562539.021638:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:0.0:1786562539.021648:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.021666:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 13 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.023099:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38c00, rc 0) 00000100:00100000:0.0:1786562539.023286:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652806016:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1746us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.023297:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17681 00000100:00100000:3.0:1786562539.024874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.027468:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652806144 00000100:00100000:0.0:1786562539.027491:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652806144 00000100:00100000:0.0:1786562539.027625:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17682 00000100:00100000:0.0:1786562539.027643:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652806144:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562539.027677:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.027707:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc46 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.027748:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562539.027755:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562539.027771:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 13 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.027800:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 13 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.027817:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38400, rc 0) 00000100:00100000:0.0:1786562539.028451:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652806144:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 810us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.028461:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17682 00000001:00080000:1.0:1786562539.028556:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876042 is committed 00000001:00080000:1.0:1786562539.028587:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876047 is committed 00000001:00080000:1.0:1786562539.028598:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876046 is committed 00000001:00080000:1.0:1786562539.028639:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876048 is committed 00000001:00080000:1.0:1786562539.028661:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876049 is committed 00000100:00100000:1.0:1786562539.048658:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.049214:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652806400 00000100:00100000:2.0:1786562539.049238:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652806400 00000100:00100000:2.0:1786562539.049326:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17104 00000100:00100000:2.0:1786562539.049339:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64123:x1873345652806400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562539.049369:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562539.049398:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689efa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc4d expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.049540:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.049560:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.049570:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.049642:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.049658:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 20 pid: 33114 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.049675:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654870016:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562539.049800:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f613a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.057513:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562539.058258:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652806528 00000100:00100000:3.0:1786562539.058274:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652806528 00010000:00010000:3.0:1786562539.058345:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 21 pid: 33114 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.058405:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8656 00000100:00100000:3.0:1786562539.058418:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:2350:x1873345652806528:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562539.058448:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562539.058457:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 21 pid: 33114 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.058473:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 21 pid: 33114 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.058512:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562539.058518:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.058530:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.058539:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.058563:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562539.058986:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e800/0x5c655bf66689ef89 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc31 expref: 21 pid: 33114 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562539.059040:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654870016:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562539.059070:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.059082:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.059088:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562539.059113:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562539.059348:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f200/0x5c655bf66689efa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc4d expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.059366:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc4d expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.059375:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.059378:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562539.059381:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ee00, rc 0) 00000100:00100000:3.0:1786562539.060018:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+21:2350:x1873345652806528:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1587us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562539.060031:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8656 00000100:00100000:1.0:1786562539.066568:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64123:x1873345652806400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 17209us (17904us total) trans 8589950649 rc 0/0 00000100:00100000:1.0:1786562539.066596:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17104 00000100:00100000:3.0:1786562539.080094:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562539.080345:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652806784 00000100:00100000:1.0:1786562539.080360:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652806784 00000100:00100000:1.0:1786562539.080469:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17105 00000100:00100000:1.0:1786562539.080483:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+519:64126:x1873345652806784:12345-192.168.204.29@tcp:101:cat.0 00000100:00080000:2.0:1786562539.080773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562539.080837:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562539.080865:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689efba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc54 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.080986:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.081036:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.081050:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.081069:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.081077:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.081084:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083095:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689efcf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083124:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689efcf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083138:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689efcf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562539.083155:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562539.083743:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083756:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083763:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083771:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562539.083777:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083785:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083802:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562539.083805:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562539.083811:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083818:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689efc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083850:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083857:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083863:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083885:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562539.083888:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083895:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083903:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2d00) 00010000:00010000:1.0:1786562539.083906:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562539.083909:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083916:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.083987:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689efba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc54 expref: 522 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.084063:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689efcf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc54 expref: 521 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.084074:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.084077:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562539.084080:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881400, rc 0) 00000100:00100000:1.0:1786562539.084188:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+521:64126:x1873345652806784:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3707us (4108us total) trans 8589950650 rc 0/0 00000100:00100000:1.0:1786562539.084201:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17105 00000100:00100000:3.0:1786562539.091968:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.096730:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807040 00000100:00100000:0.0:1786562539.096759:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807040 00000100:00100000:1.0:1786562539.104622:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17106 00000100:00100000:1.0:1786562539.104643:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64123:x1873345652807040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562539.104685:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562539.104689:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562539.104730:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26ee00/0x5c655bf66689efac lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc4d expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.104757:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.104763:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562539.104781:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689efdd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc5b expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.104941:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.104958:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.104971:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.104988:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.104996:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105081:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105089:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562539.105095:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105105:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105114:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.105117:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562539.105121:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105128:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689efe4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105166:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689efdd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc5b expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105177:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.105180:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562539.105184:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689efdd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc5b expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.105194:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880a00, rc 0) 00000100:00100000:1.0:1786562539.105312:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64123:x1873345652807040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 674us (13359us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562539.105321:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17106 00000100:00100000:3.0:1786562539.113718:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562539.113896:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807168 00000100:00100000:1.0:1786562539.113909:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807168 00000100:00100000:1.0:1786562539.114043:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 969 00000100:00100000:1.0:1786562539.114057:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+521:2351:x1873345652807168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562539.114082:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562539.114117:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689efcf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc54 expref: 521 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.114144:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.114151:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562539.114220:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+520:2351:x1873345652807168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 166us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562539.114239:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 969 00000100:00100000:3.0:1786562539.121166:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562539.125799:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807424 00000100:00100000:1.0:1786562539.125821:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807424 00000100:00100000:0.0:1786562539.132120:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6277 00000100:00100000:0.0:1786562539.132145:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:64123:x1873345652807424:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562539.132643:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+20:64123:x1873345652807424:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 505us (11490us total) trans 8589950651 rc 0/0 00000100:00100000:0.0:1786562539.132654:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6277 00000100:00100000:3.0:1786562539.188499:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.189758:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807552 00000100:00100000:0.0:1786562539.189776:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807552 00002000:00100000:0.0:1786562539.189887:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf5a680 x1873345652807552/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.189901:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5a680 with x1873345652807552 ext(2097152->3145727) 00002000:00010000:0.0:1786562539.189907:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5a680 00000100:00100000:0.0:1786562539.189952:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11501 00000100:00100000:0.0:1786562539.189967:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652807552:12345-192.168.204.29@tcp:3:cat.0 00000100:00080000:2.0:1786562539.193056:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562539.194257:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.194435:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807680 00000100:00100000:2.0:1786562539.194448:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807680 00002000:00100000:2.0:1786562539.194541:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5bb80 x1873345652807680/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.194555:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5bb80 with x1873345652807680 ext(3145728->4194303) 00002000:00010000:2.0:1786562539.194562:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5bb80 00000100:00100000:2.0:1786562539.194609:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11502 00000100:00100000:2.0:1786562539.194622:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652807680:12345-192.168.204.29@tcp:3:cat.0 00000100:00080000:1.0:1786562539.195354:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786562539.270786:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562539.274198:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652807680:12345-192.168.204.29@tcp:3:cat.0 Request processed in 79561us (79935us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562539.274217:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11502 00002000:00100000:2.0:1786562539.274243:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5bb80 x1873345652807680/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/440 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.274257:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5bb80 with x1873345652807680 ext(3145728->4194303) 00002000:00010000:2.0:1786562539.274266:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5bb80 00000100:00100000:2.0:1786562539.287622:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652807552:12345-192.168.204.29@tcp:3:cat.0 Request processed in 97643us (99125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562539.287640:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11501 00002000:00100000:2.0:1786562539.287658:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf5a680 x1873345652807552/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/440 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.287669:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5a680 with x1873345652807552 ext(2097152->3145727) 00002000:00010000:2.0:1786562539.287677:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5a680 00000100:00100000:3.0:1786562539.292402:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.293111:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807808 00000100:00100000:0.0:1786562539.293126:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807808 00000100:00100000:0.0:1786562539.293239:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17683 00000100:00100000:0.0:1786562539.293251:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64118:x1873345652807808:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562539.293275:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.293300:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc62 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.293619:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.293632:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.293642:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 16 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.293651:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562539.293657:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562539.293664:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [1769472->2097151] (req 1769472->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.293720:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 16 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.293736:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 16 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.293757:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654870144:192.168.204.29@tcp:104: 00000100:00080000:1.0:1786562539.294088:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786562539.294091:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.294103:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 12 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.294114:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654870272:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.294150:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.294160:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.294170:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884116a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654870400:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.294190:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562539.312272:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.312483:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654870144:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.312499:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654870272:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.312508:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884116a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654870400:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.312563:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [1769472->2097151] (req 1769472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.312598:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38e00, rc 0) 00000100:00100000:0.0:1786562539.312675:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:64118:x1873345652807808:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 19423us (20284us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.312687:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17683 00000100:00100000:1.0:1786562539.313480:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.314062:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.314165:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808064 00000100:00100000:2.0:1786562539.314176:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808064 00010000:00010000:2.0:1786562539.314232:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 17 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.314272:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652807936 00000100:00100000:2.0:1786562539.314275:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652807936 00010000:00010000:2.0:1786562539.314290:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.314322:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8657 00000100:00100000:2.0:1786562539.314334:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992131c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652808064:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562539.314356:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562539.314386:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 17 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.314400:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 17 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.314448:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000395a4ee5/0x5c655bf66689ebe6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca1d expref: 17 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.314470:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562539.314526:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992131c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652808064:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 194us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562539.314535:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8657 00000100:00100000:2.0:1786562539.314593:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8658 00000100:00100000:2.0:1786562539.314601:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652807936:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562539.314609:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562539.314619:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.314630:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.314644:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e389c32/0x5c655bf66689ecaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca8d expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.314655:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562539.314677:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652807936:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 78us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562539.314683:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8658 00000100:00100000:1.0:1786562539.315641:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808192 00000100:00100000:1.0:1786562539.315652:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808192 00010000:00010000:1.0:1786562539.315686:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562539.315729:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8659 00000100:00100000:1.0:1786562539.315738:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652808192:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562539.315749:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562539.315774:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.315788:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.315807:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aeb8895/0x5c655bf66689ebbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc9fa expref: 14 pid: 29662 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.315823:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562539.315827:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562539.315837:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.315849:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.315896:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562539.315912:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654870528:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562539.316040:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.320554:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.320661:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808320 00000100:00100000:0.0:1786562539.320674:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808320 00000100:00100000:0.0:1786562539.320883:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17684 00000100:00100000:0.0:1786562539.320896:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652808320:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.320921:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.320944:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d08ba2cb/0x5c655bf66689eff2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc69 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.321336:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654870656:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562539.321441:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562539.323302:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654870528:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562539.323335:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562539.323401:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652808192:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 7662us (9341us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562539.323414:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8659 00000100:00100000:3.0:1786562539.327746:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.327885:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808448 00000100:00100000:0.0:1786562539.327898:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808448 00002000:00100000:0.0:1786562539.327967:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1769472->1773567) req@ffff90e88bf5b800 x1873345652808448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.327980:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5b800 with x1873345652808448 ext(1769472->1773567) 00002000:00010000:0.0:1786562539.327987:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5b800 00000100:00100000:0.0:1786562539.328056:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11503 00000100:00100000:0.0:1786562539.328068:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652808448:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562539.329358:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652808448:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 1282us (1615us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562539.329372:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11503 00002000:00100000:0.0:1786562539.329383:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1769472->1773567) req@ffff90e88bf5b800 x1873345652808448/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/4536 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.329395:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5b800 with x1873345652808448 ext(1769472->1773567) 00002000:00010000:0.0:1786562539.329402:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5b800 00002000:00010000:1.0:1786562539.340879:0:29662:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562534 -> 1786562538 00002000:00010000:1.0:1786562539.340893:0:29662:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562533 -> 1786562538 00002000:00010000:1.0:1786562539.340896:0:29662:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562534 -> 1786562538 00000100:00100000:1.0:1786562539.340933:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654870656:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562539.340987:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d08ba2cb/0x5c655bf66689eff2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc69 expref: 17 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.341053:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d08ba2cb/0x5c655bf66689eff2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc69 expref: 17 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.341070:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38a00, rc 0) 00000100:00100000:1.0:1786562539.341155:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652808320:12345-192.168.204.29@tcp:101:cat.0 Request processed in 20261us (20616us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562539.341166:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17684 00000100:00100000:2.0:1786562539.362789:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.363574:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808576 00000100:00100000:0.0:1786562539.363590:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808576 00000100:00100000:0.0:1786562539.363697:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17685 00000100:00100000:0.0:1786562539.363710:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64118:x1873345652808576:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562539.363736:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.363762:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc70 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.363823:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.363836:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.363848:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 26 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562539.363851:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786562539.363861:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562539.363869:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562539.363876:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [1048576->1646591] (req 1048576->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 10 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.363926:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 26 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.363942:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 26 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.363964:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654870784:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.364124:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 12 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.364135:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 12 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.364146:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654870912:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.364197:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.364208:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.364228:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654871040:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.364254:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.366089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.367377:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808704 00000100:00100000:0.0:1786562539.367394:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808704 00000100:00100000:0.0:1786562539.367713:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17686 00000100:00100000:0.0:1786562539.367727:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652808704:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.367753:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.367779:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d08ba2cb/0x5c655bf66689f000 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc77 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.368331:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654871168:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562539.368913:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.386229:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.386268:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.386304:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809088 00000100:00100000:2.0:1786562539.386316:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809088 00010000:00010000:2.0:1786562539.386372:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 27 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.386410:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808832 00000100:00100000:2.0:1786562539.386427:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808832 00010000:00010000:2.0:1786562539.386443:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.386470:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8660 00000100:00100000:2.0:1786562539.386482:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652809088:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562539.386516:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562539.386551:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 27 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.386580:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 27 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.386732:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654870784:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.386745:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654870912:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.386755:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654871040:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562539.387873:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8661 00000100:00100000:1.0:1786562539.387896:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652808832:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562539.387914:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562539.393002:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 7 type: EXT [1048576->1646591] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 10 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.393054:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39200, rc 0) 00000100:00100000:0.0:1786562539.393170:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64118:x1873345652808576:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 29460us (30396us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.393181:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17685 00000100:00100000:3.0:1786562539.393474:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.394528:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652808960 00000100:00100000:0.0:1786562539.394542:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652808960 00010000:00010000:0.0:1786562539.394598:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.394659:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8662 00000100:00100000:0.0:1786562539.394670:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652808960:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562539.394688:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562539.394718:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.394733:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.394767:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689ebd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca01 expref: 10 pid: 29964 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.394789:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562539.395864:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654871168:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562539.395912:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d08ba2cb/0x5c655bf66689f000 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc77 expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.395935:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d08ba2cb/0x5c655bf66689f000 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc77 expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.395947:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38a00, rc 0) 00010000:00010000:2.0:1786562539.396038:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092350bfe/0x5c655bf66689ebed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca24 expref: 27 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.396056:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562539.396173:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652808960:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1503us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.396185:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8662 00010000:00010000:1.0:1786562539.398506:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.398537:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.398575:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1d1dbc4/0x5c655bf66689ecb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca94 expref: 13 pid: 29967 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.398599:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562539.398605:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562539.398616:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 8 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.398626:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 8 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.398835:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 8 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562539.398855:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654871296:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562539.402135:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652808704:12345-192.168.204.29@tcp:101:cat.0 Request processed in 34392us (36039us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562539.402154:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17686 00000100:00100000:1.0:1786562539.411934:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.413709:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+26:2351:x1873345652809088:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 27210us (27487us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562539.413731:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8660 00000100:00100000:0.0:1786562539.429710:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.429770:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.429990:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809472 00000100:00100000:2.0:1786562539.430020:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809472 00000100:00100000:2.0:1786562539.430092:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6278 00000100:00100000:2.0:1786562539.430105:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+520:64126:x1873345652809472:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:2.0:1786562539.430550:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+521:64126:x1873345652809472:12345-192.168.204.29@tcp:35:cat.0 Request processed in 444us (775us total) trans 8589950652 rc 0/0 00000100:00100000:2.0:1786562539.430574:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6278 00000100:00100000:3.0:1786562539.430999:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809216 00000100:00100000:3.0:1786562539.431050:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809216 00000100:00100000:3.0:1786562539.431111:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17687 00000100:00100000:3.0:1786562539.431122:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+26:64122:x1873345652809216:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562539.431141:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562539.431170:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc7e expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431210:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431234:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 12 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431251:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 27 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431260:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:3.0:1786562539.431265:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:3.0:1786562539.431272:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431319:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 27 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431336:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 27 pid: 29966 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.431354:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654871424:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562539.431450:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 12 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431461:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 12 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.431472:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654871552:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562539.431524:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.431536:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 8 pid: 6659 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.431546:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654871680:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562539.431583:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562539.432120:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654871296:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562539.432147:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562539.432183:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652808832:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 44298us (45915us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562539.432194:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8661 00000100:00100000:0.0:1786562539.439259:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562539.443114:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809600 00000100:00100000:3.0:1786562539.443136:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809600 00002000:00100000:3.0:1786562539.443226:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1642496->1646591) req@ffff90e884115500 x1873345652809600/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562539.443240:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884115500 with x1873345652809600 ext(1642496->1646591) 00002000:00010000:3.0:1786562539.443248:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884115500 00000100:00100000:3.0:1786562539.443297:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11504 00000100:00100000:3.0:1786562539.443309:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652809600:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562539.443906:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652809600:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 596us (4661us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562539.443916:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11504 00002000:00100000:3.0:1786562539.443924:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x713:0x0] (1642496->1646591) req@ffff90e884115500 x1873345652809600/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/4536 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562539.443933:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884115500 with x1873345652809600 ext(1642496->1646591) 00002000:00010000:3.0:1786562539.443937:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e884115500 00000100:00100000:3.0:1786562539.448850:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654871424:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.458179:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.458233:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.458326:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.458363:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809728 00000100:00100000:0.0:1786562539.458374:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809728 00010000:00010000:0.0:1786562539.458436:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 12 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.458478:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809856 00000100:00100000:0.0:1786562539.458492:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809856 00010000:00010000:0.0:1786562539.458508:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 9 pid: 6659 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.458526:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652809984 00000100:00100000:0.0:1786562539.458528:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652809984 00010000:00010000:0.0:1786562539.458542:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 28 pid: 29966 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562539.458724:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8663 00000100:00100000:1.0:1786562539.458739:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652809728:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562539.458758:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562539.458913:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 12 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.458928:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 12 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.458966:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562539.459069:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652809728:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 334us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562539.459077:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8663 00000100:00100000:1.0:1786562539.459103:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8664 00000100:00100000:1.0:1786562539.459110:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e992130850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652809856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562539.459118:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562539.459127:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 9 pid: 6659 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459138:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 9 pid: 6659 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459153:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562539.459175:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e992130850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652809856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 66us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562539.459181:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8664 00000100:00100000:1.0:1786562539.459245:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8665 00000100:00100000:1.0:1786562539.459253:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652809984:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562539.459261:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562539.459270:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 28 pid: 29966 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459287:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 28 pid: 29966 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459300:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689ef2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc15 expref: 28 pid: 29966 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459316:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:1.0:1786562539.459321:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(10 8) 00010000:00010000:1.0:1786562539.459330:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459341:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.459383:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562539.459400:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654871808:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562539.459457:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983317780 going to sleep for 11 seconds 00010000:00010000:3.0:1786562539.469760:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057c3353c/0x5c655bf66689ef97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc3f expref: 11 pid: 6658 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.469795:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654871552:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562539.470110:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562539.470245:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652810240 00000100:00100000:1.0:1786562539.470255:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652810240 00000100:00100000:1.0:1786562539.470349:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6279 00000100:00100000:1.0:1786562539.470360:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:64118:x1873345652810240:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562539.470729:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:64118:x1873345652810240:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 369us (619us total) trans 8589950653 rc 0/0 00000100:00100000:1.0:1786562539.470739:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6279 00000100:00080000:2.0:1786562539.471031:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562539.471348:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf66689ef27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc0e expref: 8 pid: 6659 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.471369:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29965:1873345654871680:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562539.471415:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 27 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.471433:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a7000, rc 0) 00000100:00100000:2.0:1786562539.471470:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+27:64122:x1873345652809216:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 40350us (41775us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562539.471478:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17687 00000100:00100000:1.0:1786562539.491313:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562539.492140:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8413:1873345654871808:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562539.492173:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562539.492355:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:2351:x1873345652809984:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 33100us (34026us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562539.492370:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8665 00000100:00100000:0.0:1786562539.492557:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652810368 00000100:00100000:0.0:1786562539.492566:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652810368 00002000:00100000:0.0:1786562539.492846:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (3809280->3813375) req@ffff90e88317a300 x1873345652810368/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.492858:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317a300 with x1873345652810368 ext(3809280->3813375) 00002000:00010000:0.0:1786562539.492864:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88317a300 00000100:00100000:0.0:1786562539.492893:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11505 00000100:00100000:0.0:1786562539.492904:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652810368:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562539.493171:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652810368:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 268us (1872us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562539.499059:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11505 00002000:00100000:0.0:1786562539.499089:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (3809280->3813375) req@ffff90e88317a300 x1873345652810368/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/4536 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.499102:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88317a300 with x1873345652810368 ext(3809280->3813375) 00002000:00010000:0.0:1786562539.499109:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88317a300 00000100:00100000:1.0:1786562539.507294:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.507541:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652810496 00000100:00100000:0.0:1786562539.507556:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652810496 00000100:00100000:0.0:1786562539.507716:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17688 00000100:00100000:0.0:1786562539.507730:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+16:64122:x1873345652810496:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:0.0:1786562539.507759:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.507785:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc85 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.507841:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.507854:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 11 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.507864:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 12 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.507874:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562539.507880:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562539.507886:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [3145728->3624959] (req 3145728->3624959) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 17 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.507945:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 12 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.507964:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 12 pid: 29662 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.507984:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654871936:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.508140:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 11 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.508151:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 11 pid: 28862 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.508162:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654872064:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.508197:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.508207:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.508228:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654872192:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.508254:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562539.518393:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562539.518512:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562539.518879:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654871936:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562539.518896:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654872064:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562539.518906:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654872192:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562539.518963:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [3145728->3624959] (req 3145728->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 17 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.518991:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39e00, rc 0) 00000100:00100000:1.0:1786562539.519111:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+17:64122:x1873345652810496:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 11385us (11833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562539.519122:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17688 00000100:00100000:0.0:1786562539.519736:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652810624 00000100:00100000:0.0:1786562539.519746:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652810624 00010000:00010000:0.0:1786562539.519788:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 12 pid: 28862 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.519840:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652810752 00000100:00100000:0.0:1786562539.519844:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652810752 00010000:00010000:0.0:1786562539.519860:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 13 pid: 29662 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.519893:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8666 00000100:00100000:0.0:1786562539.519905:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652810624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562539.519924:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562539.519956:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 12 pid: 28862 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.519969:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 12 pid: 28862 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.519999:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff7e28a2/0x5c655bf66689ef9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc46 expref: 12 pid: 28862 timeout: 1071 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.520041:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562539.520087:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652810624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 184us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.520095:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8666 00000100:00100000:0.0:1786562539.520114:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8667 00000100:00100000:0.0:1786562539.520123:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652810752:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562539.520132:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562539.520142:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 13 pid: 29662 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.520154:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 13 pid: 29662 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.520169:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689ef35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc23 expref: 13 pid: 29662 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.520180:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562539.520202:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652810752:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 79us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.520208:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8667 00000100:00100000:3.0:1786562539.527891:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.528070:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652810880 00000100:00100000:0.0:1786562539.528084:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652810880 00010000:00010000:0.0:1786562539.528136:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.528187:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8668 00000100:00100000:0.0:1786562539.528200:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652810880:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562539.528233:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562539.528265:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.528287:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.528317:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689ef20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc07 expref: 17 pid: 6660 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.528340:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562539.528345:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1786562539.528355:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.528367:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.528433:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.528452:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654872320:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562539.528574:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562539.536972:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654872320:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562539.537061:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562539.537130:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:2350:x1873345652810880:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 8931us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562539.537143:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8668 00000100:00100000:1.0:1786562539.563300:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.563425:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652811008 00000100:00100000:0.0:1786562539.563439:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652811008 00002000:00100000:0.0:1786562539.563514:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3620864->3624959) req@ffff90e884116a00 x1873345652811008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.563527:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884116a00 with x1873345652811008 ext(3620864->3624959) 00002000:00010000:0.0:1786562539.563536:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884116a00 00000100:00100000:0.0:1786562539.563576:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11506 00000100:00100000:0.0:1786562539.563603:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652811008:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562539.563890:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652811008:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 303us (605us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562539.563899:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11506 00002000:00100000:0.0:1786562539.563906:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x730:0x0] (3620864->3624959) req@ffff90e884116a00 x1873345652811008/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/4536 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562539.563915:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e884116a00 with x1873345652811008 ext(3620864->3624959) 00002000:00010000:0.0:1786562539.563919:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e884116a00 00000100:00100000:0.0:1786562539.572355:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.573448:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652811264 00000100:00100000:2.0:1786562539.573464:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652811264 00000100:00100000:2.0:1786562539.573691:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6280 00000100:00100000:2.0:1786562539.573707:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf871050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+521:64122:x1873345652811264:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:2.0:1786562539.574105:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf871050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+522:64122:x1873345652811264:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 400us (1764us total) trans 8589950654 rc 0/0 00000100:00100000:2.0:1786562539.574114:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6280 00000100:00100000:3.0:1786562539.582748:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562539.582790:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.582992:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652811392 00000100:00100000:0.0:1786562539.583055:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652811392 00000100:00100000:0.0:1786562539.583119:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652811520 00000100:00100000:0.0:1786562539.583122:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652811520 00000100:00100000:0.0:1786562539.583153:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17689 00000100:00100000:0.0:1786562539.583164:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652811392:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.583189:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.583223:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff7e28a2/0x5c655bf66689f015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc8c expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.583313:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654872448:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562539.583422:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562539.583446:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17690 00000100:00100000:0.0:1786562539.583453:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652811520:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.583463:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.583474:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000931b48b6/0x5c655bf66689f01c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc93 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.583513:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654872576:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562539.583536:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00002000:00010000:0.0:1786562539.591998:0:6660:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime: 1786562537 -> 1786562538 00002000:00010000:0.0:1786562539.592041:0:6660:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime: 1786562535 -> 1786562538 00002000:00010000:0.0:1786562539.592043:0:6660:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime: 1786562537 -> 1786562538 00000100:00100000:0.0:1786562539.592077:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654872448:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562539.592131:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff7e28a2/0x5c655bf66689f015 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc8c expref: 9 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.592162:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff7e28a2/0x5c655bf66689f015 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc8c expref: 9 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.592178:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38400, rc 0) 00002000:00010000:1.0:1786562539.592475:0:28862:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562537 -> 1786562538 00002000:00010000:1.0:1786562539.592488:0:28862:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562537 -> 1786562538 00002000:00010000:1.0:1786562539.592490:0:28862:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562537 -> 1786562538 00000100:00100000:1.0:1786562539.592505:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654872576:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562539.592527:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000931b48b6/0x5c655bf66689f01c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc93 expref: 13 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.592542:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000931b48b6/0x5c655bf66689f01c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc93 expref: 13 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.592557:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38600, rc 0) 00000100:00100000:1.0:1786562539.592975:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652811520:12345-192.168.204.29@tcp:101:cat.0 Request processed in 9518us (10180us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562539.592987:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17690 00000100:00100000:0.0:1786562539.593440:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2351:x1873345652811392:12345-192.168.204.29@tcp:101:cat.0 Request processed in 10275us (10701us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562539.593448:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17689 00000100:00100000:0.0:1786562539.640468:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.640541:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.640710:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652811648 00000100:00100000:2.0:1786562539.640724:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652811648 00002000:00100000:2.0:1786562539.640790:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1769471) req@ffff90e98553e680 x1873345652811648/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.640802:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553e680 with x1873345652811648 ext(1048576->1769471) 00002000:00010000:2.0:1786562539.640819:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553e680 00000100:00100000:2.0:1786562539.640851:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652811776 00000100:00100000:2.0:1786562539.640854:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652811776 00002000:00100000:2.0:1786562539.640873:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x713:0x0] (1646592->2097151) req@ffff90e98553dc00 x1873345652811776/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.640882:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553dc00 with x1873345652811776 ext(1646592->2097151) 00002000:00010000:2.0:1786562539.640885:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98553dc00 00000100:00100000:2.0:1786562539.640909:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11507 00000100:00100000:2.0:1786562539.640919:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652811648:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562539.641574:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11508 00000100:00100000:2.0:1786562539.641585:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652811776:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562539.666582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.668428:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812032 00000100:00100000:2.0:1786562539.668451:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812032 00000100:00100000:2.0:1786562539.668568:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17107 00000100:00100000:2.0:1786562539.668582:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+19:64139:x1873345652812032:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562539.669062:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562539.669092:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f000/0x5c655bf66689f023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcc9a expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.669943:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.669968:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.669986:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562539.670000:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562539.670197:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f000/0x5c655bf66689f023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.670236:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 21 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.670246:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562539.670250:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786562539.670255:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e200, rc 0) 00000100:00100000:2.0:1786562539.670335:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+21:64139:x1873345652812032:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 1755us (3767us total) trans 8589950655 rc 0/0 00000100:00100000:2.0:1786562539.670344:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17107 00000100:00100000:2.0:1786562539.670485:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2350:x1873345652811776:12345-192.168.204.29@tcp:3:cat.0 Request processed in 28901us (29943us total) trans 0 rc 450560/450560 00000100:00100000:2.0:1786562539.670499:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11508 00002000:00100000:2.0:1786562539.670510:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x713:0x0] (1646592->2097151) req@ffff90e98553dc00 x1873345652811776/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/440 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.670521:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553dc00 with x1873345652811776 ext(1646592->2097151) 00002000:00010000:2.0:1786562539.670527:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98553dc00 00000100:00100000:2.0:1786562539.670631:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652811648:12345-192.168.204.29@tcp:3:cat.0 Request processed in 29713us (30179us total) trans 0 rc 720896/720896 00000100:00100000:2.0:1786562539.670638:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11507 00002000:00100000:2.0:1786562539.670644:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1769471) req@ffff90e98553e680 x1873345652811648/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/440 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.670653:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553e680 with x1873345652811648 ext(1048576->1769471) 00002000:00010000:2.0:1786562539.670656:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553e680 00000100:00100000:1.0:1786562539.725081:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.731225:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812160 00000100:00100000:2.0:1786562539.731250:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812160 00000100:00100000:2.0:1786562539.731399:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17691 00000100:00100000:2.0:1786562539.731413:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:64136:x1873345652812160:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562539.731438:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562539.731465:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcca1 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.731511:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 25 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.731533:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=1s v=(10 8) 00010000:00010000:2.0:1786562539.731539:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 10) 00010000:00010000:2.0:1786562539.731545:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.731595:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 25 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.731612:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 25 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562539.731631:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654872704:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562539.731752:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.788577:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.788752:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.788906:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812288 00000100:00100000:2.0:1786562539.788918:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812288 00002000:00100000:2.0:1786562539.789000:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3809280->4194303) req@ffff90e88bf5dc00 x1873345652812288/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.789061:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5dc00 with x1873345652812288 ext(3809280->4194303) 00010000:00010000:2.0:1786562539.789075:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 26 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.789096:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 26 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562539.789106:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf5dc00 00000100:00100000:2.0:1786562539.789135:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5972 00000100:00100000:2.0:1786562539.789147:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652812288:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:3.0:1786562539.789844:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654872704:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562539.789888:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.789910:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f000, rc 0) 00000100:00100000:3.0:1786562539.789952:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:64136:x1873345652812160:12345-192.168.204.29@tcp:101:cat.0 Request processed in 58541us (64948us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562539.789964:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17691 00000100:00100000:0.0:1786562539.791720:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812544 00000100:00100000:0.0:1786562539.791741:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812544 00000100:00100000:0.0:1786562539.792104:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17108 00000100:00100000:0.0:1786562539.792120:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+522:64142:x1873345652812544:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.792159:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.792202:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39c00/0x5c655bf66689f03f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcca8 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792333:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792351:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792364:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792380:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792388:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792395:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792964:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39400/0x5c655bf66689f054 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792979:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39400/0x5c655bf66689f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.792989:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39400/0x5c655bf66689f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562539.793039:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:0.0:1786562539.793158:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793167:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793175:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793182:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bfe38400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562539.793187:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793196:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793227:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562539.793231:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562539.793237:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793245:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38400/0x5c655bf66689f046 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793261:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793267:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793273:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793283:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bfe38600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562539.793287:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793294:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793301:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db600) 00010000:00010000:0.0:1786562539.793304:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562539.793306:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793313:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe38600/0x5c655bf66689f04d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793376:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39c00/0x5c655bf66689f03f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca8 expref: 525 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793391:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39400/0x5c655bf66689f054 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca8 expref: 524 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.793399:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562539.793402:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786562539.793405:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39400, rc 0) 00000100:00100000:0.0:1786562539.793488:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+524:64142:x1873345652812544:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1372us (4926us total) trans 8589950656 rc 0/0 00000100:00100000:0.0:1786562539.793498:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17108 00000100:00100000:0.0:1786562539.809998:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.810065:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.810104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.810139:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812672 00000100:00100000:0.0:1786562539.810150:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812672 00000100:00100000:0.0:1786562539.810228:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812800 00000100:00100000:0.0:1786562539.810232:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812800 00000100:00100000:0.0:1786562539.810251:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813056 00000100:00100000:0.0:1786562539.810254:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813056 00000100:00100000:0.0:1786562539.810276:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17692 00000100:00100000:0.0:1786562539.810288:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652812672:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.810332:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.810358:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f062 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccaf expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.810437:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654872832:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562539.810538:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562539.810563:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17693 00000100:00100000:0.0:1786562539.810571:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652812800:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.810580:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.810592:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000950187ba/0x5c655bf66689f069 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccb6 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.810625:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654872960:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562539.810650:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562539.812608:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17694 00000100:00100000:3.0:1786562539.812638:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652813056:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562539.812660:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562539.812679:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f070 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccbd expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.812745:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654873088:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562539.812868:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f840 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.816504:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.816558:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.816598:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652812928 00000100:00100000:2.0:1786562539.816611:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652812928 00000100:00100000:2.0:1786562539.816687:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 970 00000100:00100000:2.0:1786562539.816700:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+524:2351:x1873345652812928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562539.816722:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562539.817926:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39400/0x5c655bf66689f054 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca8 expref: 524 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.817962:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562539.817968:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562539.818433:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+523:2351:x1873345652812928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1731us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562539.818445:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 970 00000100:00100000:3.0:1786562539.835130:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813184 00000100:00100000:3.0:1786562539.835151:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813184 00000100:00100000:3.0:1786562539.835243:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17695 00000100:00100000:3.0:1786562539.835257:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652813184:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562539.835283:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562539.837330:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f077 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccc4 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.837454:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654873216:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562539.837852:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f480 going to sleep for 11 seconds 00002000:00010000:0.0:1786562539.850216:0:29967:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562538 -> 1786562539 00002000:00010000:0.0:1786562539.850229:0:29967:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562538 -> 1786562539 00002000:00010000:0.0:1786562539.850232:0:29967:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562538 -> 1786562539 00000100:00100000:0.0:1786562539.850269:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654872832:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562539.850327:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f062 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccaf expref: 19 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.850359:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f062 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccaf expref: 19 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.850373:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39600, rc 0) 00000100:00100000:0.0:1786562539.850451:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652812672:12345-192.168.204.29@tcp:101:cat.0 Request processed in 40165us (40469us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562539.850462:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17692 00002000:00010000:0.0:1786562539.850854:0:29964:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime: 1786562531 -> 1786562539 00002000:00010000:0.0:1786562539.850858:0:29964:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime: 1786562525 -> 1786562539 00002000:00010000:0.0:1786562539.850861:0:29964:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime: 1786562531 -> 1786562539 00000100:00100000:0.0:1786562539.850879:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654872960:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562539.850901:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000950187ba/0x5c655bf66689f069 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccb6 expref: 32 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.850917:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000950187ba/0x5c655bf66689f069 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccb6 expref: 32 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.850928:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39000, rc 0) 00000100:00100000:0.0:1786562539.850953:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652812800:12345-192.168.204.29@tcp:101:cat.0 Request processed in 40384us (40888us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562539.850961:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17693 00000100:00100000:0.0:1786562539.855196:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654873088:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562539.855260:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f070 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccbd expref: 30 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.855292:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f070 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccbd expref: 30 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.855314:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d800, rc 0) 00000100:00100000:0.0:1786562539.855624:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:2348:x1873345652813056:12345-192.168.204.29@tcp:101:cat.0 Request processed in 42781us (45299us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562539.855637:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17694 00000100:00100000:3.0:1786562539.859091:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652812288:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 69925us (70317us total) trans 17179876050 rc 0/0 00000100:00100000:3.0:1786562539.859112:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5972 00002000:00100000:3.0:1786562539.859135:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (3809280->4194303) req@ffff90e88bf5dc00 x1873345652812288/t17179876050(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:10/0 lens 488/448 e 0 to 0 dl 1786562550 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562539.859154:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5dc00 with x1873345652812288 ext(3809280->4194303) 00010000:00010000:3.0:1786562539.859169:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 28 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.859218:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 28 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562539.859229:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf5dc00 00000100:00100000:0.0:1786562539.869425:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654873216:192.168.204.29@tcp:106: 00010000:00010000:0.0:1786562539.869678:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f077 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccc4 expref: 17 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.869710:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f077 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccc4 expref: 17 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.869726:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d400, rc 0) 00000100:00100000:0.0:1786562539.870142:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652813184:12345-192.168.204.29@tcp:101:cat.0 Request processed in 34887us (53662us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562539.870152:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17695 00000100:00100000:2.0:1786562539.897804:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562539.903996:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813312 00000100:00100000:3.0:1786562539.904034:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813312 00010000:00010000:3.0:1786562539.904098:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 28 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.904168:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8669 00000100:00100000:3.0:1786562539.904182:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652813312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562539.904203:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562539.904248:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 28 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.904265:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 28 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.904308:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f007 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [3809280->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc7e expref: 28 pid: 29965 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.904338:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 10) 00010000:00010000:3.0:1786562539.904350:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 10) 00010000:00010000:3.0:1786562539.904360:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 8 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.904375:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 8 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562539.904433:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 8 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562539.904452:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654873344:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562539.906063:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562539.933084:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654873344:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562539.933127:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562539.933233:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652813312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 29052us (35443us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562539.933248:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8669 00000100:00100000:2.0:1786562539.942933:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.942995:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.943131:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813568 00000100:00100000:0.0:1786562539.943144:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813568 00000100:00100000:0.0:1786562539.943230:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17696 00000100:00100000:0.0:1786562539.943246:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+16:64142:x1873345652813568:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562539.943272:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562539.943297:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcccb expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.943341:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.943352:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562539.943357:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562539.943362:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 17 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.943418:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 11 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.943435:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 11 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.943453:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654873472:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562539.943731:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562539.948152:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813440 00000100:00100000:3.0:1786562539.948175:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813440 00002000:00100000:3.0:1786562539.948273:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5fb80 x1873345652813440/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562539.948287:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5fb80 with x1873345652813440 ext(3145728->4194303) 00002000:00010000:3.0:1786562539.948294:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5fb80 00000100:00100000:3.0:1786562539.948442:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11509 00000100:00100000:3.0:1786562539.948454:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652813440:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562539.950837:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562539.950954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562539.951193:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813952 00000100:00100000:2.0:1786562539.951219:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813952 00002000:00100000:2.0:1786562539.951289:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72f:0x0] (1769472->2097151) req@ffff90e98553d500 x1873345652813952/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/0 e 0 to 0 dl 1786562550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562539.951303:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553d500 with x1873345652813952 ext(1769472->2097151) 00010000:00010000:2.0:1786562539.951315:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 12 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562539.951336:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 12 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562539.951345:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e98553d500 00000100:00100000:2.0:1786562539.951388:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5973 00000100:00100000:2.0:1786562539.951399:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2350:x1873345652813952:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562539.952330:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652813824 00000100:00100000:1.0:1786562539.952342:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652813824 00000100:00100000:1.0:1786562539.952413:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17109 00000100:00100000:1.0:1786562539.952423:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+523:64145:x1873345652813824:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562539.952449:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562539.952485:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689f085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccd2 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.952695:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.952713:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.952726:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.952743:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.952751:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.952759:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953272:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689f09a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953284:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689f09a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953293:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689f09a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562539.953306:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562539.953433:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953441:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953449:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953455:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562539.953460:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953468:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953497:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562539.953500:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562539.953507:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.953513:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0400/0x5c655bf66689f08c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562539.954332:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654873472:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562539.954379:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 17 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562539.954415:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39600, rc 0) 00000100:00100000:0.0:1786562539.954514:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+17:64142:x1873345652813568:12345-192.168.204.29@tcp:101:cat.0 Request processed in 11269us (11518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562539.954533:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17696 00010000:00010000:1.0:1786562539.958741:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958769:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958779:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958787:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9aefc0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562539.958793:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958802:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958826:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2d00) 00010000:00010000:1.0:1786562539.958830:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562539.958835:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958841:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0000/0x5c655bf66689f093 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958944:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0c00/0x5c655bf66689f085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd2 expref: 526 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958971:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689f09a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd2 expref: 525 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.958980:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562539.958983:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562539.958986:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988267e00, rc 0) 00000100:00100000:1.0:1786562539.959130:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+525:64145:x1873345652813824:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 6706us (8306us total) trans 8589950657 rc 0/0 00000100:00100000:1.0:1786562539.959142:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17109 00000100:00100000:3.0:1786562539.987149:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2351:x1873345652813440:12345-192.168.204.29@tcp:3:cat.0 Request processed in 38677us (44617us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562539.987171:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11509 00002000:00100000:3.0:1786562539.987195:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5fb80 x1873345652813440/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/440 e 0 to 0 dl 1786562550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562539.987219:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5fb80 with x1873345652813440 ext(3145728->4194303) 00002000:00010000:3.0:1786562539.987228:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5fb80 00000100:00100000:1.0:1786562539.988324:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652813952:12345-192.168.204.29@tcp:4:cat.0 Request processed in 36916us (37360us total) trans 21474843570 rc 0/0 00000100:00100000:1.0:1786562539.988338:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5973 00002000:00100000:1.0:1786562539.988351:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x72f:0x0] (1769472->2097151) req@ffff90e98553d500 x1873345652813952/t21474843570(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:10/0 lens 488/448 e 0 to 0 dl 1786562550 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562539.988361:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553d500 with x1873345652813952 ext(1769472->2097151) 00010000:00010000:1.0:1786562539.988374:0:29460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562539.988396:0:29460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562539.990696:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e98553d500 00000100:00100000:0.0:1786562540.004672:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562540.004780:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814080 00000100:00100000:3.0:1786562540.004793:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814080 00000100:00100000:3.0:1786562540.004889:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 971 00000100:00100000:3.0:1786562540.004901:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+525:2350:x1873345652814080:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562540.004924:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562540.004960:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267e00/0x5c655bf66689f09a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd2 expref: 525 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.004989:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562540.004995:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562540.005305:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+524:2350:x1873345652814080:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 405us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562540.005314:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 971 00000100:00100000:2.0:1786562540.009445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.010775:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814208 00000100:00100000:0.0:1786562540.010794:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814208 00010000:00010000:0.0:1786562540.010856:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562540.010913:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8670 00000100:00100000:0.0:1786562540.010926:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652814208:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562540.010947:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562540.010977:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.010995:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.011046:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689efeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc62 expref: 14 pid: 29966 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.011070:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562540.011075:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562540.011087:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 16 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.011098:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 16 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.011146:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 16 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562540.011164:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654873600:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562540.011290:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562540.022294:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654873600:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562540.022334:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562540.022416:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652814208:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11491us (12984us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562540.022429:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8670 00000100:00100000:3.0:1786562540.022886:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.023115:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814336 00000100:00100000:0.0:1786562540.023136:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814336 00000100:00100000:0.0:1786562540.023200:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17697 00000100:00100000:0.0:1786562540.023219:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64136:x1873345652814336:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562540.023246:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562540.023271:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccd9 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.023313:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.023330:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=1s v=(6 0) 00010000:00010000:0.0:1786562540.023335:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:0.0:1786562540.023341:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.023384:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 16 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.023407:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 16 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562540.023426:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654873728:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562540.023510:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562540.033656:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.033939:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814464 00000100:00100000:0.0:1786562540.033954:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814464 00002000:00100000:0.0:1786562540.034071:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88bf59180 x1873345652814464/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562540.034085:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf59180 with x1873345652814464 ext(1048576->2097151) 00002000:00010000:0.0:1786562540.034093:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf59180 00000100:00100000:0.0:1786562540.034139:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11510 00000100:00100000:0.0:1786562540.034151:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652814464:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562540.040638:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.043476:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654873728:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562540.043535:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 14 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.043565:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38e00, rc 0) 00000100:00100000:1.0:1786562540.043737:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:64136:x1873345652814336:12345-192.168.204.29@tcp:101:cat.0 Request processed in 20518us (20849us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.043749:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17697 00000100:00100000:2.0:1786562540.045217:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814592 00000100:00100000:2.0:1786562540.045234:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814592 00002000:00100000:2.0:1786562540.045325:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3624959) req@ffff90e88bf58a80 x1873345652814592/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.047059:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58a80 with x1873345652814592 ext(3145728->3624959) 00010000:00010000:2.0:1786562540.047086:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.047115:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562540.047130:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88bf58a80 00000100:00100000:2.0:1786562540.047215:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5974 00000100:00100000:2.0:1786562540.047240:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652814592:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562540.085811:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652814464:12345-192.168.204.29@tcp:3:cat.0 Request processed in 51645us (52153us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562540.085842:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11510 00002000:00100000:0.0:1786562540.085860:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e88bf59180 x1873345652814464/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562540.085872:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf59180 with x1873345652814464 ext(1048576->2097151) 00002000:00010000:0.0:1786562540.085880:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf59180 00000100:00100000:0.0:1786562540.114945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.117045:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814720 00000100:00100000:1.0:1786562540.117068:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814720 00000100:00100000:1.0:1786562540.117180:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17698 00000100:00100000:1.0:1786562540.117198:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+27:64142:x1873345652814720:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562540.117244:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562540.117273:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcce0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.117316:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 8 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.117328:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x713:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786562540.117334:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562540.117340:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 4/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 28 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.117388:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 8 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.117410:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 8 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.117428:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654873856:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562540.117544:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b300 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.126495:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654873856:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562540.126548:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 3/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 28 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.126579:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988266200, rc 0) 00000100:00100000:2.0:1786562540.126661:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:64142:x1873345652814720:12345-192.168.204.29@tcp:101:cat.0 Request processed in 9469us (11733us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562540.126672:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17698 00000100:00100000:0.0:1786562540.127661:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652814592:12345-192.168.204.29@tcp:4:cat.0 Request processed in 80422us (87028us total) trans 21474843571 rc 0/0 00000100:00100000:0.0:1786562540.127680:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5974 00002000:00100000:0.0:1786562540.127698:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (3145728->3624959) req@ffff90e88bf58a80 x1873345652814592/t21474843571(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/448 e 0 to 0 dl 1786562551 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562540.127714:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58a80 with x1873345652814592 ext(3145728->3624959) 00010000:00010000:0.0:1786562540.127733:0:14369:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.127757:0:14369:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562540.127768:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88bf58a80 00000100:00100000:0.0:1786562540.138274:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.138647:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814848 00000100:00100000:2.0:1786562540.138661:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814848 00002000:00100000:2.0:1786562540.138730:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x713:0x0] (1048576->1646591) req@ffff90e98553ea00 x1873345652814848/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.138743:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553ea00 with x1873345652814848 ext(1048576->1646591) 00010000:00010000:2.0:1786562540.138755:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 9 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.138773:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 9 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562540.138781:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98553ea00 00000100:00100000:2.0:1786562540.138824:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5975 00000100:00100000:2.0:1786562540.138835:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+9:2349:x1873345652814848:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562540.149844:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.151589:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652814848:12345-192.168.204.29@tcp:4:cat.0 Request processed in 12740us (13317us total) trans 17179876051 rc 0/0 00000100:00100000:2.0:1786562540.151609:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5975 00002000:00100000:2.0:1786562540.151631:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x713:0x0] (1048576->1646591) req@ffff90e98553ea00 x1873345652814848/t17179876051(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/448 e 0 to 0 dl 1786562551 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.151646:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553ea00 with x1873345652814848 ext(1048576->1646591) 00010000:00010000:2.0:1786562540.151665:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 11 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.151684:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 11 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562540.151696:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98553ea00 00000100:00100000:1.0:1786562540.160265:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652814976 00000100:00100000:1.0:1786562540.160290:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652814976 00010000:00010000:1.0:1786562540.160362:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.160430:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8671 00000100:00100000:1.0:1786562540.160442:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652814976:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.160463:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786562540.161115:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.161218:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815104 00000100:00100000:2.0:1786562540.161225:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815104 00010000:00010000:2.0:1786562540.161258:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 11 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.161296:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8672 00000100:00100000:2.0:1786562540.161306:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652815104:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562540.161319:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562540.161349:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 11 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.161371:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 11 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.161411:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046060880/0x5c655bf66689eff9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc70 expref: 11 pid: 29967 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.161445:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562540.161450:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562540.161460:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 27 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.161479:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 27 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.161530:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 27 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.161548:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654873984:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562540.162095:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00002000:00010000:1.0:1786562540.163488:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562538 -> 1786562539 00010000:00010000:1.0:1786562540.163510:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.163531:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.163558:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076a593a9/0x5c655bf66689f00e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc85 expref: 19 pid: 37002 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.163784:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.163790:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.163799:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 13 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.163811:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 13 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.163871:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 13 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.163889:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654874112:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562540.163989:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99827b300 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.173335:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654873984:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562540.173373:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562540.173475:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652815104:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12160us (12353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562540.173490:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8672 00000100:00100000:0.0:1786562540.175952:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654874112:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562540.175997:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562540.176099:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652814976:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 15658us (26271us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562540.176113:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8671 00000100:00100000:3.0:1786562540.194214:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.195947:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815232 00000100:00100000:1.0:1786562540.195968:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815232 00002000:00100000:1.0:1786562540.196102:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf58e00 x1873345652815232/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.196116:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58e00 with x1873345652815232 ext(1048576->2097151) 00002000:00010000:1.0:1786562540.196125:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf58e00 00000100:00100000:1.0:1786562540.196164:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11511 00000100:00100000:1.0:1786562540.196188:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652815232:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562540.200794:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562540.200991:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815360 00000100:00100000:3.0:1786562540.201023:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815360 00002000:00100000:3.0:1786562540.201100:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf5e300 x1873345652815360/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.201120:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5e300 with x1873345652815360 ext(3145728->4194303) 00002000:00010000:3.0:1786562540.201127:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5e300 00000100:00100000:3.0:1786562540.201158:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11512 00000100:00100000:3.0:1786562540.201169:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652815360:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562540.235370:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652815232:12345-192.168.204.29@tcp:3:cat.0 Request processed in 39178us (41171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562540.235390:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11511 00002000:00100000:3.0:1786562540.235408:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e88bf58e00 x1873345652815232/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.235420:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58e00 with x1873345652815232 ext(1048576->2097151) 00002000:00010000:3.0:1786562540.235427:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf58e00 00000100:00100000:1.0:1786562540.260895:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652815360:12345-192.168.204.29@tcp:3:cat.0 Request processed in 59708us (60095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562540.260917:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11512 00002000:00100000:1.0:1786562540.260937:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf5e300 x1873345652815360/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.260951:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5e300 with x1873345652815360 ext(3145728->4194303) 00002000:00010000:1.0:1786562540.260961:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5e300 00000100:00100000:3.0:1786562540.272239:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.272785:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815488 00000100:00100000:1.0:1786562540.272800:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815488 00000100:00100000:1.0:1786562540.272884:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17699 00000100:00100000:1.0:1786562540.272897:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:64142:x1873345652815488:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562540.272923:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562540.272950:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcce7 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.272990:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.272996:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.276998:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 19 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.277098:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 19 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.277123:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988267000, rc 0) 00000100:00100000:0.0:1786562540.277962:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:64142:x1873345652815488:12345-192.168.204.29@tcp:101:cat.0 Request processed in 5059us (5734us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562540.277978:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17699 00000100:00100000:0.0:1786562540.286803:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.287073:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815616 00000100:00100000:2.0:1786562540.287087:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815616 00000100:00100000:2.0:1786562540.287164:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17700 00000100:00100000:2.0:1786562540.287189:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2351:x1873345652815616:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562540.287223:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562540.287246:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccee expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.287280:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562540.287285:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562540.287297:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.287315:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.287335:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99cd81400, rc 0) 00000100:00100000:2.0:1786562540.288501:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652815616:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1317us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562540.288514:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17700 00000100:00100000:3.0:1786562540.298936:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.299477:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815744 00000100:00100000:0.0:1786562540.299493:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815744 00000100:00100000:0.0:1786562540.299574:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17701 00000100:00100000:0.0:1786562540.299764:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652815744:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562540.299792:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562540.299819:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccf5 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.299853:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562540.299858:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562540.299870:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.299888:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.299903:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22400, rc 0) 00000100:00100000:0.0:1786562540.299964:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652815744:12345-192.168.204.29@tcp:101:cat.0 Request processed in 207us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562540.306093:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17701 00000100:00100000:0.0:1786562540.309326:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.309691:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652815872 00000100:00100000:2.0:1786562540.309968:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652815872 00002000:00100000:2.0:1786562540.310123:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e98553f480 x1873345652815872/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.310138:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553f480 with x1873345652815872 ext(2097152->3145727) 00002000:00010000:2.0:1786562540.310148:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553f480 00000100:00100000:2.0:1786562540.310368:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11513 00000100:00100000:2.0:1786562540.310388:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652815872:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562540.320178:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.320478:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816000 00000100:00100000:0.0:1786562540.320492:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816000 00002000:00100000:0.0:1786562540.320565:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88bf5ca80 x1873345652816000/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562540.320586:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ca80 with x1873345652816000 ext(4194304->5185535) 00002000:00010000:0.0:1786562540.320595:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5ca80 00000100:00100000:0.0:1786562540.320633:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11514 00000100:00100000:0.0:1786562540.320648:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652816000:12345-192.168.204.29@tcp:3:cat.0 00010000:00010000:1.0:1786562540.326519:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562540.360972:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652815872:12345-192.168.204.29@tcp:3:cat.0 Request processed in 50569us (51639us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562540.360994:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11513 00002000:00100000:3.0:1786562540.361059:0:16203:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e98553f480 x1873345652815872/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.361073:0:16203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553f480 with x1873345652815872 ext(2097152->3145727) 00002000:00010000:3.0:1786562540.361082:0:16203:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553f480 00000100:00100000:3.0:1786562540.364262:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652816000:12345-192.168.204.29@tcp:3:cat.0 Request processed in 43598us (44084us total) trans 0 rc 991232/991232 00000100:00100000:3.0:1786562540.364286:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11514 00002000:00100000:3.0:1786562540.364304:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88bf5ca80 x1873345652816000/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.364317:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ca80 with x1873345652816000 ext(4194304->5185535) 00002000:00010000:3.0:1786562540.364326:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5ca80 00000100:00100000:2.0:1786562540.411867:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.412175:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816128 00000100:00100000:0.0:1786562540.412189:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816128 00000100:00100000:0.0:1786562540.412271:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17702 00000100:00100000:0.0:1786562540.412284:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+28:64142:x1873345652816128:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562540.412308:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562540.412334:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfccfc expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.412373:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 10) 00010000:00010000:0.0:1786562540.412379:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(1 10) 00010000:00010000:0.0:1786562540.412390:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.412422:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.412439:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f22e00, rc 0) 00000100:00100000:0.0:1786562540.412524:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:64142:x1873345652816128:12345-192.168.204.29@tcp:101:cat.0 Request processed in 242us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562540.412532:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17702 00000001:00080000:1.0:1786562540.450188:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950656 is committed 00000001:00080000:1.0:1786562540.450225:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950651 is committed 00000001:00080000:1.0:1786562540.450243:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950627 is committed 00000001:00080000:1.0:1786562540.450268:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950657 is committed 00000001:00080000:1.0:1786562540.450275:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950653 is committed 00000001:00080000:1.0:1786562540.450331:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950655 is committed 00000100:00100000:2.0:1786562540.462907:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.463121:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562540.470384:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816256 00000100:00100000:3.0:1786562540.472645:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816256 00002000:00100000:1.0:1786562540.473125:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5f480 x1873345652816256/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.473143:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5f480 with x1873345652816256 ext(3145728->4194303) 00002000:00010000:1.0:1786562540.473152:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5f480 00000100:00100000:1.0:1786562540.473215:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816384 00000100:00100000:1.0:1786562540.473222:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816384 00002000:00100000:1.0:1786562540.473256:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf5c700 x1873345652816384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.473265:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5c700 with x1873345652816384 ext(3145728->4194303) 00002000:00010000:1.0:1786562540.473270:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5c700 00000100:00100000:1.0:1786562540.473294:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11515 00000100:00100000:1.0:1786562540.473308:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652816256:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562540.473591:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11516 00000100:00100000:2.0:1786562540.473603:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652816384:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562540.503292:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652816384:12345-192.168.204.29@tcp:3:cat.0 Request processed in 29672us (40150us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562540.503313:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11516 00002000:00100000:1.0:1786562540.503332:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88bf5c700 x1873345652816384/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.503346:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5c700 with x1873345652816384 ext(3145728->4194303) 00002000:00010000:1.0:1786562540.503354:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5c700 00000100:00100000:1.0:1786562540.510844:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652816256:12345-192.168.204.29@tcp:3:cat.0 Request processed in 37520us (47934us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562540.510871:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11515 00002000:00100000:1.0:1786562540.510894:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5f480 x1873345652816256/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.510908:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5f480 with x1873345652816256 ext(3145728->4194303) 00002000:00010000:1.0:1786562540.510918:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5f480 00000100:00100000:2.0:1786562540.539543:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.539905:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816512 00000100:00100000:1.0:1786562540.539918:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816512 00002000:00100000:1.0:1786562540.539994:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88bf5c380 x1873345652816512/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.540055:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5c380 with x1873345652816512 ext(4194304->5185535) 00002000:00010000:1.0:1786562540.540063:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5c380 00000100:00100000:1.0:1786562540.540094:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11517 00000100:00100000:1.0:1786562540.540104:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652816512:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562540.571532:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:2350:x1873345652816512:12345-192.168.204.29@tcp:3:cat.0 Request processed in 31411us (31987us total) trans 0 rc 991232/991232 00000100:00100000:0.0:1786562540.571551:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11517 00002000:00100000:0.0:1786562540.571569:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e88bf5c380 x1873345652816512/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562540.571595:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5c380 with x1873345652816512 ext(4194304->5185535) 00002000:00010000:0.0:1786562540.571603:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5c380 00000100:00100000:3.0:1786562540.615836:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.616171:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816640 00000100:00100000:2.0:1786562540.616184:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816640 00000100:00100000:2.0:1786562540.616276:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17703 00000100:00100000:2.0:1786562540.616289:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64147:x1873345652816640:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562540.616316:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562540.616346:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd03 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.616403:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.616416:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 18 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.616425:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(1 6) 00010000:00010000:2.0:1786562540.616431:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:2.0:1786562540.616437:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [4186112->4194303] (req 4186112->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.616484:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 18 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.616501:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 18 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.616518:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654874240:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562540.616867:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.616879:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.616890:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654874368:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562540.616919:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.618901:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.624836:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652816896 00000100:00100000:1.0:1786562540.624857:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652816896 00000100:00100000:1.0:1786562540.624950:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6281 00000100:00100000:1.0:1786562540.624962:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+503:64142:x1873345652816896:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1786562540.626786:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+504:64142:x1873345652816896:12345-192.168.204.29@tcp:35:cat.0 Request processed in 1811us (7884us total) trans 8589950658 rc 0/0 00000100:00100000:1.0:1786562540.626804:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6281 00000100:00100000:3.0:1786562540.634946:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654874240:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562540.634968:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654874368:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562540.635061:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [4186112->4194303] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.635089:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0400, rc 0) 00000100:00100000:3.0:1786562540.635189:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64147:x1873345652816640:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 18903us (19369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562540.635211:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17703 00000100:00100000:3.0:1786562540.640509:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562540.644991:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.663862:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817024 00000100:00100000:2.0:1786562540.663885:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817024 00010000:00010000:2.0:1786562540.663977:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.664081:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817152 00000100:00100000:2.0:1786562540.664087:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817152 00010000:00010000:2.0:1786562540.664108:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 19 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.664146:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8673 00000100:00100000:2.0:1786562540.664159:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652817024:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562540.664182:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562540.664229:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.664246:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.664281:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea029f6/0x5c655bf66689f0a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccd9 expref: 16 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.664306:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562540.664406:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652817024:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (23915us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.664625:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8674 00000100:00100000:1.0:1786562540.664639:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652817152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.664654:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562540.664669:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 19 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.664681:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 19 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.664697:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f0b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce7 expref: 19 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.664711:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.664717:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.664728:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 15 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.664752:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 15 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.664805:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 15 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.664825:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654874496:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562540.664899:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.665240:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8673 00000100:00100000:0.0:1786562540.679432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.679522:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.679765:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654874496:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562540.679797:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562540.679871:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652817152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 15236us (34896us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.679889:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8674 00000100:00100000:3.0:1786562540.680947:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817408 00000100:00100000:3.0:1786562540.680963:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817408 00000100:00100000:3.0:1786562540.681076:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17704 00000100:00100000:3.0:1786562540.681088:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652817408:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562540.681113:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562540.681138:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f0d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd0a expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562540.681238:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654874624:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562540.681341:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.687988:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817280 00000100:00100000:2.0:1786562540.688030:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817280 00002000:00100000:2.0:1786562540.688105:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (4186112->4190207) req@ffff90e98553ca80 x1873345652817280/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.688118:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553ca80 with x1873345652817280 ext(4186112->4190207) 00002000:00010000:2.0:1786562540.688126:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553ca80 00000100:00100000:2.0:1786562540.688164:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11518 00000100:00100000:2.0:1786562540.688174:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652817280:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562540.688449:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2348:x1873345652817280:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 275us (9031us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562540.688458:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11518 00002000:00100000:2.0:1786562540.688466:0:14369:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x730:0x0] (4186112->4190207) req@ffff90e98553ca80 x1873345652817280/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/4536 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.688475:0:14369:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553ca80 with x1873345652817280 ext(4186112->4190207) 00002000:00010000:2.0:1786562540.688478:0:14369:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553ca80 00000100:00100000:0.0:1786562540.695159:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.695385:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817536 00000100:00100000:2.0:1786562540.695399:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817536 00000100:00100000:2.0:1786562540.695489:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17705 00000100:00100000:2.0:1786562540.695502:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:64145:x1873345652817536:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562540.695528:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562540.695555:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd11 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.695837:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.695848:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 30 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562540.695855:0:6660:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562538 -> 1786562539 00010000:00010000:2.0:1786562540.695856:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562540.695860:0:6660:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562538 -> 1786562539 00010000:00010000:2.0:1786562540.695870:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.695877:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000400:0x714:0x0].0x0 since=1s v=(1 10) 00010000:00010000:2.0:1786562540.695882:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00000100:00100000:3.0:1786562540.695884:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654874624:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562540.695888:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2801664->3145727] (req 2801664->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.695925:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f0d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd0a expref: 16 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.695929:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.695945:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 10 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.695946:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f0d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd0a expref: 16 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.695963:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654874752:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562540.695964:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880e00, rc 0) 00000100:00100000:3.0:1786562540.696070:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652817408:12345-192.168.204.29@tcp:101:cat.0 Request processed in 14985us (16547us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562540.696079:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17704 00010000:00010000:2.0:1786562540.701902:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.701928:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.701947:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654874880:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562540.701963:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.702044:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817664 00000100:00100000:1.0:1786562540.702053:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817664 00000100:00100000:1.0:1786562540.702123:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17706 00000100:00100000:1.0:1786562540.702134:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64147:x1873345652817664:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562540.702152:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562540.702171:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd18 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.702224:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.702230:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.702237:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4194304->5103615] (req 4194304->5103615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 12 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.702249:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [4194304->5103615] (req 4194304->5103615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 12 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.702264:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00010000:00010000:2.0:1786562540.702363:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 30 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.702374:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 30 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.702384:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654875008:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562540.709118:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64147:x1873345652817664:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 6965us (7134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.709352:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17706 00010000:00010000:2.0:1786562540.709860:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 11 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.709885:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 11 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.709905:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654875136:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562540.709960:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562540.715515:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.715564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.715837:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817920 00000100:00100000:1.0:1786562540.715850:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817920 00010000:00010000:1.0:1786562540.715907:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 12 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.715962:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652817792 00000100:00100000:1.0:1786562540.715965:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652817792 00010000:00010000:1.0:1786562540.715979:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 31 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.716001:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8675 00000100:00100000:1.0:1786562540.716044:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652817920:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.716065:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562540.716098:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 12 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.716115:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 12 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.716154:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562540.716233:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652817920:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 191us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.716242:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8675 00000100:00100000:1.0:1786562540.716263:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8676 00000100:00100000:1.0:1786562540.716280:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652817792:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.716289:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562540.716298:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 31 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.716313:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 31 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.716326:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562540.716342:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652817792:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 74us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.716349:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8676 00010000:00010000:2.0:1786562540.716953:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b383da/0x5c655bf66689edec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb51 expref: 11 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.716976:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654874752:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562540.716992:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a98e5223/0x5c655bf66689ec8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfca78 expref: 30 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.717001:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654874880:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562540.717079:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654875008:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562540.733845:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345654875136:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562540.733912:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [2801664->3145727] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 29 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.733939:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9aefc0c00, rc 0) 00000100:00100000:2.0:1786562540.734063:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:64145:x1873345652817536:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 38563us (38920us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562540.734075:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17705 00000100:00100000:3.0:1786562540.735513:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.735742:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818176 00000100:00100000:1.0:1786562540.735760:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818176 00010000:00010000:1.0:1786562540.735829:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 11 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.735894:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8677 00000100:00100000:1.0:1786562540.735909:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2350:x1873345652818176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.735930:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562540.735967:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 11 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.735983:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 11 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.736066:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f038 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcca1 expref: 11 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.736100:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562540.736178:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2350:x1873345652818176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 271us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.736188:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8677 00000100:00100000:0.0:1786562540.744746:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.744919:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818048 00000100:00100000:1.0:1786562540.744934:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818048 00010000:00010000:1.0:1786562540.744991:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 29 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.745239:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8678 00000100:00100000:1.0:1786562540.745252:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652818048:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.745275:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562540.745311:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 29 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745331:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 29 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745363:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a70ccd3/0x5c655bf66689f0cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccfc expref: 29 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745384:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.745389:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.745399:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 28 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745411:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 28 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745422:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.745424:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.745430:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745437:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.745482:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.745500:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654875264:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562540.750179:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 28 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.750230:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654875392:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562540.750315:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562540.756798:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654875264:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562540.756820:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654875392:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562540.756852:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562540.756937:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652818048:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11686us (12207us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.756952:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8678 00000100:00100000:3.0:1786562540.757924:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.759252:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818304 00000100:00100000:2.0:1786562540.759268:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818304 00002000:00100000:2.0:1786562540.759347:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2801664->2805759) req@ffff90e88b7ea680 x1873345652818304/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.759360:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ea680 with x1873345652818304 ext(2801664->2805759) 00002000:00010000:2.0:1786562540.759367:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7ea680 00000100:00100000:2.0:1786562540.759472:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11519 00000100:00100000:2.0:1786562540.759482:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652818304:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:2.0:1786562540.759811:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652818304:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 329us (1893us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562540.759821:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11519 00002000:00100000:2.0:1786562540.759829:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (2801664->2805759) req@ffff90e88b7ea680 x1873345652818304/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/4536 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.759838:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b7ea680 with x1873345652818304 ext(2801664->2805759) 00002000:00010000:2.0:1786562540.759841:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b7ea680 00000100:00100000:0.0:1786562540.774175:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.774671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.774782:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818432 00000100:00100000:2.0:1786562540.774795:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818432 00002000:00100000:2.0:1786562540.774863:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e9b42f6300 x1873345652818432/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.774875:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f6300 with x1873345652818432 ext(1048576->2097151) 00002000:00010000:2.0:1786562540.774881:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b42f6300 00000100:00100000:2.0:1786562540.774909:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818560 00000100:00100000:2.0:1786562540.774912:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818560 00002000:00100000:2.0:1786562540.774929:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9b42f7b80 x1873345652818560/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.774937:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f7b80 with x1873345652818560 ext(1048576->2097151) 00002000:00010000:2.0:1786562540.774941:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b42f7b80 00000100:00100000:2.0:1786562540.774973:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11520 00000100:00100000:2.0:1786562540.774983:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652818432:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562540.775737:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11521 00000100:00100000:0.0:1786562540.775751:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652818560:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562540.780332:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.781805:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818688 00000100:00100000:1.0:1786562540.781825:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818688 00000100:00100000:1.0:1786562540.783339:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17707 00000100:00100000:1.0:1786562540.783363:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+18:64145:x1873345652818688:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:1.0:1786562540.783391:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562540.783426:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd1f expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.783472:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.783483:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(1 6) 00010000:00010000:1.0:1786562540.783489:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 6) 00010000:00010000:1.0:1786562540.783496:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->2740223] (req 2097152->2740223) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.783544:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.783561:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 16 pid: 29964 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.784785:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654875520:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562540.784925:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562540.791740:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.796906:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818816 00000100:00100000:2.0:1786562540.796929:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818816 00002000:00100000:2.0:1786562540.797062:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (5099520->5103615) req@ffff90e9bfb5c700 x1873345652818816/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.797076:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5c700 with x1873345652818816 ext(5099520->5103615) 00002000:00010000:2.0:1786562540.797084:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfb5c700 00000100:00100000:2.0:1786562540.797131:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11522 00000100:00100000:2.0:1786562540.797143:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652818816:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562540.798632:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652818816:12345-192.168.204.29@tcp:3:cat.0 Request processed in 1476us (6894us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562540.798650:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11522 00002000:00100000:2.0:1786562540.798665:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (5099520->5103615) req@ffff90e9bfb5c700 x1873345652818816/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/4536 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.798678:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5c700 with x1873345652818816 ext(5099520->5103615) 00002000:00010000:2.0:1786562540.798685:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfb5c700 00000100:00100000:1.0:1786562540.800898:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654875520:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562540.800953:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->2740223] (req 2097152->2740223) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.800985:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39a00, rc 0) 00000100:00100000:1.0:1786562540.801096:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+19:64145:x1873345652818688:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 17742us (20779us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.801107:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17707 00000100:00100000:3.0:1786562540.801659:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652818432:12345-192.168.204.29@tcp:3:cat.0 Request processed in 26674us (27497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562540.801670:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11520 00002000:00100000:3.0:1786562540.801685:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->2097151) req@ffff90e9b42f6300 x1873345652818432/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.801695:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f6300 with x1873345652818432 ext(1048576->2097151) 00002000:00010000:3.0:1786562540.801702:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b42f6300 00000100:00100000:3.0:1786562540.803871:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652818560:12345-192.168.204.29@tcp:3:cat.0 Request processed in 28108us (29185us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562540.803888:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11521 00002000:00100000:3.0:1786562540.803903:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x713:0x0] (1048576->2097151) req@ffff90e9b42f7b80 x1873345652818560/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.803915:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f7b80 with x1873345652818560 ext(1048576->2097151) 00002000:00010000:3.0:1786562540.803922:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b42f7b80 00000100:00100000:1.0:1786562540.833851:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.833992:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652818944 00000100:00100000:0.0:1786562540.834047:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652818944 00010000:00010000:0.0:1786562540.834103:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 15 pid: 29964 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562540.834158:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8679 00000100:00100000:0.0:1786562540.834170:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2350:x1873345652818944:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562540.834205:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562540.834234:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 15 pid: 29964 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.834250:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 15 pid: 29964 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.834279:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689ef12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbf9 expref: 15 pid: 29964 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.834302:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 6) 00010000:00010000:0.0:1786562540.834307:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 6) 00010000:00010000:0.0:1786562540.834317:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.834329:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.834380:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 18 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562540.834798:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654875648:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562540.834996:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562540.844082:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654875648:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562540.844118:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562540.844205:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652818944:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10036us (10369us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562540.844219:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8679 00000100:00100000:0.0:1786562540.854839:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.856273:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652819072 00000100:00100000:1.0:1786562540.856294:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652819072 00000100:00100000:1.0:1786562540.856377:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17708 00000100:00100000:1.0:1786562540.856390:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:64153:x1873345652819072:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562540.856426:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562540.856452:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd26 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.856495:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.856506:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(3 10) 00010000:00010000:1.0:1786562540.856511:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 10) 00010000:00010000:1.0:1786562540.856516:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.856581:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 27 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.856597:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 27 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.856614:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654875776:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562540.856732:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562540.861391:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562540.861539:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652819200 00000100:00100000:3.0:1786562540.861553:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652819200 00002000:00100000:3.0:1786562540.861641:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (2736128->2740223) req@ffff90e9887ee680 x1873345652819200/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.861653:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ee680 with x1873345652819200 ext(2736128->2740223) 00002000:00010000:3.0:1786562540.861660:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887ee680 00000100:00100000:3.0:1786562540.861703:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11523 00000100:00100000:3.0:1786562540.861716:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652819200:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562540.861994:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652819200:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 280us (618us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562540.862028:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11523 00002000:00100000:3.0:1786562540.862036:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x730:0x0] (2736128->2740223) req@ffff90e9887ee680 x1873345652819200/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/4536 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562540.862053:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ee680 with x1873345652819200 ext(2736128->2740223) 00002000:00010000:3.0:1786562540.862056:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9887ee680 00000100:00100000:2.0:1786562540.867244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.867374:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652819328 00000100:00100000:0.0:1786562540.867387:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652819328 00002000:00100000:0.0:1786562540.867469:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2801664->3145727) req@ffff90e88bf5d180 x1873345652819328/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562540.867482:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5d180 with x1873345652819328 ext(2801664->3145727) 00010000:00010000:0.0:1786562540.867495:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 28 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562540.867518:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 28 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562540.867527:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf5d180 00000100:00100000:0.0:1786562540.867580:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5976 00000100:00100000:0.0:1786562540.867593:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2348:x1873345652819328:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:1.0:1786562540.868341:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654875776:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562540.868385:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.868420:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39c00, rc 0) 00000100:00100000:1.0:1786562540.868464:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64153:x1873345652819072:12345-192.168.204.29@tcp:101:cat.0 Request processed in 12077us (13639us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.868473:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17708 00000100:00100000:0.0:1786562540.869657:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.869807:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652819584 00000100:00100000:1.0:1786562540.869819:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652819584 00000100:00100000:1.0:1786562540.869885:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6282 00000100:00100000:1.0:1786562540.869897:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+504:64145:x1873345652819584:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:1.0:1786562540.870366:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+505:64145:x1873345652819584:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 470us (716us total) trans 8589950659 rc 0/0 00000100:00100000:1.0:1786562540.870379:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6282 00000100:00100000:1.0:1786562540.884206:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652819328:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 16585us (16951us total) trans 17179876052 rc 0/0 00000100:00100000:1.0:1786562540.884224:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5976 00002000:00100000:1.0:1786562540.884242:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x714:0x0] (2801664->3145727) req@ffff90e88bf5d180 x1873345652819328/t17179876052(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/448 e 0 to 0 dl 1786562551 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.884252:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5d180 with x1873345652819328 ext(2801664->3145727) 00010000:00010000:1.0:1786562540.884274:0:13913:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.884299:0:13913:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562540.884308:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf5d180 00000100:00100000:0.0:1786562540.897928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.899861:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652819712 00000100:00100000:1.0:1786562540.899880:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652819712 00010000:00010000:1.0:1786562540.899946:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.900020:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8680 00000100:00100000:1.0:1786562540.900034:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652819712:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562540.900055:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562540.900087:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562538 -> 1786562540 00002000:00010000:1.0:1786562540.900091:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562538 -> 1786562540 00010000:00010000:1.0:1786562540.900100:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.900115:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.900146:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a337de6/0x5c655bf66689f0e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2801664->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd11 expref: 30 pid: 28861 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.900167:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 10) 00010000:00010000:1.0:1786562540.900172:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 10) 00010000:00010000:1.0:1786562540.900183:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.900207:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.900259:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562540.900277:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654875904:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562540.902689:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562540.927089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562540.927851:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654875904:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562540.927886:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562540.927970:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652819712:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 27939us (30058us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562540.927988:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8680 00000100:00100000:2.0:1786562540.928184:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652819840 00000100:00100000:2.0:1786562540.928204:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652819840 00002000:00100000:2.0:1786562540.928266:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e9b42f7480 x1873345652819840/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.928279:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f7480 with x1873345652819840 ext(2097152->3145727) 00002000:00010000:2.0:1786562540.928285:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b42f7480 00000100:00100000:2.0:1786562540.928325:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11524 00000100:00100000:2.0:1786562540.928336:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652819840:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562540.942768:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562540.946614:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820096 00000100:00100000:3.0:1786562540.946636:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820096 00000100:00100000:3.0:1786562540.946738:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17110 00000100:00100000:3.0:1786562540.946752:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+505:64158:x1873345652820096:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562540.946792:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562540.946823:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689f0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd2d expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.947129:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.947148:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.947168:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.947200:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.947210:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.947217:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949151:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880600/0x5c655bf66689f111 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949183:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880600/0x5c655bf66689f111 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949213:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880600/0x5c655bf66689f111 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562540.949228:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:3.0:1786562540.949369:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949378:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949385:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949391:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562540.949396:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949404:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949419:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562540.949422:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562540.949427:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949434:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880e00/0x5c655bf66689f103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949456:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949463:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949469:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949474:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562540.949476:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949483:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949491:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b46ab100) 00010000:00010000:3.0:1786562540.949493:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562540.949497:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.949503:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f10a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.952454:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881800/0x5c655bf66689f0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd2d expref: 508 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.952522:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880600/0x5c655bf66689f111 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd2d expref: 507 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.952541:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562540.952545:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562540.952549:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880600, rc 0) 00000100:00100000:1.0:1786562540.957714:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652819840:12345-192.168.204.29@tcp:3:cat.0 Request processed in 29362us (30623us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562540.957733:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11524 00002000:00100000:1.0:1786562540.957748:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e9b42f7480 x1873345652819840/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:11/0 lens 488/440 e 0 to 0 dl 1786562551 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562540.957761:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f7480 with x1873345652819840 ext(2097152->3145727) 00002000:00010000:1.0:1786562540.957770:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b42f7480 00000100:00100000:2.0:1786562540.964688:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+507:64158:x1873345652820096:12345-192.168.204.29@tcp:101:cat.0 Request processed in 17921us (21917us total) trans 8589950660 rc 0/0 00000100:00100000:2.0:1786562540.964706:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17110 00000100:00100000:0.0:1786562540.974897:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.975067:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820352 00000100:00100000:2.0:1786562540.975081:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820352 00000100:00100000:2.0:1786562540.975233:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 972 00000100:00100000:2.0:1786562540.975246:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+507:2350:x1873345652820352:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562540.975272:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562540.975308:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880600/0x5c655bf66689f111 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd2d expref: 507 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.975336:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562540.975343:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562540.975427:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+506:2350:x1873345652820352:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 184us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562540.975436:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 972 00000100:00100000:0.0:1786562540.982121:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.982173:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562540.982229:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.982317:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820224 00000100:00100000:2.0:1786562540.982331:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820224 00000100:00100000:2.0:1786562540.982400:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820480 00000100:00100000:2.0:1786562540.982404:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820480 00000100:00100000:2.0:1786562540.982430:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820608 00000100:00100000:2.0:1786562540.982434:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820608 00000100:00100000:2.0:1786562540.982459:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17709 00000100:00100000:2.0:1786562540.982471:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:64153:x1873345652820224:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562540.982496:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562540.982523:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd3b expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.982580:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.982592:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(2 6) 00010000:00010000:2.0:1786562540.982598:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 6) 00010000:00010000:2.0:1786562540.982604:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 15 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.982650:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.982667:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.982687:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654876032:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562540.982787:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.982813:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17710 00000100:00100000:2.0:1786562540.982820:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652820480:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562540.982830:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562540.982842:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf66689f126 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd34 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.982880:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654876160:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562540.982907:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562540.982925:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17711 00000100:00100000:2.0:1786562540.982932:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652820608:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1786562540.982939:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562540.982946:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f96b197/0x5c655bf66689f12d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd42 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562540.982974:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654876288:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562540.982998:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e480 going to sleep for 11 seconds 00002000:00010000:3.0:1786562540.986915:0:29662:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime: 1786562539 -> 1786562540 00002000:00010000:3.0:1786562540.986928:0:29662:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime: 1786562539 -> 1786562540 00002000:00010000:3.0:1786562540.986931:0:29662:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime: 1786562539 -> 1786562540 00000100:00100000:3.0:1786562540.986963:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654876288:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562540.987059:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f96b197/0x5c655bf66689f12d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd42 expref: 20 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.987094:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f96b197/0x5c655bf66689f12d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd42 expref: 20 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562540.987109:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269e00, rc 0) 00000100:00100000:3.0:1786562540.987183:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652820608:12345-192.168.204.29@tcp:101:cat.0 Request processed in 4251us (4952us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562540.987204:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17711 00002000:00010000:1.0:1786562540.987310:0:28862:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime: 1786562538 -> 1786562540 00000100:00100000:1.0:1786562540.987328:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654876160:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562540.987349:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf66689f126 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd34 expref: 30 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.987361:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf66689f126 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd34 expref: 30 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562540.987371:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269a00, rc 0) 00000100:00100000:1.0:1786562540.987394:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652820480:12345-192.168.204.29@tcp:101:cat.0 Request processed in 4575us (5220us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562540.987400:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17710 00000100:00100000:2.0:1786562540.987497:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654876032:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562540.987517:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 15 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.987534:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:2.0:1786562540.987557:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64153:x1873345652820224:12345-192.168.204.29@tcp:101:cat.0 Request processed in 5089us (5453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562540.987573:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17709 00000100:00100000:0.0:1786562540.989517:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562540.989723:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820736 00000100:00100000:2.0:1786562540.989736:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820736 00002000:00100000:2.0:1786562540.989801:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->2740223) req@ffff90e9b42f5500 x1873345652820736/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/0 e 0 to 0 dl 1786562551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562540.989815:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f5500 with x1873345652820736 ext(2097152->2740223) 00010000:00010000:2.0:1786562540.989826:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562540.989845:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 19 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562540.989853:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9b42f5500 00000100:00100000:2.0:1786562540.989891:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5977 00000100:00100000:2.0:1786562540.989902:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652820736:12345-192.168.204.29@tcp:4:multiop.0 00000100:00100000:2.0:1786562541.007118:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652820736:12345-192.168.204.29@tcp:4:multiop.0 Request processed in 17198us (17598us total) trans 21474843572 rc 0/0 00000100:00100000:2.0:1786562541.007137:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5977 00002000:00100000:2.0:1786562541.007155:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x730:0x0] (2097152->2740223) req@ffff90e9b42f5500 x1873345652820736/t21474843572(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:11/0 lens 488/448 e 0 to 0 dl 1786562551 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562541.007176:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f5500 with x1873345652820736 ext(2097152->2740223) 00010000:00010000:2.0:1786562541.007200:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 21 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.007227:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 21 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.007236:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9b42f5500 00000100:00100000:3.0:1786562541.010878:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.012036:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820864 00000100:00100000:0.0:1786562541.012054:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820864 00010000:00010000:0.0:1786562541.012139:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 21 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.012201:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8681 00000100:00100000:0.0:1786562541.012216:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2349:x1873345652820864:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562541.012236:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786562541.012701:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.012737:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652820992 00000100:00100000:3.0:1786562541.012743:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652820992 00000100:00100000:3.0:1786562541.012786:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17712 00000100:00100000:3.0:1786562541.012796:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:64158:x1873345652820992:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562541.012816:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.012839:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd49 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.012870:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 10) 00010000:00010000:3.0:1786562541.012875:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 10) 00010000:00010000:3.0:1786562541.012887:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.012905:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 30 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.012922:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881800, rc 0) 00000100:00100000:3.0:1786562541.012991:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:64158:x1873345652820992:12345-192.168.204.29@tcp:101:cat.0 Request processed in 198us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.012999:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17712 00000100:00080000:2.0:1786562541.013721:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562541.013729:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786562541.014152:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 21 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.014173:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 21 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.014212:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be528387/0x5c655bf66689f0ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->4186111] (req 2097152->2740223) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd1f expref: 21 pid: 29967 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.014231:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 6) 00010000:00010000:0.0:1786562541.014235:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 6) 00010000:00010000:0.0:1786562541.014243:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.014254:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.014483:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.014504:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654876416:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562541.014722:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.017801:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654876416:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562541.017840:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562541.017921:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652820864:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5708us (7058us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.017935:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8681 00000100:00100000:3.0:1786562541.025442:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.025537:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652821120 00000100:00100000:0.0:1786562541.025552:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652821120 00002000:00100000:0.0:1786562541.025632:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e9bfb5dc00 x1873345652821120/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.025645:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5dc00 with x1873345652821120 ext(2097152->3145727) 00002000:00010000:0.0:1786562541.025653:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfb5dc00 00000100:00100000:0.0:1786562541.025702:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11525 00000100:00100000:0.0:1786562541.025714:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652821120:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562541.039802:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.039903:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.040817:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652821120:12345-192.168.204.29@tcp:3:cat.0 Request processed in 15097us (15382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562541.040831:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11525 00002000:00100000:3.0:1786562541.040848:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x714:0x0] (2097152->3145727) req@ffff90e9bfb5dc00 x1873345652821120/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.040860:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bfb5dc00 with x1873345652821120 ext(2097152->3145727) 00002000:00010000:3.0:1786562541.040869:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bfb5dc00 00000100:00100000:0.0:1786562541.045916:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652821248 00000100:00100000:0.0:1786562541.045940:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652821248 00002000:00100000:0.0:1786562541.046059:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf5ea00 x1873345652821248/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.046073:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ea00 with x1873345652821248 ext(2097152->3145727) 00002000:00010000:0.0:1786562541.046081:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5ea00 00000100:00100000:0.0:1786562541.046129:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652821376 00000100:00100000:0.0:1786562541.046133:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652821376 00002000:00100000:0.0:1786562541.046162:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5ed80 x1873345652821376/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.046172:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ed80 with x1873345652821376 ext(3145728->4194303) 00002000:00010000:0.0:1786562541.046176:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5ed80 00000100:00100000:0.0:1786562541.046213:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11526 00000100:00100000:0.0:1786562541.046225:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652821248:12345-192.168.204.29@tcp:3:cat.0 00000100:00080000:2.0:1786562541.046736:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562541.046743:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562541.047962:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11527 00000100:00100000:0.0:1786562541.047984:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652821376:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562541.054199:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.054874:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652821504 00000100:00100000:1.0:1786562541.054889:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652821504 00000100:00100000:1.0:1786562541.054964:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17713 00000100:00100000:1.0:1786562541.054977:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+20:64158:x1873345652821504:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562541.055022:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.055048:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd50 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.055084:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 6) 00010000:00010000:1.0:1786562541.055089:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 6) 00010000:00010000:1.0:1786562541.055102:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 21 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.055121:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 21 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.055137:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe39000, rc 0) 00000100:00100000:1.0:1786562541.055232:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+21:64158:x1873345652821504:12345-192.168.204.29@tcp:101:cat.0 Request processed in 257us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.055242:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17713 00000100:00100000:0.0:1786562541.069802:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.078960:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652821760 00000100:00100000:3.0:1786562541.078983:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652821760 00000100:00100000:0.0:1786562541.079327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.079370:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.079513:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652821888 00000100:00100000:1.0:1786562541.079519:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652821888 00002000:00100000:1.0:1786562541.079652:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e9b42f5180 x1873345652821888/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.079665:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f5180 with x1873345652821888 ext(2097152->3145727) 00002000:00010000:1.0:1786562541.079674:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b42f5180 00000100:00100000:1.0:1786562541.079707:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822016 00000100:00100000:1.0:1786562541.079711:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822016 00002000:00100000:1.0:1786562541.079731:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9b42f6d80 x1873345652822016/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.079747:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f6d80 with x1873345652822016 ext(3145728->4194303) 00002000:00010000:1.0:1786562541.079751:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b42f6d80 00000100:00100000:1.0:1786562541.079772:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11528 00000100:00100000:1.0:1786562541.079782:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652821888:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562541.079859:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17111 00000100:00100000:2.0:1786562541.079868:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+506:64162:x1873345652821760:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:2.0:1786562541.079889:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.079914:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689f142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd57 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.080038:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.080055:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.080073:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.080090:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.080097:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.080104:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.081789:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689f157 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.081817:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689f157 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.081830:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689f157 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562541.081845:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562541.081979:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.081987:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.081994:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082001:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562541.082025:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082033:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082048:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562541.082051:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562541.082057:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082063:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365200/0x5c655bf66689f149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082078:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082084:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082090:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082102:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562541.082105:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082112:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082122:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b479d600) 00010000:00010000:2.0:1786562541.082125:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562541.082131:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082139:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365c00/0x5c655bf66689f150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082223:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364200/0x5c655bf66689f142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd57 expref: 509 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082246:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689f157 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd57 expref: 508 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.082255:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.082257:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786562541.082260:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365a00, rc 0) 00000100:00100000:2.0:1786562541.082314:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+508:64162:x1873345652821760:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 2442us (12523us total) trans 8589950661 rc 0/0 00000100:00100000:2.0:1786562541.082327:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17111 00000100:00080000:2.0:1786562541.082376:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562541.087807:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11529 00000100:00100000:0.0:1786562541.087849:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652822016:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562541.115655:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2348:x1873345652821248:12345-192.168.204.29@tcp:3:cat.0 Request processed in 69415us (75852us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562541.115675:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11526 00002000:00100000:1.0:1786562541.115692:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e88bf5ea00 x1873345652821248/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.115704:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ea00 with x1873345652821248 ext(2097152->3145727) 00002000:00010000:1.0:1786562541.115712:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88bf5ea00 00000100:00100000:1.0:1786562541.117905:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652821376:12345-192.168.204.29@tcp:3:cat.0 Request processed in 69912us (77985us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562541.117922:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11527 00002000:00100000:1.0:1786562541.117938:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e88bf5ed80 x1873345652821376/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.117949:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf5ed80 with x1873345652821376 ext(3145728->4194303) 00002000:00010000:1.0:1786562541.117956:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88bf5ed80 00000100:00100000:3.0:1786562541.128398:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.129084:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822144 00000100:00100000:2.0:1786562541.129101:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822144 00000100:00100000:2.0:1786562541.129199:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 973 00000100:00100000:2.0:1786562541.129213:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+508:2349:x1873345652822144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.129236:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.129270:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365a00/0x5c655bf66689f157 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd57 expref: 508 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.129297:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.129304:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.129435:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+507:2349:x1873345652822144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 225us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.129444:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 973 00000100:00100000:2.0:1786562541.131149:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652822016:12345-192.168.204.29@tcp:3:cat.0 Request processed in 43311us (51766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562541.131165:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11529 00002000:00100000:2.0:1786562541.131192:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x714:0x0] (3145728->4194303) req@ffff90e9b42f6d80 x1873345652822016/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562541.131203:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f6d80 with x1873345652822016 ext(3145728->4194303) 00002000:00010000:2.0:1786562541.131211:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b42f6d80 00000100:00100000:3.0:1786562541.132716:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652821888:12345-192.168.204.29@tcp:3:cat.0 Request processed in 52920us (53382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562541.132734:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11528 00002000:00100000:3.0:1786562541.132752:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x730:0x0] (2097152->3145727) req@ffff90e9b42f5180 x1873345652821888/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.132764:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f5180 with x1873345652821888 ext(2097152->3145727) 00002000:00010000:3.0:1786562541.132772:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b42f5180 00000100:00100000:2.0:1786562541.167062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.167302:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.174719:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822272 00000100:00100000:3.0:1786562541.174741:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822272 00000100:00100000:1.0:1786562541.175043:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822400 00000100:00100000:1.0:1786562541.175050:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822400 00000100:00100000:1.0:1786562541.175112:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17714 00000100:00100000:1.0:1786562541.175126:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+21:64158:x1873345652822272:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562541.175157:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.175195:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd5e expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.175243:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 15 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.175260:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(3 6) 00010000:00010000:1.0:1786562541.175276:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 6) 00010000:00010000:1.0:1786562541.175282:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 22 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.175331:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 15 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.175350:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 15 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.175369:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654876544:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.175696:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.175811:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17715 00000100:00100000:0.0:1786562541.175897:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:64153:x1873345652822400:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562541.175907:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562541.175920:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd65 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.175939:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x730:0x0].0x0 since=0s v=(4 6) 00010000:00010000:0.0:1786562541.175946:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.175958:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.175978:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e000, rc 0) 00000100:00100000:0.0:1786562541.176059:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:64153:x1873345652822400:12345-192.168.204.29@tcp:101:cat.0 Request processed in 167us (8757us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.176067:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17715 00000100:00100000:1.0:1786562541.182339:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.182923:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654876544:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.182969:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 22 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.182997:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bfe38200, rc 0) 00000100:00100000:3.0:1786562541.183117:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+22:64158:x1873345652822272:12345-192.168.204.29@tcp:101:cat.0 Request processed in 7994us (16073us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.183129:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17714 00000100:00100000:0.0:1786562541.186126:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822528 00000100:00100000:0.0:1786562541.186150:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822528 00002000:00100000:1.0:1786562541.190153:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (4186112->4194303) req@ffff90e9887ef100 x1873345652822528/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 8680/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.190172:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ef100 with x1873345652822528 ext(4186112->4194303) 00010000:00010000:1.0:1786562541.190198:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 16 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.190225:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 16 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562541.190235:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9887ef100 00000100:00100000:1.0:1786562541.190358:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5978 00000100:00100000:1.0:1786562541.190372:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652822528:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562541.191321:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2351:x1873345652822528:12345-192.168.204.29@tcp:4:cat.0 Request processed in 946us (8991us total) trans 21474843573 rc 0/0 00000100:00100000:1.0:1786562541.191336:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5978 00002000:00100000:1.0:1786562541.191347:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x730:0x0] (4186112->4194303) req@ffff90e9887ef100 x1873345652822528/t21474843573(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 8680/448 e 0 to 0 dl 1786562552 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.191357:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9887ef100 with x1873345652822528 ext(4186112->4194303) 00010000:00010000:1.0:1786562541.191366:0:29458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 18 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.191384:0:29458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 18 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562541.191392:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9887ef100 00000100:00100000:1.0:1786562541.202943:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.203322:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822656 00000100:00100000:2.0:1786562541.203335:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822656 00010000:00010000:2.0:1786562541.203403:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 18 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.203456:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8682 00000100:00100000:2.0:1786562541.203467:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+18:2351:x1873345652822656:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.203488:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.203519:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 18 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203666:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 18 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203702:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbbafc8d/0x5c655bf66689f0d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [4186112->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd03 expref: 18 pid: 8368 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203727:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 6) 00010000:00010000:2.0:1786562541.203733:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 6) 00010000:00010000:2.0:1786562541.203743:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 21 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203756:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 21 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203769:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 6) 00010000:00010000:2.0:1786562541.203772:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 6) 00010000:00010000:2.0:1786562541.203777:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203786:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.203908:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.203926:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654876672:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562541.204959:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 21 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.204980:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654876800:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562541.205073:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.211126:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.211309:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822784 00000100:00100000:3.0:1786562541.211322:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822784 00000100:00100000:3.0:1786562541.211406:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17716 00000100:00100000:3.0:1786562541.211419:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:64160:x1873345652822784:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562541.211445:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.211469:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd6c expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.211512:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.211525:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 10 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.211533:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.211619:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=3s v=(1 0) 00010000:00010000:3.0:1786562541.211624:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1786562541.211631:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [163840->987135] (req 163840->987135) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.211675:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.211691:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.211709:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654876928:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.212749:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 10 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.212767:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 10 pid: 8368 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.212787:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654877056:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.214201:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 29 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.214224:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 29 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.214244:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654877184:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.215059:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.227530:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654876672:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562541.227568:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654876800:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562541.227603:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.227699:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2351:x1873345652822656:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 24232us (24772us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.227713:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8682 00000100:00100000:2.0:1786562541.228739:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.228787:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.229691:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652822912 00000100:00100000:3.0:1786562541.229706:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652822912 00010000:00010000:3.0:1786562541.229784:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 11 pid: 8368 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786562541.229967:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562541.230166:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823040 00000100:00100000:3.0:1786562541.230171:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823040 00010000:00010000:3.0:1786562541.230200:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 30 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.237483:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654876928:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562541.237509:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654877056:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562541.237521:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654877184:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562541.237575:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [163840->987135] (req 163840->987135) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.237604:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92d600, rc 0) 00000100:00100000:0.0:1786562541.237705:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64160:x1873345652822784:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 26288us (26592us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.237716:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17716 00000100:00100000:1.0:1786562541.237870:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8683 00000100:00100000:1.0:1786562541.237889:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652822912:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.237912:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.237946:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 11 pid: 8368 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.237962:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 11 pid: 8368 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.237991:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689ee8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcba5 expref: 11 pid: 8368 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.238022:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.238047:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652822912:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 166us (9314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.238054:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8683 00000100:00100000:1.0:1786562541.238073:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8684 00000100:00100000:1.0:1786562541.238081:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652823040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.238091:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.238102:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 30 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.238113:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 30 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.238129:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689ee55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb82 expref: 30 pid: 12119 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.238138:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.238156:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652823040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 77us (9369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.238163:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8684 00000100:00100000:0.0:1786562541.238670:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.238758:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.238782:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823296 00000100:00100000:0.0:1786562541.238791:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823296 00010000:00010000:0.0:1786562541.238823:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.238852:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8685 00000100:00100000:0.0:1786562541.238860:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652823296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562541.238871:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562541.238885:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.238897:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.238913:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068f8c621/0x5c655bf66689ee7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcb97 expref: 12 pid: 6659 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.238928:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562541.238932:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1786562541.238941:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.238953:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.238997:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.239058:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654877312:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562541.239125:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.239216:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.239336:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823168 00000100:00100000:3.0:1786562541.239341:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823168 00002000:00100000:3.0:1786562541.239385:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9b42f7800 x1873345652823168/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.239396:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f7800 with x1873345652823168 ext(3145728->4194303) 00002000:00010000:3.0:1786562541.239403:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b42f7800 00000100:00100000:3.0:1786562541.239427:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823424 00000100:00100000:3.0:1786562541.239431:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823424 00002000:00100000:3.0:1786562541.239447:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88720f800 x1873345652823424/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.239456:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720f800 with x1873345652823424 ext(3145728->4194303) 00002000:00010000:3.0:1786562541.239460:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88720f800 00000100:00100000:3.0:1786562541.239478:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11530 00000100:00100000:3.0:1786562541.239485:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2349:x1873345652823168:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562541.240331:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11531 00000100:00100000:3.0:1786562541.240346:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652823424:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1786562541.248079:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.248224:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654877312:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562541.248256:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.248329:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652823296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 9467us (9568us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.248343:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8685 00000100:00100000:3.0:1786562541.251810:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823552 00000100:00100000:3.0:1786562541.251834:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823552 00002000:00100000:3.0:1786562541.251911:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x711:0x0] (163840->167935) req@ffff90e88720e300 x1873345652823552/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.251925:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720e300 with x1873345652823552 ext(163840->167935) 00002000:00010000:3.0:1786562541.251932:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720e300 00000100:00100000:3.0:1786562541.251980:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11532 00000100:00100000:3.0:1786562541.251992:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652823552:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562541.252487:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2348:x1873345652823552:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 495us (4421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786562541.252498:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11532 00002000:00100000:3.0:1786562541.252506:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x711:0x0] (163840->167935) req@ffff90e88720e300 x1873345652823552/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/4536 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.252522:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720e300 with x1873345652823552 ext(163840->167935) 00002000:00010000:3.0:1786562541.252526:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88720e300 00000100:00100000:3.0:1786562541.259643:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2349:x1873345652823168:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 20139us (20958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562541.259662:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11530 00002000:00100000:3.0:1786562541.259680:0:13913:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e9b42f7800 x1873345652823168/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.259692:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b42f7800 with x1873345652823168 ext(3145728->4194303) 00002000:00010000:3.0:1786562541.259701:0:13913:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b42f7800 00000100:00100000:3.0:1786562541.264430:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652823424:12345-192.168.204.29@tcp:3:cat.0 Request processed in 24070us (25195us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562541.264460:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11531 00002000:00100000:3.0:1786562541.264479:0:14017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x730:0x0] (3145728->4194303) req@ffff90e88720f800 x1873345652823424/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.264491:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720f800 with x1873345652823424 ext(3145728->4194303) 00002000:00010000:3.0:1786562541.264500:0:14017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88720f800 00000100:00100000:1.0:1786562541.277354:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.277909:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823680 00000100:00100000:0.0:1786562541.277924:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823680 00000100:00100000:0.0:1786562541.278031:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17717 00000100:00100000:0.0:1786562541.278044:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+29:64158:x1873345652823680:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562541.278067:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562541.278091:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd73 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.278132:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.278142:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x714:0x0].0x0 since=0s v=(4 10) 00010000:00010000:0.0:1786562541.278148:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:0.0:1786562541.278154:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 30 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.278207:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 10 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.278223:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 10 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.278239:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654877440:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562541.278344:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.278834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.279242:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823808 00000100:00100000:1.0:1786562541.279252:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823808 00000100:00100000:1.0:1786562541.279314:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17718 00000100:00100000:1.0:1786562541.279324:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2351:x1873345652823808:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1786562541.279343:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.279360:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fbc1e2a/0x5c655bf66689f181 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd7a expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.279425:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654877568:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562541.279498:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.283816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.283859:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652823936 00000100:00100000:0.0:1786562541.283870:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652823936 00002000:00100000:0.0:1786562541.283936:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5103615) req@ffff90e88720c000 x1873345652823936/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.283949:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720c000 with x1873345652823936 ext(4194304->5103615) 00010000:00010000:0.0:1786562541.283961:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.283981:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562541.283991:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88720c000 00000100:00100000:0.0:1786562541.284057:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5979 00000100:00100000:0.0:1786562541.284070:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652823936:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:1.0:1786562541.285167:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654877440:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.285226:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 30 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.285250:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26ee00, rc 0) 00000100:00100000:1.0:1786562541.285294:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+30:64158:x1873345652823680:12345-192.168.204.29@tcp:101:cat.0 Request processed in 7253us (7954us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.285304:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17717 00000100:00100000:3.0:1786562541.285426:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654877568:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562541.285461:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fbc1e2a/0x5c655bf66689f181 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd7a expref: 14 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.285480:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fbc1e2a/0x5c655bf66689f181 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd7a expref: 14 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.285501:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9c1e95400, rc 0) 00000100:00100000:3.0:1786562541.285527:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652823808:12345-192.168.204.29@tcp:101:cat.0 Request processed in 6206us (6696us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562541.285534:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17718 00000100:00100000:2.0:1786562541.293839:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.293886:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824064 00000100:00100000:2.0:1786562541.293899:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824064 00002000:00100000:2.0:1786562541.293969:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (983040->987135) req@ffff90e98825d500 x1873345652824064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562541.293982:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825d500 with x1873345652824064 ext(983040->987135) 00002000:00010000:2.0:1786562541.293989:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825d500 00000100:00100000:2.0:1786562541.294047:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11533 00000100:00100000:2.0:1786562541.294058:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652824064:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:2.0:1786562541.294349:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2348:x1873345652824064:12345-192.168.204.29@tcp:3:cat.0 Request processed in 291us (527us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786562541.294359:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11533 00002000:00100000:2.0:1786562541.294366:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x711:0x0] (983040->987135) req@ffff90e98825d500 x1873345652824064/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/4536 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562541.294376:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825d500 with x1873345652824064 ext(983040->987135) 00002000:00010000:2.0:1786562541.294379:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e98825d500 00000100:00100000:0.0:1786562541.298205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.298809:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824192 00000100:00100000:3.0:1786562541.298822:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824192 00000100:00100000:3.0:1786562541.298888:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17719 00000100:00100000:3.0:1786562541.298899:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:64162:x1873345652824192:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562541.298923:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.298947:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd81 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.298989:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 23 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299000:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 10 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299029:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299039:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=2s v=(1 0) 00010000:00010000:3.0:1786562541.299044:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1786562541.299050:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 23 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299094:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 16 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299109:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 16 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.299125:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654877696:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.299243:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 10 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299253:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 10 pid: 6658 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.299263:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654877824:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.299295:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 23 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.299304:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 23 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.299314:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654877952:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.299335:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.317455:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652823936:12345-192.168.204.29@tcp:4:cat.0 Request processed in 33369us (33635us total) trans 17179876053 rc 0/0 00000100:00100000:1.0:1786562541.317475:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5979 00002000:00100000:1.0:1786562541.317494:0:29459:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5103615) req@ffff90e88720c000 x1873345652823936/t17179876053(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/448 e 0 to 0 dl 1786562552 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.317507:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88720c000 with x1873345652823936 ext(4194304->5103615) 00010000:00010000:1.0:1786562541.317522:0:29459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.317543:0:29459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562541.317552:0:29459:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88720c000 00000100:00100000:2.0:1786562541.318424:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.319424:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824320 00000100:00100000:1.0:1786562541.319441:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824320 00002000:00100000:1.0:1786562541.319621:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (5103616->5185535) req@ffff90e98825ca80 x1873345652824320/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.319633:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ca80 with x1873345652824320 ext(5103616->5185535) 00010000:00010000:1.0:1786562541.319644:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.319747:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562541.319758:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98825ca80 00000100:00100000:1.0:1786562541.319809:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5980 00000100:00100000:1.0:1786562541.319821:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652824320:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1786562541.323752:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654877696:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.323772:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654877824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.323784:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654877952:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.323829:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 23 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.323855:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92c600, rc 0) 00000100:00100000:2.0:1786562541.325463:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.325603:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.325630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.326411:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824576 00000100:00100000:1.0:1786562541.326427:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824576 00010000:00010000:1.0:1786562541.326493:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 24 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.326546:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824448 00000100:00100000:1.0:1786562541.326549:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824448 00010000:00010000:1.0:1786562541.326582:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 11 pid: 6658 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.326605:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8686 00000100:00100000:1.0:1786562541.326616:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345652824576:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.326636:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.326887:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 24 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.326904:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 24 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.326944:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a972fb8b/0x5c655bf66689eea9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbc1 expref: 24 pid: 28862 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.326967:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.327090:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345652824576:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 475us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.327098:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8686 00000100:00100000:1.0:1786562541.327121:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824704 00000100:00100000:1.0:1786562541.327125:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824704 00010000:00010000:1.0:1786562541.327140:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 17 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.327161:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8687 00000100:00100000:1.0:1786562541.327168:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652824448:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.327176:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.327199:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 11 pid: 6658 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327209:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 11 pid: 6658 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327223:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3aa6ca0/0x5c655bf66689ef90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc38 expref: 11 pid: 6658 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327239:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.327260:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652824448:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 92us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.327267:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8687 00000100:00100000:1.0:1786562541.327280:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8688 00000100:00100000:1.0:1786562541.327286:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+17:2350:x1873345652824704:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.327295:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.327304:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 17 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327314:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 17 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327327:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051559b7a/0x5c655bf66689eed3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcbd6 expref: 17 pid: 6659 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327340:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1786562541.327345:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1786562541.327353:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 22 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327363:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 22 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.327529:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 22 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.327546:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654878080:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562541.327612:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00080000:1.0:1786562541.327641:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562541.330698:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:64162:x1873345652824192:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 31780us (32495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.330717:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17719 00000100:00100000:1.0:1786562541.332535:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.332897:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654878080:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562541.332929:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.333032:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2350:x1873345652824704:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5718us (7374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.333046:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8688 00000100:00100000:0.0:1786562541.334508:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824832 00000100:00100000:0.0:1786562541.334524:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824832 00002000:00100000:1.0:1786562541.334703:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x72e:0x0] (1839104->1843199) req@ffff90e98553d180 x1873345652824832/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.334717:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553d180 with x1873345652824832 ext(1839104->1843199) 00002000:00010000:1.0:1786562541.334724:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553d180 00000100:00100000:1.0:1786562541.334764:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11534 00000100:00100000:1.0:1786562541.334776:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652824832:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:1.0:1786562541.335135:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652824832:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 359us (2612us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562541.335145:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11534 00002000:00100000:1.0:1786562541.335153:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x72e:0x0] (1839104->1843199) req@ffff90e98553d180 x1873345652824832/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/4536 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.335161:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98553d180 with x1873345652824832 ext(1839104->1843199) 00002000:00010000:1.0:1786562541.335165:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98553d180 00000100:00100000:3.0:1786562541.336678:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652824320:12345-192.168.204.29@tcp:3:cat.0 Request processed in 16838us (18242us total) trans 0 rc 81920/81920 00000100:00100000:3.0:1786562541.336692:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5980 00002000:00100000:3.0:1786562541.336705:0:29462:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x714:0x0] (5103616->5185535) req@ffff90e98825ca80 x1873345652824320/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:H/600/0 rc 81920/81920 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562541.336716:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825ca80 with x1873345652824320 ext(5103616->5185535) 00010000:00010000:3.0:1786562541.336729:0:29462:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.336753:0:29462:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562541.336761:0:29462:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e98825ca80 00000100:00100000:1.0:1786562541.340175:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.340296:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.340392:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825088 00000100:00100000:3.0:1786562541.340407:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825088 00010000:00010000:3.0:1786562541.340472:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.340522:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8689 00000100:00100000:3.0:1786562541.340534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652825088:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.340554:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.340585:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.340601:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.340632:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036baa0f9/0x5c655bf66689f0e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5103615) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd18 expref: 13 pid: 29963 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.340655:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:3.0:1786562541.340660:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:3.0:1786562541.340876:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.340889:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.340939:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.340963:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654878208:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562541.341118:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.344304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.344392:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654878208:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562541.344424:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.344519:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652825088:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3985us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.344533:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8689 00000100:00100000:2.0:1786562541.347629:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652824960 00000100:00100000:2.0:1786562541.347653:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652824960 00000100:00100000:2.0:1786562541.347848:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825216 00000100:00100000:2.0:1786562541.347853:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825216 00000100:00100000:0.0:1786562541.347901:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17720 00000100:00100000:0.0:1786562541.347916:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:64153:x1873345652824960:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562541.347941:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562541.347967:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd88 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.348034:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:0.0:1786562541.348040:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:0.0:1786562541.348052:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 13 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.348072:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 13 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.348088:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26fe00, rc 0) 00000100:00100000:0.0:1786562541.348190:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:64153:x1873345652824960:12345-192.168.204.29@tcp:101:cat.0 Request processed in 278us (8029us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.348198:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17720 00000100:00100000:0.0:1786562541.348225:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17721 00000100:00100000:0.0:1786562541.348231:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652825216:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1786562541.348238:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562541.348247:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f196 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd8f expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.348303:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654878336:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562541.348366:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.351127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:3.0:1786562541.351268:0:29964:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime: 1786562536 -> 1786562540 00002000:00010000:3.0:1786562541.351275:0:29964:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime: 1786562536 -> 1786562540 00002000:00010000:3.0:1786562541.351278:0:29964:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime: 1786562536 -> 1786562540 00000100:00100000:3.0:1786562541.351308:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654878336:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562541.351358:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f196 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd8f expref: 31 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.351398:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f196 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd8f expref: 31 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.351415:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f400, rc 0) 00000100:00100000:3.0:1786562541.351500:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652825216:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3267us (7209us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562541.351511:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17721 00000100:00100000:3.0:1786562541.351547:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825472 00000100:00100000:3.0:1786562541.351554:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825472 00000100:00100000:3.0:1786562541.351609:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17722 00000100:00100000:3.0:1786562541.351620:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652825472:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562541.351638:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.351661:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fbc1e2a/0x5c655bf66689f19d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd9d expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.351725:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654878464:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562541.351786:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00010000:00010000:1.0:1786562541.351916:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786562541.355242:0:29964:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime: 1786562536 -> 1786562540 00002000:00010000:3.0:1786562541.355256:0:29964:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime: 1786562537 -> 1786562540 00002000:00010000:3.0:1786562541.355259:0:29964:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime: 1786562536 -> 1786562540 00000100:00100000:3.0:1786562541.355293:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654878464:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562541.355350:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007fbc1e2a/0x5c655bf66689f19d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd9d expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.355391:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fbc1e2a/0x5c655bf66689f19d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd9d expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.355408:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9c1e95400, rc 0) 00000100:00100000:3.0:1786562541.355544:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2349:x1873345652825472:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3926us (4430us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562541.355555:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17722 00000100:00100000:1.0:1786562541.356410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.356979:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825344 00000100:00100000:3.0:1786562541.356992:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825344 00000100:00100000:3.0:1786562541.357082:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17723 00000100:00100000:3.0:1786562541.357093:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:64162:x1873345652825344:12345-192.168.204.29@tcp:101:multiop.0 00010000:00010000:3.0:1786562541.357118:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.357142:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcd96 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.357193:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.357204:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.357212:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1786562541.357218:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562541.357224:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->1552383] (req 1048576->1552383) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 23 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.357267:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 15 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.357283:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 15 pid: 29965 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.357301:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654878592:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.357526:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.357543:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.357554:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654878720:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.357583:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562541.365926:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.366030:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825600 00000100:00100000:1.0:1786562541.366042:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825600 00002000:00100000:1.0:1786562541.366111:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e88b519c00 x1873345652825600/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.366124:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519c00 with x1873345652825600 ext(5181440->5185535) 00002000:00010000:1.0:1786562541.366131:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519c00 00000100:00100000:1.0:1786562541.366222:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11535 00000100:00100000:1.0:1786562541.366234:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652825600:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1786562541.366601:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652825600:12345-192.168.204.29@tcp:3:cat.0 Request processed in 368us (688us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786562541.366610:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11535 00002000:00100000:1.0:1786562541.366618:0:29461:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x714:0x0] (5181440->5185535) req@ffff90e88b519c00 x1873345652825600/t0(0) o3->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/4536 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.366626:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88b519c00 with x1873345652825600 ext(5181440->5185535) 00002000:00010000:1.0:1786562541.366631:0:29461:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88b519c00 00000100:00100000:1.0:1786562541.368952:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.368993:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.369048:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825984 00000100:00100000:1.0:1786562541.369060:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825984 00002000:00100000:1.0:1786562541.369129:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bbfa1f80 x1873345652825984/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.369142:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa1f80 with x1873345652825984 ext(4194304->5185535) 00002000:00010000:1.0:1786562541.369149:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bbfa1f80 00000100:00100000:1.0:1786562541.369193:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11536 00000100:00100000:1.0:1786562541.369206:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652825984:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:3.0:1786562541.369550:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654878592:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.369567:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654878720:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.369608:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [1048576->1552383] (req 1048576->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 23 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.369635:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a6600, rc 0) 00000100:00100000:3.0:1786562541.369713:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:64162:x1873345652825344:12345-192.168.204.29@tcp:101:multiop.0 Request processed in 12621us (13307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.369723:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17723 00000100:00100000:2.0:1786562541.370059:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825856 00000100:00100000:2.0:1786562541.370067:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825856 00010000:00010000:2.0:1786562541.370101:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.370131:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8690 00000100:00100000:2.0:1786562541.370139:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2351:x1873345652825856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.370155:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.370195:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370214:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370242:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ff65/0x5c655bf66689f07e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcccb expref: 23 pid: 29966 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370258:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.370285:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652825856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 147us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.370292:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8690 00000100:00100000:2.0:1786562541.370356:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.370398:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652825728 00000100:00100000:2.0:1786562541.370402:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652825728 00010000:00010000:2.0:1786562541.370420:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 16 pid: 29965 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.370455:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8691 00000100:00100000:2.0:1786562541.370463:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+16:2351:x1873345652825728:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.370472:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.370483:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 16 pid: 29965 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370494:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 16 pid: 29965 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370514:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000153bf7f7/0x5c655bf66689f0bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccee expref: 16 pid: 29965 timeout: 1073 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370526:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562541.370530:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562541.370541:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 21 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370553:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 21 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.370598:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 21 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.370614:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654878848:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562541.370681:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562541.375281:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654878848:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562541.375322:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.375397:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2351:x1873345652825728:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4934us (5040us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.375413:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8691 00000100:00100000:1.0:1786562541.409828:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.410082:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652826112 00000100:00100000:0.0:1786562541.410096:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652826112 00002000:00100000:0.0:1786562541.410157:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72f:0x0] (1548288->1552383) req@ffff90e9bbfa3b80 x1873345652826112/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.410171:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa3b80 with x1873345652826112 ext(1548288->1552383) 00002000:00010000:0.0:1786562541.410187:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bbfa3b80 00000100:00100000:0.0:1786562541.410218:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11537 00000100:00100000:0.0:1786562541.410229:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652826112:12345-192.168.204.29@tcp:3:multiop.0 00000100:00100000:0.0:1786562541.410531:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652826112:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 301us (717us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786562541.410540:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11537 00002000:00100000:0.0:1786562541.410547:0:29463:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x72f:0x0] (1548288->1552383) req@ffff90e9bbfa3b80 x1873345652826112/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/4536 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.410556:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa3b80 with x1873345652826112 ext(1548288->1552383) 00002000:00010000:0.0:1786562541.410560:0:29463:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bbfa3b80 00000100:00100000:1.0:1786562541.413646:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652825984:12345-192.168.204.29@tcp:3:multiop.0 Request processed in 44425us (44634us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1786562541.413665:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11536 00002000:00100000:1.0:1786562541.413682:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x714:0x0] (4194304->5185535) req@ffff90e9bbfa1f80 x1873345652825984/t0(0) o3->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/440 e 0 to 0 dl 1786562552 ref 1 fl Complete:/600/0 rc 991232/991232 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.413695:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa1f80 with x1873345652825984 ext(4194304->5185535) 00002000:00010000:1.0:1786562541.413702:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bbfa1f80 00000100:00100000:3.0:1786562541.416027:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.416123:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652826368 00000100:00100000:0.0:1786562541.416137:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652826368 00000100:00100000:0.0:1786562541.416224:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6283 00000100:00100000:0.0:1786562541.416239:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:64162:x1873345652826368:12345-192.168.204.29@tcp:35:multiop.0 00000100:00100000:0.0:1786562541.416780:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+508:64162:x1873345652826368:12345-192.168.204.29@tcp:35:multiop.0 Request processed in 542us (781us total) trans 8589950662 rc 0/0 00000100:00100000:0.0:1786562541.416790:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6283 00000100:00100000:0.0:1786562541.420243:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.420364:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652826496 00000100:00100000:3.0:1786562541.420438:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652826496 00000100:00100000:3.0:1786562541.420628:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17724 00000100:00100000:3.0:1786562541.420641:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652826496:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1786562541.420668:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.420696:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f1ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcda4 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.420787:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654878976:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562541.420903:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562541.423690:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654878976:192.168.204.29@tcp:106: 00010000:00010000:2.0:1786562541.423748:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f1ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcda4 expref: 31 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.423780:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf363578/0x5c655bf66689f1ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcda4 expref: 31 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.423796:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a7000, rc 0) 00000100:00100000:2.0:1786562541.423915:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652826496:12345-192.168.204.29@tcp:101:cat.0 Request processed in 3275us (3687us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562541.423926:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17724 00000100:00100000:1.0:1786562541.429135:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.429294:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652826752 00000100:00100000:3.0:1786562541.429308:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652826752 00000100:00100000:3.0:1786562541.429389:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6284 00000100:00100000:3.0:1786562541.429401:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+508:64158:x1873345652826752:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1786562541.429773:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+509:64158:x1873345652826752:12345-192.168.204.29@tcp:35:cat.0 Request processed in 373us (651us total) trans 8589950663 rc 0/0 00000100:00100000:3.0:1786562541.429781:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6284 00000100:00100000:0.0:1786562541.466739:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.467067:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652826880 00000100:00100000:1.0:1786562541.467080:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652826880 00000100:00100000:1.0:1786562541.467196:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17112 00000100:00100000:1.0:1786562541.467210:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64168:x1873345652826880:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562541.467248:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.467290:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f1b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdab expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.467387:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.467404:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.467418:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.467438:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.467446:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.467453:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786562541.467815:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562541.468584:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.468608:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.468618:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.469522:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.469548:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 10 pid: 33114 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.469568:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654879104:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.471124:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.482756:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.483300:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827136 00000100:00100000:3.0:1786562541.483314:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827136 00000100:00100000:3.0:1786562541.483418:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6285 00000100:00100000:3.0:1786562541.483431:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:49279:x1873345652827136:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786562541.483847:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:49279:x1873345652827136:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 416us (1105us total) trans 8589950664 rc 0/0 00000100:00100000:3.0:1786562541.483856:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6285 00000100:00080000:1.0:1786562541.484054:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562541.484365:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654879104:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562541.484410:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.487757:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.487911:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827264 00000100:00100000:1.0:1786562541.487924:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827264 00010000:00010000:1.0:1786562541.487978:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 12 pid: 33114 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.488066:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8692 00000100:00100000:1.0:1786562541.488079:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652827264:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.488099:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.488108:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 12 pid: 33114 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.488124:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 12 pid: 33114 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.488151:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e200/0x5c655bf66689f02a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcc9a expref: 12 pid: 33114 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.488173:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562541.488189:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.488201:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.488209:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.489569:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.489679:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652827264:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1583us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.489692:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8692 00010000:00010000:2.0:1786562541.493557:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493580:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562541.493651:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:2.0:1786562541.493657:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562541.493832:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493851:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493864:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493871:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493880:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493891:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562541.493896:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493904:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493923:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562541.493927:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562541.493932:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493939:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f1b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493963:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493969:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493975:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493980:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562541.493983:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.493989:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.494000:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562541.494114:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562541.494120:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.494127:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f1c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.494197:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f1b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.494216:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.494224:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.494227:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562541.494230:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880c00, rc 0) 00000100:00100000:2.0:1786562541.494403:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64168:x1873345652826880:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 27194us (27679us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.494414:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17112 00000100:00100000:2.0:1786562541.500846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.500956:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827392 00000100:00100000:1.0:1786562541.500968:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827392 00000100:00100000:1.0:1786562541.501075:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17725 00000100:00100000:1.0:1786562541.501096:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652827392:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562541.501118:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.501142:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feda40b3/0x5c655bf66689f1ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdb2 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.501228:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654879232:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562541.501326:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.502954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.503106:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.506962:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827520 00000100:00100000:2.0:1786562541.506984:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827520 00000100:00100000:2.0:1786562541.507374:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827648 00000100:00100000:2.0:1786562541.507379:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827648 00000100:00100000:3.0:1786562541.507408:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17726 00000100:00100000:3.0:1786562541.507426:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652827520:12345-192.168.204.29@tcp:101:lfs.0 00000100:00100000:0.0:1786562541.507466:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.507496:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.507515:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.507598:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827776 00000100:00100000:2.0:1786562541.507602:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827776 00000100:00100000:2.0:1786562541.507624:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652827904 00000100:00100000:2.0:1786562541.507628:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652827904 00000100:00100000:2.0:1786562541.507647:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652828032 00000100:00100000:2.0:1786562541.507649:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652828032 00000100:00100000:0.0:1786562541.507759:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17727 00000100:00100000:0.0:1786562541.507770:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652827648:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562541.507787:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562541.507813:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f1d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdc0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.507898:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654879360:192.168.204.29@tcp:106: 00000100:00100000:0.0:1786562541.508026:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92540 going to sleep for 11 seconds 00000100:00100000:2.0:1786562541.508202:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17728 00000100:00100000:2.0:1786562541.508212:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652827776:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.508220:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.508234:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdc7 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508252:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1786562541.508258:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562541.508319:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508340:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508355:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1ac00, rc 0) 00000100:00100000:2.0:1786562541.508392:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652827776:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 182us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.508400:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17728 00000100:00100000:2.0:1786562541.508424:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17729 00000100:00100000:2.0:1786562541.508431:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652827904:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.508438:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.508447:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdce expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508467:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:2.0:1786562541.508471:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(5 10) 00010000:00010000:2.0:1786562541.508479:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508491:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508501:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1b600, rc 0) 00000100:00100000:2.0:1786562541.508521:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652827904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 91us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.508527:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17729 00000100:00100000:2.0:1786562541.508541:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17730 00000100:00100000:2.0:1786562541.508549:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652828032:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.508557:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.508566:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdd5 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508579:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 6) 00010000:00010000:2.0:1786562541.508583:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(5 6) 00010000:00010000:2.0:1786562541.508589:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508600:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.508610:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1a200, rc 0) 00000100:00100000:2.0:1786562541.508630:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652828032:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 82us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.508636:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17730 00000100:00100000:1.0:1786562541.509453:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654879232:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562541.509492:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000feda40b3/0x5c655bf66689f1ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdb2 expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.509514:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feda40b3/0x5c655bf66689f1ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdb2 expref: 13 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.509526:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881200, rc 0) 00000100:00100000:1.0:1786562541.509619:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2349:x1873345652827392:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8534us (8786us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562541.509626:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17725 00010000:00010000:3.0:1786562541.516926:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.516975:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689f1f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdb9 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.518469:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654879488:192.168.204.29@tcp:106: 00000100:00100000:3.0:1786562541.518613:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00002000:00010000:1.0:1786562541.520707:0:29963:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime: 1786562539 -> 1786562540 00002000:00010000:1.0:1786562541.520720:0:29963:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime: 1786562539 -> 1786562540 00002000:00010000:1.0:1786562541.520723:0:29963:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime: 1786562539 -> 1786562540 00000100:00100000:1.0:1786562541.520759:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654879360:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562541.520813:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f1d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc0 expref: 14 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.520844:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f1d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc0 expref: 14 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.520862:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26f200, rc 0) 00000100:00100000:1.0:1786562541.520936:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652827648:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 13167us (17829us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562541.520947:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17727 00000100:00100000:3.0:1786562541.534055:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873345654879488:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562541.534270:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689f1f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdb9 expref: 12 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.534314:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf363578/0x5c655bf66689f1f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdb9 expref: 12 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.534331:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9a98a7000, rc 0) 00000100:00100000:3.0:1786562541.534417:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652827520:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 26996us (31474us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562541.534428:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17726 00000100:00100000:0.0:1786562541.542545:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.542749:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652828288 00000100:00100000:1.0:1786562541.542763:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652828288 00000100:00100000:1.0:1786562541.542847:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17113 00000100:00100000:1.0:1786562541.542859:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64168:x1873345652828288:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562541.542887:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.542914:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f1f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcddc expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.544379:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.544423:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.544433:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.544749:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.544769:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 10 pid: 33140 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.544788:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654879616:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562541.544915:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.548723:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654879616:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562541.548766:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.554258:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.554413:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652828416 00000100:00100000:2.0:1786562541.554425:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652828416 00010000:00010000:2.0:1786562541.554651:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 11 pid: 33140 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.554706:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8693 00000100:00100000:2.0:1786562541.554718:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652828416:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.554738:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.554747:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 11 pid: 33140 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.554763:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 11 pid: 33140 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.554793:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f1c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdab expref: 11 pid: 33140 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.554817:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.554823:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.554840:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.554848:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.554891:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.555081:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652828416:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 362us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.555089:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8693 00010000:00010000:1.0:1786562541.557229:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.557250:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562541.557283:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:1.0:1786562541.557521:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f1f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcddc expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.557551:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcddc expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.557561:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562541.557564:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562541.557568:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e400, rc 0) 00000100:00100000:1.0:1786562541.569866:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652828288:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 26990us (27483us total) trans 8589950665 rc 0/0 00000100:00100000:1.0:1786562541.569884:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17113 00000100:00100000:3.0:1786562541.582874:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.582911:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.582955:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.583046:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652828544 00000100:00100000:1.0:1786562541.583058:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652828544 00000100:00100000:1.0:1786562541.583130:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652828672 00000100:00100000:1.0:1786562541.583134:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652828672 00000100:00100000:1.0:1786562541.583154:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652828800 00000100:00100000:1.0:1786562541.583156:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652828800 00000100:00100000:1.0:1786562541.583190:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17731 00000100:00100000:1.0:1786562541.583202:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652828544:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562541.583228:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.583254:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f20d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcde3 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.583337:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654879744:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562541.583704:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17732 00000100:00100000:2.0:1786562541.583717:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652828672:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.583727:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.583741:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008022f8e4/0x5c655bf66689f214 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdea expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.583777:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654879872:192.168.204.29@tcp:106: 00000100:00100000:1.0:1786562541.589610:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.589677:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17733 00000100:00100000:1.0:1786562541.589711:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652828800:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562541.589742:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562541.589769:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f21b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdf1 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.589855:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654880000:192.168.204.29@tcp:106: 00000100:00100000:2.0:1786562541.591320:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562541.602739:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654879872:192.168.204.29@tcp:106: 00010000:00010000:3.0:1786562541.602797:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008022f8e4/0x5c655bf66689f214 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdea expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.602828:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008022f8e4/0x5c655bf66689f214 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdea expref: 14 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.602849:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1a400, rc 0) 00000100:00100000:3.0:1786562541.602916:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652828672:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 19203us (20003us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562541.602927:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17732 00000100:00100000:1.0:1786562541.602964:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654879744:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562541.602990:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f20d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcde3 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.603021:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f20d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcde3 expref: 13 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.603155:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880a00, rc 0) 00000100:00100000:1.0:1786562541.603192:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652828544:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 19992us (20331us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562541.603199:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17731 00000100:00100000:1.0:1786562541.603241:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.611849:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873345654880000:192.168.204.29@tcp:106: 00010000:00010000:1.0:1786562541.611905:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f21b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdf1 expref: 12 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.611935:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f21b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdf1 expref: 12 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.611960:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881400, rc 0) 00000100:00100000:1.0:1786562541.612069:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652828800:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 22380us (29111us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562541.612079:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17733 00000100:00100000:0.0:1786562541.616550:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.616818:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829056 00000100:00100000:2.0:1786562541.616832:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829056 00000100:00100000:2.0:1786562541.616916:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17114 00000100:00100000:2.0:1786562541.616929:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652829056:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.616963:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.616968:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562541.617044:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e400/0x5c655bf66689f1ff lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcddc expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.617074:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.617081:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562541.617098:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b400/0x5c655bf66689f222 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdf8 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.617240:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1be00/0x5c655bf66689f229 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.617258:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1be00/0x5c655bf66689f229 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.617268:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1be00/0x5c655bf66689f229 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562541.617283:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00010000:00010000:2.0:1786562541.617901:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b400/0x5c655bf66689f222 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdf8 expref: 12 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.617924:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1be00/0x5c655bf66689f229 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdf8 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.617933:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.617936:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562541.617939:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1be00, rc 0) 00000100:00100000:2.0:1786562541.618255:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652829056:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1327us (1717us total) trans 8589950666 rc 0/0 00000100:00100000:2.0:1786562541.618266:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17114 00000100:00100000:2.0:1786562541.622801:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.622851:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.622946:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829184 00000100:00100000:3.0:1786562541.622960:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829184 00000100:00100000:3.0:1786562541.623057:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829312 00000100:00100000:3.0:1786562541.623060:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829312 00000100:00100000:3.0:1786562541.623086:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17734 00000100:00100000:3.0:1786562541.623098:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652829184:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562541.623162:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.623202:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.623213:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x711:0x0].0x0 since=1s v=(0 1) 00010000:00010000:3.0:1786562541.623218:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562541.623224:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.623278:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.623296:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.623319:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654880128:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.623445:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc17f600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562541.623894:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17735 00000100:00100000:2.0:1786562541.623910:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652829312:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:2.0:1786562541.623944:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.623961:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 21 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.623969:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72e:0x0].0x0 since=1s v=(0 1) 00010000:00010000:2.0:1786562541.623972:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1786562541.623976:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.624002:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 21 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.624031:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 21 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.624043:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654880256:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.624080:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562541.625778:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.625819:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.625847:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.626406:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829440 00000100:00100000:3.0:1786562541.626420:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829440 00000100:00100000:3.0:1786562541.626679:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829568 00000100:00100000:3.0:1786562541.626683:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829568 00000100:00100000:3.0:1786562541.626711:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829696 00000100:00100000:3.0:1786562541.626714:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829696 00000100:00100000:3.0:1786562541.626739:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17736 00000100:00100000:3.0:1786562541.626750:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652829440:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562541.626807:0:29964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.626834:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 21 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.626846:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1786562541.626850:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562541.626856:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.626900:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 21 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.626914:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 21 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.626931:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654880384:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.627539:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17737 00000100:00100000:1.0:1786562541.627556:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652829568:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562541.627587:0:29966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.627604:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 29 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.627614:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.627623:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 12 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.627631:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1786562541.627634:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562541.627638:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627666:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17738 00010000:00010000:1.0:1786562541.627666:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 12 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627677:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652829696:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562541.627678:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 12 pid: 29964 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.627691:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654880512:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562541.627698:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627708:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627716:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627723:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627730:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627737:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 29 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627742:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000400:0x714:0x0].0x0 since=1s v=(5 10) 00010000:00010000:2.0:1786562541.627745:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 10) 00010000:00010000:2.0:1786562541.627748:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 8/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627769:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 29 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627778:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 29 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627788:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654880640:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.627800:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.627810:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627818:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 12 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.627820:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654880768:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562541.627828:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 12 pid: 37002 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627837:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654880896:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.627846:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 29 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.627855:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 29 pid: 29662 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627863:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.627865:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654881024:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562541.627872:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 12 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627881:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654881152:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.627884:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786562541.627906:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627915:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627925:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654881280:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562541.627958:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.627967:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.627975:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654881408:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.627994:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99829dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562541.633298:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.633329:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990558780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.635809:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829824 00000100:00100000:1.0:1786562541.635828:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829824 00000100:00100000:1.0:1786562541.635914:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17739 00000100:00100000:1.0:1786562541.635925:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652829824:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562541.635985:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636067:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 21 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636079:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 13 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636089:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 14 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636097:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636105:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 21 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636112:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x240000400:0x730:0x0].0x0 since=1s v=(5 6) 00010000:00010000:1.0:1786562541.636118:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(7 6) 00010000:00010000:1.0:1786562541.636123:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 8/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636169:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 21 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636201:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 21 pid: 29963 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.636219:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881536:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.636358:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636368:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.636377:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881664:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.636425:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 14 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636435:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 14 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.636444:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881792:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.636481:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 13 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636491:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 13 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.636501:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881920:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.636529:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 21 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.636539:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 21 pid: 29967 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.636549:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654882048:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.636575:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786562541.637607:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654880512:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.637624:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654880768:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.637690:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:29967:1873345654880128:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.637694:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345654880256:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.637718:0:29967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.637718:0:29965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.637750:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654880640:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.637761:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654880896:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.658810:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.658844:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.658949:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654881152:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.659001:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654881280:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.659066:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654881408:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562541.659112:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.659156:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.659224:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.659242:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.659257:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.659292:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830464 00000100:00100000:2.0:1786562541.659300:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830464 00010000:00010000:2.0:1786562541.659345:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 30 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.659377:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830208 00000100:00100000:2.0:1786562541.659380:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830208 00000100:00100000:0.0:1786562541.659524:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652829952 00000100:00100000:0.0:1786562541.659530:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652829952 00002000:00100000:0.0:1786562541.659575:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x711:0x0] (163840->987135) req@ffff90e88bf58380 x1873345652829952/t0(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.659586:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58380 with x1873345652829952 ext(163840->987135) 00010000:00010000:0.0:1786562541.659595:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 13 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.659610:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 13 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562541.659618:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf58380 00000100:00100000:0.0:1786562541.659635:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830080 00000100:00100000:0.0:1786562541.659638:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830080 00002000:00100000:0.0:1786562541.659654:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x72e:0x0] (1839104->2097151) req@ffff90e88bf58000 x1873345652830080/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.659662:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58000 with x1873345652830080 ext(1839104->2097151) 00010000:00010000:0.0:1786562541.659669:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 22 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.659679:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 22 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562541.659692:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88bf58000 00000100:00100000:0.0:1786562541.659712:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5981 00000100:00100000:0.0:1786562541.659723:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652829952:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562541.660203:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5982 00000100:00100000:0.0:1786562541.660214:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345652830080:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:3.0:1786562541.660845:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830592 00000100:00100000:3.0:1786562541.660852:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830592 00010000:00010000:3.0:1786562541.660885:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 15 pid: 29964 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.660998:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830848 00000100:00100000:3.0:1786562541.661002:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830848 00010000:00010000:3.0:1786562541.661037:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.661053:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8694 00000100:00100000:3.0:1786562541.661063:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652830464:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.661077:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.661107:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 30 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661122:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 30 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661155:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f134 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd49 expref: 30 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661192:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.661240:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652830464:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 178us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.661249:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8694 00000100:00100000:3.0:1786562541.661272:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8695 00000100:00100000:3.0:1786562541.661278:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652830592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.661290:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.661303:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 15 pid: 29964 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661315:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 15 pid: 29964 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661330:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ca9acc/0x5c655bf66689f0c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfccf5 expref: 15 pid: 29964 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661341:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.661360:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652830592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 82us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.661366:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8695 00000100:00100000:3.0:1786562541.661380:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8696 00000100:00100000:3.0:1786562541.661388:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652830848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.661580:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.661595:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661606:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.661622:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.661641:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652830848:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 254us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.661649:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8696 00010000:00010000:2.0:1786562541.662042:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 15 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.662081:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8697 00000100:00100000:2.0:1786562541.662092:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652830208:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.662104:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.662119:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 15 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.662129:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 15 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.662143:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2bca6ca/0x5c655bf66689f1dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdc7 expref: 15 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.662161:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.662195:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652830208:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 109us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.662202:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8697 00000100:00100000:2.0:1786562541.662334:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.662549:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654881024:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.662588:0:29966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.662623:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881792:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.662636:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069d5078/0x5c655bf66689f1ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdd5 expref: 13 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.662647:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881920:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562541.663266:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.663511:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830336 00000100:00100000:1.0:1786562541.663522:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830336 00010000:00010000:1.0:1786562541.663560:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 14 pid: 37002 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.663587:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830720 00000100:00100000:1.0:1786562541.663591:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830720 00010000:00010000:1.0:1786562541.663606:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 15 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.663630:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8698 00000100:00100000:1.0:1786562541.663639:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652830336:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.663651:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.663672:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 14 pid: 37002 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.663684:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 14 pid: 37002 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.663707:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ce0327b/0x5c655bf66689f0f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd26 expref: 14 pid: 37002 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.663724:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.663756:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2349:x1873345652830336:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 120us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.663763:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8698 00000100:00100000:1.0:1786562541.663780:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8699 00000100:00100000:1.0:1786562541.663786:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+15:2349:x1873345652830720:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.663795:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.663808:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 15 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.663817:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 15 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.663829:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000376ba8cd/0x5c655bf66689f16c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd65 expref: 15 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.663840:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.663855:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2349:x1873345652830720:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 71us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.663861:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8699 00000100:00100000:1.0:1786562541.663895:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881536:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.663904:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654881664:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562541.663911:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654882048:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562541.663939:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.664048:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654880384:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562541.664068:0:29964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.666720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.666888:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652830976 00000100:00100000:2.0:1786562541.666901:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652830976 00002000:00100000:2.0:1786562541.666961:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1552383) req@ffff90e9baa15180 x1873345652830976/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/0 e 0 to 0 dl 1786562552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562541.666973:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9baa15180 with x1873345652830976 ext(1048576->1552383) 00010000:00010000:2.0:1786562541.666984:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 24 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.667111:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 24 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.667122:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9baa15180 00000100:00100000:2.0:1786562541.667159:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5983 00000100:00100000:2.0:1786562541.667180:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652830976:12345-192.168.204.29@tcp:4:cat.0 00000100:00100000:0.0:1786562541.690071:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.694062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.694161:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.694209:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.694225:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.694239:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.694265:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.695136:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831104 00000100:00100000:1.0:1786562541.695136:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831232 00000100:00100000:2.0:1786562541.695152:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831104 00000100:00100000:1.0:1786562541.695152:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831232 00010000:00010000:2.0:1786562541.695231:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 13 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.695271:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831360 00000100:00100000:2.0:1786562541.695274:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831360 00000100:00100000:0.0:1786562541.697089:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831488 00000100:00100000:0.0:1786562541.697107:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831488 00000100:00100000:3.0:1786562541.700388:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831616 00000100:00100000:3.0:1786562541.700411:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831616 00010000:00010000:3.0:1786562541.703903:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 26 pid: 29967 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.703968:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831744 00000100:00100000:3.0:1786562541.703980:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831744 00010000:00010000:3.0:1786562541.704047:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.704062:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652831872 00000100:00100000:3.0:1786562541.704066:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652831872 00010000:00010000:3.0:1786562541.704081:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 27 pid: 29963 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.704106:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8700 00000100:00100000:3.0:1786562541.704119:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2351:x1873345652831104:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.704141:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.704191:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 13 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704209:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 13 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704241:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbb2940/0x5c655bf66689f18f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5181440->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd88 expref: 13 pid: 29964 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704267:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.704356:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2351:x1873345652831104:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 240us (10307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.704366:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8700 00000100:00100000:3.0:1786562541.704404:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8701 00000100:00100000:3.0:1786562541.704411:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652831616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.704422:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.704573:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 27 pid: 29967 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704585:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 27 pid: 29967 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704602:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d373189/0x5c655bf66689f165 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd5e expref: 27 pid: 29967 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704614:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.704635:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652831616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 226us (10409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.704642:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8701 00000100:00100000:3.0:1786562541.704657:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8702 00000100:00100000:3.0:1786562541.704663:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+14:2350:x1873345652831744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.704671:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.704679:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704689:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704704:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf66689f11f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd3b expref: 14 pid: 12119 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704713:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.704730:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+13:2350:x1873345652831744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 68us (10490us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.704737:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8702 00000100:00100000:3.0:1786562541.704750:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8703 00000100:00100000:3.0:1786562541.704759:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652831872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.704766:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.704774:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 25 pid: 29963 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704784:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 25 pid: 29963 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704797:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000950187ba/0x5c655bf66689f13b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd50 expref: 25 pid: 29963 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704808:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(7 6) 00010000:00010000:3.0:1786562541.704813:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(7 6) 00010000:00010000:3.0:1786562541.704820:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704830:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.704863:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.704882:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652831872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 124us (10616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.704889:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8703 00010000:00010000:1.0:1786562541.706643:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 30 pid: 29662 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.707071:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8704 00000100:00100000:1.0:1786562541.707094:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:2349:x1873345652831232:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.707119:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.707151:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 30 pid: 29662 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.707182:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 30 pid: 29662 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.707213:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f0af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcce0 expref: 30 pid: 29662 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.707235:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562541.707240:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562541.707247:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.707260:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.707296:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562541.707411:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 29 pid: 29966 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.710867:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.712301:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652831232:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5205us (22232us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.712317:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8704 00000100:00100000:1.0:1786562541.712376:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8705 00000100:00100000:1.0:1786562541.712393:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345652831360:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.712415:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.712671:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 28 pid: 29966 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712691:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 28 pid: 29966 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712721:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f17a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd73 expref: 28 pid: 29966 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712743:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.712769:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652831360:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 384us (18607us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.712776:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8705 00000100:00100000:1.0:1786562541.712833:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8706 00000100:00100000:1.0:1786562541.712842:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652831488:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.712850:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.712860:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712873:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712891:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014b80c75/0x5c655bf66689f1e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdce expref: 14 pid: 6659 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712903:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 10) 00010000:00010000:1.0:1786562541.712908:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(7 10) 00010000:00010000:1.0:1786562541.712916:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712925:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.712976:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.712995:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652831488:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 155us (18785us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.713002:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8706 00010000:00010000:1.0:1786562541.713195:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713206:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713238:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713247:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713257:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713266:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562541.713272:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713281:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713296:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713304:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf8cb1f/0x5c655bf66689f25a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.713362:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652829824:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 77438us (80081us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.713385:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17739 00010000:00010000:1.0:1786562541.713416:0:29966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713435:0:29966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713647:0:29966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713655:0:29966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713663:0:29966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713670:0:29966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562541.713673:0:29966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713682:0:29966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713693:0:29966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.713700:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f24c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.713745:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652829568:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 86195us (87924us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.713755:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17737 00000100:00100000:2.0:1786562541.713907:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652830976:12345-192.168.204.29@tcp:4:cat.0 Request processed in 46736us (47198us total) trans 21474843574 rc 0/0 00000100:00100000:2.0:1786562541.713919:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5983 00002000:00100000:2.0:1786562541.713932:0:16006:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x72f:0x0] (1048576->1552383) req@ffff90e9baa15180 x1873345652830976/t21474843574(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/448 e 0 to 0 dl 1786562552 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562541.713943:0:16006:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9baa15180 with x1873345652830976 ext(1048576->1552383) 00010000:00010000:2.0:1786562541.713953:0:16006:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 25 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.713967:0:16006:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 25 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.713976:0:16006:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e9baa15180 00010000:00010000:2.0:1786562541.714032:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714043:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714069:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714078:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714087:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714093:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1a400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562541.714096:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714103:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714115:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.714121:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008022f8e4/0x5c655bf66689f253 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.714159:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652829696:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 86485us (88310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.714166:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17738 00000100:00100000:0.0:1786562541.720920:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345652830080:12345-192.168.204.29@tcp:4:cat.0 Request processed in 60688us (62054us total) trans 21474843575 rc 0/0 00000100:00100000:0.0:1786562541.720942:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5982 00002000:00100000:0.0:1786562541.720964:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x72e:0x0] (1839104->2097151) req@ffff90e88bf58000 x1873345652830080/t21474843575(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:12/0 lens 488/448 e 0 to 0 dl 1786562552 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562541.720976:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58000 with x1873345652830080 ext(1839104->2097151) 00010000:00010000:0.0:1786562541.720992:0:13965:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 24 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.721034:0:13965:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 24 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562541.721044:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e88bf58000 00000100:00100000:2.0:1786562541.722905:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.723967:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652832000 00000100:00100000:3.0:1786562541.723984:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652832000 00010000:00010000:3.0:1786562541.724277:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 24 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.724331:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8707 00000100:00100000:3.0:1786562541.724342:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652832000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.724363:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.724399:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 24 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.724414:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 24 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.724454:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000854a751/0x5c655bf66689f1a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd96 expref: 24 pid: 8368 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.724476:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562541.724481:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562541.724488:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.724499:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.724543:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.725376:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652829952:12345-192.168.204.29@tcp:4:cat.0 Request processed in 65647us (66575us total) trans 17179876054 rc 0/0 00000100:00100000:1.0:1786562541.725391:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5981 00002000:00100000:1.0:1786562541.725407:0:16007:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x711:0x0] (163840->987135) req@ffff90e88bf58380 x1873345652829952/t17179876054(0) o4->b3dc1ca5-a8ed-4b97-b774-56a52e1a472d@192.168.204.29@tcp:12/0 lens 488/448 e 0 to 0 dl 1786562552 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562541.725419:0:16007:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88bf58380 with x1873345652829952 ext(163840->987135) 00010000:00010000:1.0:1786562541.725429:0:16007:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.725444:0:16007:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562541.725452:0:16007:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90e88bf58380 00000100:00100000:3.0:1786562541.725642:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652832000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1301us (2752us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.725651:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8707 00010000:00010000:2.0:1786562541.725841:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725854:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725892:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725901:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725910:0:29964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725918:0:29964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99261c400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562541.725924:0:29964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725936:0:29964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725959:0:29964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.725968:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a97b96b/0x5c655bf66689f245 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.726056:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652829440:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 99309us (100290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.726067:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17736 00000100:00100000:2.0:1786562541.733984:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.734091:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.734186:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652832128 00000100:00100000:3.0:1786562541.734200:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652832128 00010000:00010000:3.0:1786562541.734261:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 23 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.734315:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652832256 00000100:00100000:3.0:1786562541.734319:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652832256 00010000:00010000:3.0:1786562541.734337:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.734379:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8708 00000100:00100000:3.0:1786562541.734391:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345652832128:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.734411:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.734454:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 23 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734471:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 23 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734503:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f188 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd81 expref: 23 pid: 6660 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734524:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562541.734530:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562541.734538:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734569:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734601:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.734669:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345652832128:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 279us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.734678:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8708 00000100:00100000:3.0:1786562541.734698:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8709 00000100:00100000:3.0:1786562541.734705:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652832256:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562541.734714:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562541.734731:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734743:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734760:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 163840->987135) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcd6c expref: 12 pid: 6658 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734772:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562541.734775:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1786562541.734779:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734793:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734812:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562541.734830:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652832256:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 125us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.734836:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8709 00010000:00010000:3.0:1786562541.734893:0:29967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734903:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734935:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734943:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734952:0:29967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734960:0:29967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99261de00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562541.734965:0:29967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734982:0:29967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.734994:0:29967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.735029:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.735086:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652829184:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 111990us (112302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.735097:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17734 00010000:00010000:2.0:1786562541.736137:0:29965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736154:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736198:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736207:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736215:0:29965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736222:0:29965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1a800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562541.736226:0:29965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736235:0:29965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736254:0:29965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.736262:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a70f39e/0x5c655bf66689f23e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.736346:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2348:x1873345652829312:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 112438us (113489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.736356:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17735 00000100:00100000:2.0:1786562541.743409:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.743573:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652832512 00000100:00100000:3.0:1786562541.743587:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652832512 00000100:00100000:3.0:1786562541.743661:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17115 00000100:00100000:3.0:1786562541.743680:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652832512:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562541.743759:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786562541.743797:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689ecf0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcab7 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743826:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfe39800/0x5c655bf66689eccd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcab0 expref: 10 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743838:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562541.743844:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562541.743893:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743911:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743920:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743927:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743934:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743942:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743951:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 508 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.743961:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744062:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 508 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744078:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 508 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.744102:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882176:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.744226:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744236:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 10 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.744246:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882304:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.744279:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744288:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 10 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.744298:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882432:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.744324:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744333:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 10 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.744342:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882560:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.744363:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744378:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.744386:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882688:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.744411:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 10 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.744418:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 10 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.744427:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882816:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.744462:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990558b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562541.752117:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.752148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.752204:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.752324:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833024 00000100:00100000:3.0:1786562541.752337:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833024 00000100:00100000:3.0:1786562541.752426:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6286 00000100:00100000:3.0:1786562541.752448:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9c2065850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:49279:x1873345652833024:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786562541.752797:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9c2065850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:49279:x1873345652833024:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 361us (590us total) trans 8589950667 rc 0/0 00000100:00100000:3.0:1786562541.752806:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6286 00000100:00100000:3.0:1786562541.752906:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882176:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.752919:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882304:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.752928:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882432:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.752937:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882560:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.752946:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882688:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562541.752954:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654882816:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562541.752993:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.754271:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652832768 00000100:00100000:2.0:1786562541.754288:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652832768 00010000:00010000:2.0:1786562541.754347:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 12 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.754402:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652832640 00000100:00100000:2.0:1786562541.754406:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652832640 00010000:00010000:2.0:1786562541.754423:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 509 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.754459:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8710 00000100:00100000:2.0:1786562541.754470:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+12:2349:x1873345652832768:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.754488:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.754496:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 12 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754515:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 12 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754544:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515200/0x5c655bf66689e556 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc62d expref: 12 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754745:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.754753:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754765:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.754829:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652832768:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 360us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.754838:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8710 00000100:00100000:2.0:1786562541.754858:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8711 00000100:00100000:2.0:1786562541.754865:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+509:2349:x1873345652832640:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562541.754873:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562541.754878:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 509 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754889:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 509 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754904:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f800/0x5c655bf66689ea26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc905 expref: 509 pid: 35929 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754921:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.754925:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.754931:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562541.754948:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+508:2349:x1873345652832640:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 84us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.754956:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8711 00000100:00100000:1.0:1786562541.762798:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.762881:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.762968:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.763107:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833280 00000100:00100000:0.0:1786562541.763120:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833280 00010000:00010000:0.0:1786562541.763201:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.763249:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833536 00000100:00100000:0.0:1786562541.763252:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833536 00010000:00010000:0.0:1786562541.763270:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.763301:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8712 00000100:00100000:0.0:1786562541.763314:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+508:2349:x1873345652833280:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562541.763335:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562541.763343:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763359:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763404:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf66689e445 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc585 expref: 508 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763429:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562541.763445:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763456:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562541.763526:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+507:2349:x1873345652833280:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 213us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.763534:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8712 00000100:00100000:0.0:1786562541.763566:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8713 00000100:00100000:0.0:1786562541.763573:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652833536:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562541.763582:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562541.763587:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763599:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763617:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689e63d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc6ab expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763628:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562541.763633:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.763639:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562541.763660:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652833536:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 87us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.763680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8713 00000100:00100000:1.0:1786562541.766188:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.766295:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833152 00000100:00100000:0.0:1786562541.766308:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833152 00010000:00010000:0.0:1786562541.766360:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 10 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.766416:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833408 00000100:00100000:0.0:1786562541.766420:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833408 00010000:00010000:0.0:1786562541.766444:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562541.766468:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8714 00000100:00100000:0.0:1786562541.766479:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652833152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562541.766500:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562541.766507:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 11 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.766525:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 11 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562541.766661:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8715 00000100:00100000:1.0:1786562541.766672:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+11:2349:x1873345652833408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562541.766681:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562541.766687:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.766703:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.766717:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1000/0x5c655bf66689e40d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc562 expref: 11 pid: 33140 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.766741:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562541.766747:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.766759:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.766767:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.766799:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562541.766867:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+10:2349:x1873345652833408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 197us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562541.766875:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8715 00010000:00010000:0.0:1786562541.767164:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf66689e44c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc58c expref: 9 pid: 33113 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.767188:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562541.767191:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562541.767225:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+8:2349:x1873345652833152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 748us (4256us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.767233:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8714 00010000:00010000:3.0:1786562541.767330:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.767341:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562541.769430:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4388, 88 off356392 00000004:00080000:3.0:1786562541.769454:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211447325ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769575:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4364, 88 off354104 00000004:00080000:3.0:1786562541.769582:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211576192ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769613:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4365, 88 off354192 00000004:00080000:3.0:1786562541.769617:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211611378ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769634:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4389, 88 off356480 00000004:00080000:3.0:1786562541.769638:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211631962ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769652:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4390, 88 off356568 00000004:00080000:3.0:1786562541.769656:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211650435ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769672:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4366, 88 off354280 00000004:00080000:3.0:1786562541.769676:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211670397ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769691:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4367, 88 off354368 00000004:00080000:3.0:1786562541.769695:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211689238ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769711:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4368, 88 off354456 00000004:00080000:3.0:1786562541.769716:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211710290ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769733:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4391, 88 off356656 00000004:00080000:3.0:1786562541.769737:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211731052ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769753:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4369, 88 off354544 00000004:00080000:3.0:1786562541.769757:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211751645ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769773:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4392, 88 off356744 00000004:00080000:3.0:1786562541.769777:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211771128ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769794:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4370, 88 off354632 00000004:00080000:3.0:1786562541.769798:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211792350ns, next at 911624464511ns, rc = 0 00000040:00080000:3.0:1786562541.769814:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4393, 88 off356832 00000004:00080000:3.0:1786562541.769818:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211812150ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769832:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4394, 88 off356920 00000004:00080000:3.0:1786562541.769836:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211830200ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769856:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4395, 88 off357008 00000004:00080000:3.0:1786562541.769860:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211854052ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769878:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4396, 88 off357096 00000004:00080000:3.0:1786562541.769883:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 974211876872ns, next at 911624567946ns, rc = 0 00000040:00080000:3.0:1786562541.769900:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4371, 88 off354720 00000004:00080000:3.0:1786562541.769903:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 974211897572ns, next at 911624464511ns, rc = 0 00000001:00080000:1.0:1786562541.814043:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950662 is committed 00000001:00080000:1.0:1786562541.814068:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950665 is committed 00000001:00080000:1.0:1786562541.814080:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950666 is committed 00000001:00080000:1.0:1786562541.814088:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950668 is committed 00000004:00080000:1.0:1786562541.814095:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2879 committed 00000004:00080000:1.0:1786562541.814151:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2906 committed 00000004:00080000:1.0:1786562541.814165:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2905 committed 00000004:00080000:1.0:1786562541.814179:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2904 committed 00000004:00080000:1.0:1786562541.814183:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2903 committed 00000004:00080000:1.0:1786562541.814186:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2878 committed 00000004:00010000:2.0:1786562541.814612:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006be8602c reply state 000000004c5dc529 transno 8589950668 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562541.814632:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786562541.814800:0:33115:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1786562541.814825:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64168:x1873345652832512:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 71140us (71438us total) trans 8589950668 rc 0/0 00000100:00100000:2.0:1786562541.814836:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17115 00000100:00100000:3.0:1786562541.818417:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654883072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.818534:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.818991:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654883584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.819061:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786562541.819261:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2902 committed 00000004:00080000:1.0:1786562541.819267:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2877 committed 00000004:00080000:1.0:1786562541.819270:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2901 committed 00000004:00080000:1.0:1786562541.819273:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2876 committed 00000004:00080000:1.0:1786562541.819276:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2875 committed 00000004:00080000:1.0:1786562541.819278:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2874 committed 00000004:00080000:1.0:1786562541.819281:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2900 committed 00000004:00080000:1.0:1786562541.819283:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2899 committed 00000004:00080000:1.0:1786562541.819285:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2873 committed 00000004:00080000:1.0:1786562541.819288:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2872 committed 00000004:00080000:1.0:1786562541.819290:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2898 committed 00000001:00080000:1.0:1786562541.819326:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950667 is committed 00000001:00080000:1.0:1786562541.819339:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950663 is committed 00000100:00100000:1.0:1786562541.819382:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654882944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562541.819426:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654883328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562541.819470:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654883200:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1786562541.819514:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.819526:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.819536:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.819543:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9ba9d9a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562541.819719:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.819732:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.819755:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562541.819759:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562541.819766:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562541.819774:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9a00/0x5c655bf66689f261 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562541.821148:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562541.821267:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883072 00000100:00100000:0.0:1786562541.821279:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883072 00000100:00100000:0.0:1786562541.821679:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883584 00000100:00100000:0.0:1786562541.821684:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883584 00000100:00100000:0.0:1786562541.821705:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17740 00000100:00100000:0.0:1786562541.821716:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654883072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562541.822074:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654883072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 359us (3540us total) trans 17179876055 rc 0/0 00000100:00100000:0.0:1786562541.822082:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17740 00000100:00100000:0.0:1786562541.822100:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17741 00000100:00100000:0.0:1786562541.822107:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654883584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562541.822269:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562541.822273:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562541.822276:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562541.822279:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562541.822282:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562541.822313:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654883584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (3251us total) trans 17179876056 rc 0/0 00000100:00100000:0.0:1786562541.822320:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17741 00000100:00100000:3.0:1786562541.822480:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654883840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.822524:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822546:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654884352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.822718:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822736:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654884864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.822752:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822798:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822818:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654883456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.822837:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822851:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654883968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.822866:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822879:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654884480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.822895:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.822922:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883328 00000100:00100000:3.0:1786562541.822928:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883328 00000100:00100000:3.0:1786562541.822958:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883840 00000100:00100000:3.0:1786562541.822960:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883840 00000100:00100000:3.0:1786562541.822975:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884352 00000100:00100000:3.0:1786562541.822977:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884352 00000100:00100000:0.0:1786562541.823038:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884864 00000100:00100000:0.0:1786562541.823042:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884864 00000100:00100000:0.0:1786562541.823062:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654882944 00000100:00100000:0.0:1786562541.823064:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654882944 00000100:00100000:0.0:1786562541.823075:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883456 00000100:00100000:0.0:1786562541.823077:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883456 00000100:00100000:0.0:1786562541.823086:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883968 00000100:00100000:0.0:1786562541.823089:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883968 00000100:00100000:0.0:1786562541.823098:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884480 00000100:00100000:0.0:1786562541.823100:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884480 00000100:00100000:0.0:1786562541.823112:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17742 00000100:00100000:0.0:1786562541.823119:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3289:x1873345654883328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562541.823297:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562541.823301:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562541.823303:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562541.823305:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562541.823308:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562541.823352:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3289:x1873345654883328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (2211us total) trans 17179876057 rc 0/0 00000100:00100000:0.0:1786562541.823358:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17742 00000100:00100000:0.0:1786562541.823390:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17743 00000100:00100000:0.0:1786562541.823397:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3289:x1873345654883840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562541.823521:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:0.0:1786562541.823525:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562541.823526:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562541.823529:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562541.823531:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:0.0:1786562541.824298:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3289:x1873345654883840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 898us (1769us total) trans 17179876058 rc 0/0 00000100:00100000:0.0:1786562541.824309:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17743 00000100:00100000:0.0:1786562541.824335:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17744 00000100:00100000:0.0:1786562541.824346:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654884864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562541.824726:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562541.824730:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562541.824732:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562541.824734:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:0.0:1786562541.824736:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562541.824780:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654884864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 437us (2026us total) trans 21474843576 rc 0/0 00000100:00100000:0.0:1786562541.824786:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17744 00000100:00100000:0.0:1786562541.824801:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17745 00000100:00100000:0.0:1786562541.824808:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3290:x1873345654882944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562541.824944:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3290:x1873345654882944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (2155us total) trans 17179876059 rc 0/0 00000100:00100000:0.0:1786562541.824951:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17745 00000100:00100000:0.0:1786562541.824964:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17746 00000100:00100000:0.0:1786562541.824970:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3290:x1873345654883456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562541.825106:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562541.825110:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562541.825112:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562541.825114:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562541.825116:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562541.825143:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3290:x1873345654883456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (2305us total) trans 17179876060 rc 0/0 00000100:00100000:0.0:1786562541.825150:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17746 00000100:00100000:0.0:1786562541.825166:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17747 00000100:00100000:0.0:1786562541.825187:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654883968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562541.825833:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3290:x1873345654883968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 645us (2962us total) trans 21474843577 rc 0/0 00000100:00100000:0.0:1786562541.825841:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17747 00000100:00100000:0.0:1786562541.825861:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17748 00000100:00100000:0.0:1786562541.825870:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654884480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562541.826048:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562541.826052:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562541.826054:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562541.826056:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:0.0:1786562541.826059:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562541.826090:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3290:x1873345654884480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (3193us total) trans 21474843578 rc 0/0 00000100:00100000:0.0:1786562541.826098:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17748 00000004:00080000:1.0:1786562541.826322:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa17b80/2, rc 0, transno 17179876056 00000100:00100000:1.0:1786562541.826339:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654883584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562541.826355:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654884096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562541.826418:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562541.826461:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654884608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562541.826484:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786562541.826521:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa16300/2, rc 0, transno 17179876055 00000100:00100000:1.0:1786562541.826527:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654883072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562541.826546:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884096 00000100:00100000:1.0:1786562541.826749:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884096 00000100:00100000:1.0:1786562541.826794:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884608 00000100:00100000:1.0:1786562541.826797:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884608 00000100:00100000:1.0:1786562541.826816:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17749 00000100:00100000:1.0:1786562541.826823:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1873345654884096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562541.827037:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1873345654884096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (618us total) trans 21474843579 rc 0/0 00000100:00100000:1.0:1786562541.827047:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17749 00000100:00100000:1.0:1786562541.827065:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17750 00000100:00100000:1.0:1786562541.827072:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1873345654884608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562541.827207:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562541.827210:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:1.0:1786562541.827213:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562541.827215:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:1.0:1786562541.827218:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562541.827244:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1873345654884608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (758us total) trans 21474843580 rc 0/0 00000100:00100000:1.0:1786562541.827250:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17750 00000004:00080000:1.0:1786562541.827298:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5e680/2, rc 0, transno 21474843579 00000100:00100000:1.0:1786562541.827304:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654884096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562541.827312:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5ca80/2, rc 0, transno 21474843580 00000100:00100000:1.0:1786562541.827315:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654884608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562541.828081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:2.0:1786562541.828771:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562541.828802:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833664 00000100:00100000:2.0:1786562541.828812:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833664 00000100:00100000:2.0:1786562541.828886:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17116 00000100:00100000:2.0:1786562541.828899:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:64168:x1873345652833664:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.828929:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.828972:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcdff expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.829080:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.829106:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.829132:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562541.829136:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562541.829142:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1a400, rc 0) 00000100:00100000:2.0:1786562541.829223:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64168:x1873345652833664:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 326us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.829230:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17116 00000100:00080000:2.0:1786562541.829255:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562541.834415:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17751 00000100:00100000:3.0:1786562541.834448:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3289:x1873345654884352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562541.834874:0:28862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562541.834880:0:28862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562526 -> 1786562526 00002000:00010000:3.0:1786562541.834883:0:28862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562541.834886:0:28862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 1786562526 -> 1786562526 00002000:00010000:3.0:1786562541.834889:0:28862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562541.834999:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3289:x1873345654884352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 569us (12279us total) trans 21474843581 rc 0/0 00000100:00100000:3.0:1786562541.835050:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17751 00000004:00080000:3.0:1786562541.835186:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa17800/2, rc 0, transno 17179876057 00000100:00100000:3.0:1786562541.835196:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654883328:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.835214:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa15c00/2, rc 0, transno 17179876058 00000100:00100000:3.0:1786562541.835219:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654883840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.835232:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5f800/2, rc 0, transno 21474843581 00000100:00100000:3.0:1786562541.835238:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654884352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562541.835250:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5d180/2, rc 0, transno 21474843576 00000100:00100000:3.0:1786562541.835254:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654884864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.835270:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562541.835284:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654884992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.835333:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786562541.835390:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa17100/2, rc 0, transno 17179876059 00000100:00100000:3.0:1786562541.835394:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654882944:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.835405:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa15500/2, rc 0, transno 17179876060 00000100:00100000:3.0:1786562541.835409:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654883456:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.835419:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5f100/2, rc 0, transno 21474843577 00000100:00100000:3.0:1786562541.835422:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654883968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562541.835430:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5ce00/2, rc 0, transno 21474843578 00000100:00100000:3.0:1786562541.835433:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654884480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.835454:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.835478:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654883712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.835502:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.835522:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654884224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.835545:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.835565:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654884736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.835586:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562541.835619:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884992 00000100:00100000:3.0:1786562541.835627:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884992 00000100:00100000:3.0:1786562541.835660:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883200 00000100:00100000:3.0:1786562541.835662:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883200 00000100:00100000:3.0:1786562541.835694:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654883712 00000100:00100000:3.0:1786562541.835697:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654883712 00000100:00100000:3.0:1786562541.835713:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884224 00000100:00100000:3.0:1786562541.835716:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884224 00000100:00100000:3.0:1786562541.835729:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654884736 00000100:00100000:3.0:1786562541.835731:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654884736 00000100:00100000:3.0:1786562541.835746:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17752 00000100:00100000:3.0:1786562541.835754:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654884992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562541.835986:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562541.835990:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562541.835993:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562541.835995:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562541.835998:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:3.0:1786562541.836067:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3289:x1873345654884992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (734us total) trans 17179876061 rc 0/0 00000100:00100000:3.0:1786562541.836075:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17752 00000100:00100000:3.0:1786562541.836092:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17753 00000100:00100000:3.0:1786562541.836100:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654883200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562541.836226:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654883200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (769us total) trans 17179876062 rc 0/0 00000100:00100000:3.0:1786562541.836233:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17753 00000100:00100000:3.0:1786562541.836393:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17754 00000100:00100000:3.0:1786562541.836400:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654883712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562541.836508:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562541.836511:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562541.836514:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562541.836516:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562541.836518:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:3.0:1786562541.836544:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654883712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (1041us total) trans 17179876063 rc 0/0 00000100:00100000:3.0:1786562541.836551:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17754 00000100:00100000:3.0:1786562541.836565:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17755 00000100:00100000:3.0:1786562541.836572:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654884224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562541.836704:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654884224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (1157us total) trans 21474843582 rc 0/0 00000100:00100000:3.0:1786562541.836711:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17755 00000100:00100000:3.0:1786562541.836723:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17756 00000100:00100000:3.0:1786562541.836731:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654884736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562541.836846:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562541.836850:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562541.836852:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562541.836854:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562527 -> 1786562527 00002000:00010000:3.0:1786562541.836857:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:3.0:1786562541.836885:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654884736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (1298us total) trans 21474843583 rc 0/0 00000100:00100000:3.0:1786562541.836892:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17756 00000100:00100000:1.0:1786562541.837660:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.837886:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833792 00000100:00100000:0.0:1786562541.837897:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833792 00000100:00100000:0.0:1786562541.837965:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17117 00000100:00100000:0.0:1786562541.837976:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64168:x1873345652833792:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562541.837998:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562541.838055:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f000/0x5c655bf66689f26f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce06 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.838163:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689f276 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.838193:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689f276 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.838208:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689f276 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562541.838243:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 16777217 00000004:00200000:0.0:1786562541.838248:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562541.838272:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689f276 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.838304:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26f000/0x5c655bf66689f26f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce06 expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.838325:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689f276 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce06 expref: 9 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562541.838335:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562541.838339:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562541.838343:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e88a26e600, rc 0) 00000100:00100000:0.0:1786562541.838417:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64168:x1873345652833792:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 443us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562541.838429:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17117 00000004:00080000:3.0:1786562541.843987:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa14a80/2, rc 0, transno 17179876061 00000100:00100000:3.0:1786562541.844044:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654884992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.844085:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa15f80/2, rc 0, transno 17179876062 00000100:00100000:3.0:1786562541.844090:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654883200:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.844100:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa16a00/2, rc 0, transno 17179876063 00000100:00100000:3.0:1786562541.844103:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654883712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562541.844118:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5df80/2, rc 0, transno 21474843582 00000100:00100000:3.0:1786562541.844122:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654884224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562541.844132:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5c380/2, rc 0, transno 21474843583 00000100:00100000:3.0:1786562541.844136:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654884736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562541.844290:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.844391:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.844824:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652833920 00000100:00100000:3.0:1786562541.844835:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652833920 00000100:00100000:3.0:1786562541.844904:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834048 00000100:00100000:3.0:1786562541.844908:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834048 00000100:00100000:3.0:1786562541.844938:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17757 00000100:00100000:3.0:1786562541.844948:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652833920:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562541.844974:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.845026:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce0d expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562541.845067:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x711:0x0] initial LVB size: 1048576, mtime: 0x6a7cc7ec, atime: 0x6a7cc7e8, ctime: 0x6a7cc7ec, blocks: 0x807 00010000:00010000:3.0:1786562541.845098:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=974s v=(0 0) 00010000:00010000:3.0:1786562541.845103:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562541.845117:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.845144:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.845160:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9c00, rc 0) 00000100:00100000:3.0:1786562541.845242:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652833920:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 294us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562541.845250:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17757 00000100:00100000:3.0:1786562541.845270:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17758 00000100:00100000:3.0:1786562541.845278:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2351:x1873345652834048:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562541.845285:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562541.845298:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce14 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562541.845316:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72e:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7e9, ctime: 0x6a7cc7ec, blocks: 0x809 00010000:00010000:3.0:1786562541.845327:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=974s v=(0 0) 00010000:00010000:3.0:1786562541.845330:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562541.845336:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.845348:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562541.845357:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9ba9d9a00, rc 0) 00000100:00100000:1.0:1786562541.851312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.851351:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.851389:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.851414:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562541.851672:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834176 00000100:00100000:3.0:1786562541.851687:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834176 00000100:00100000:3.0:1786562541.851763:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834432 00000100:00100000:3.0:1786562541.851767:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834432 00000100:00100000:3.0:1786562541.851790:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834304 00000100:00100000:3.0:1786562541.851793:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834304 00000100:00100000:3.0:1786562541.851811:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834560 00000100:00100000:3.0:1786562541.851814:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834560 00000100:00100000:2.0:1786562541.852029:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652834048:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6747us (7632us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.852041:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17758 00000100:00100000:2.0:1786562541.852075:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17759 00000100:00100000:2.0:1786562541.852086:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652834176:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.852114:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.852145:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce1b expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.852194:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72f:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7eb, ctime: 0x6a7cc7ec, blocks: 0x807 00010000:00010000:2.0:1786562541.852226:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=974s v=(0 0) 00010000:00010000:2.0:1786562541.852232:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562541.852245:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852271:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852289:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1ac00, rc 0) 00000100:00100000:2.0:1786562541.852348:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652834176:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 265us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.852355:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17759 00000100:00100000:2.0:1786562541.852369:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17760 00000100:00100000:2.0:1786562541.852389:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652834432:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.852398:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.852412:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce29 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.852431:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x714:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ec, blocks: 0x1807 00010000:00010000:2.0:1786562541.852456:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=974s v=(0 0) 00010000:00010000:2.0:1786562541.852460:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562541.852466:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852479:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852488:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1ba00, rc 0) 00000100:00100000:2.0:1786562541.852510:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652834432:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 136us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.852516:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17760 00000100:00100000:2.0:1786562541.852530:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17761 00000100:00100000:2.0:1786562541.852536:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652834304:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.852543:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.852566:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce22 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.852582:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x713:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7eb, atime: 0x6a7cc7ea, ctime: 0x6a7cc7eb, blocks: 0x809 00010000:00010000:2.0:1786562541.852591:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=974s v=(0 0) 00010000:00010000:2.0:1786562541.852594:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562541.852600:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852610:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852618:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1bc00, rc 0) 00000100:00100000:2.0:1786562541.852638:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652834304:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 103us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.852644:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17761 00000100:00100000:2.0:1786562541.852657:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17762 00000100:00100000:2.0:1786562541.852664:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652834560:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562541.852672:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562541.852685:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce30 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562541.852699:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x730:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ec, blocks: 0x1007 00010000:00010000:2.0:1786562541.852707:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=974s v=(0 0) 00010000:00010000:2.0:1786562541.852710:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562541.852716:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852725:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 13 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562541.852734:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1a600, rc 0) 00000100:00100000:2.0:1786562541.852752:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652834560:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 89us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562541.852758:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17762 00000100:00100000:1.0:1786562541.910450:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.911042:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834688 00000100:00100000:2.0:1786562541.911056:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834688 00000100:00100000:2.0:1786562541.911143:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17763 00000100:00100000:2.0:1786562541.911156:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652834688:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:2.0:1786562541.912288:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562541.912402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562541.912807:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834816 00000100:00100000:0.0:1786562541.912818:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834816 00000100:00100000:0.0:1786562541.912881:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652834944 00000100:00100000:0.0:1786562541.912884:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652834944 00000100:00100000:0.0:1786562541.912908:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17764 00000100:00100000:0.0:1786562541.912919:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652834816:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562541.914882:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17765 00000100:00100000:3.0:1786562541.914906:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652834944:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:1.0:1786562541.935698:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.935755:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.935790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562541.935848:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835200 00000100:00100000:1.0:1786562541.935863:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835200 00000100:00100000:1.0:1786562541.935924:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835072 00000100:00100000:1.0:1786562541.935927:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835072 00000100:00100000:1.0:1786562541.935945:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835328 00000100:00100000:1.0:1786562541.935950:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835328 00000100:00100000:1.0:1786562541.935974:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17766 00000100:00100000:1.0:1786562541.935986:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652835200:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:2.0:1786562541.936062:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17767 00000100:00100000:2.0:1786562541.936072:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652835072:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:1.0:1786562541.936211:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17768 00000100:00100000:1.0:1786562541.936219:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652835328:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:1.0:1786562542.119283:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876060 is committed 00000001:00080000:1.0:1786562542.119316:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876054 is committed 00000001:00080000:1.0:1786562542.119332:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876052 is committed 00000001:00080000:1.0:1786562542.119345:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876063 is committed 00000001:00080000:1.0:1786562542.147283:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843578 is committed 00000001:00080000:1.0:1786562542.147305:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843575 is committed 00000001:00080000:1.0:1786562542.147317:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843580 is committed 00000001:00080000:1.0:1786562542.147327:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843573 is committed 00000001:00080000:1.0:1786562542.147347:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843583 is committed 00000100:00100000:2.0:1786562542.156209:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652834688:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 245044us (245771us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562542.156228:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17763 00000100:00100000:3.0:1786562542.160493:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652835072:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 224403us (224718us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.160522:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17767 00000100:00100000:2.0:1786562542.166135:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835200:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 226911us (227219us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562542.166154:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17766 00000100:00100000:1.0:1786562542.166307:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652835328:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 230078us (230507us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562542.166323:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17768 00000100:00100000:2.0:1786562542.166342:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652834944:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 251441us (253935us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562542.166353:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17765 00000100:00100000:3.0:1786562542.166745:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652834816:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 253825us (254462us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.166755:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17764 00000100:00100000:2.0:1786562542.193339:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562542.193441:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562542.207454:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835456 00000100:00100000:0.0:1786562542.207476:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835456 00000100:00100000:3.0:1786562542.207723:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835584 00000100:00100000:3.0:1786562542.207738:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835584 00000100:00100000:3.0:1786562542.207855:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17769 00000100:00100000:3.0:1786562542.207875:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835584:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562542.208253:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835584:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 384us (14809us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.208273:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17769 00000100:00100000:0.0:1786562542.209759:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17770 00000100:00100000:0.0:1786562542.209774:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835456:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:1.0:1786562542.213567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.213689:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835712 00000100:00100000:3.0:1786562542.213709:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835712 00000100:00100000:3.0:1786562542.213794:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17771 00000100:00100000:3.0:1786562542.213808:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835712:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562542.214001:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835712:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 196us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.214038:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17771 00000100:00100000:1.0:1786562542.218517:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.218542:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.218593:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.218729:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835840 00000100:00100000:3.0:1786562542.218749:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835840 00000100:00100000:3.0:1786562542.218933:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652835968 00000100:00100000:3.0:1786562542.218938:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652835968 00000100:00100000:0.0:1786562542.219092:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652835456:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 9315us (25759us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562542.219107:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17770 00000100:00100000:0.0:1786562542.219153:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836096 00000100:00100000:0.0:1786562542.219174:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836096 00000100:00100000:1.0:1786562542.219220:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17772 00000100:00100000:0.0:1786562542.219234:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17773 00000100:00100000:1.0:1786562542.219244:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652835840:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:0.0:1786562542.219254:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652835968:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562542.219401:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17774 00000100:00100000:3.0:1786562542.219413:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652836096:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:3.0:1786562542.219789:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652836096:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 378us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.219799:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17774 00000100:00100000:1.0:1786562542.220112:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652835840:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 877us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562542.220121:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17772 00000100:00100000:3.0:1786562542.224465:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652835968:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 5196us (5899us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.224489:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17773 00000100:00100000:1.0:1786562542.240824:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562542.241093:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836224 00000100:00100000:0.0:1786562542.241118:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836224 00000100:00100000:0.0:1786562542.241226:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11538 00000100:00100000:0.0:1786562542.241238:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652836224:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562542.241277:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.241297:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.241301:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.241308:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.241322:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.243368:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562542.246147:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836352 00000100:00100000:0.0:1786562542.246173:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836352 00000100:00100000:0.0:1786562542.246272:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11539 00000100:00100000:0.0:1786562542.246284:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652836352:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562542.246325:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.246347:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.246353:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.246360:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.246375:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.269306:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.269434:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836480 00000100:00100000:1.0:1786562542.269453:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836480 00000100:00100000:1.0:1786562542.269616:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11540 00000100:00100000:1.0:1786562542.269628:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652836480:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562542.269672:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.269701:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562542.269706:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562542.269714:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.269729:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281447:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281469:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281478:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281490:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562542.281495:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281504:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281525:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.281533:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f2a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.281713:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652836224:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 40473us (40901us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562542.281726:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11538 00000100:00100000:3.0:1786562542.286043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.286079:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562542.286377:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836608 00000100:00100000:0.0:1786562542.286388:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836608 00000100:00100000:0.0:1786562542.286456:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836736 00000100:00100000:0.0:1786562542.286460:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836736 00000100:00100000:0.0:1786562542.286492:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11541 00000100:00100000:0.0:1786562542.286503:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652836608:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562542.286546:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.286568:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.286573:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.286582:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.286596:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.286804:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11542 00000100:00100000:1.0:1786562542.286816:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652836736:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562542.286849:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.286858:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562542.286861:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562542.286865:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.286880:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.287382:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.287460:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.287483:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.287503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.287546:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836864 00000100:00100000:3.0:1786562542.287552:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836864 00000100:00100000:3.0:1786562542.287588:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652836992 00000100:00100000:3.0:1786562542.287591:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652836992 00000100:00100000:3.0:1786562542.287611:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837120 00000100:00100000:3.0:1786562542.287614:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837120 00000100:00100000:3.0:1786562542.287630:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837248 00000100:00100000:3.0:1786562542.287633:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837248 00000100:00100000:3.0:1786562542.287651:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11543 00000100:00100000:3.0:1786562542.287659:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652836864:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562542.287679:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.287692:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562542.287707:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562542.287712:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.287723:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.288975:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11544 00000100:00100000:0.0:1786562542.288990:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652836992:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562542.289041:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.289054:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.289058:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.289065:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.289076:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.289732:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11545 00000100:00100000:0.0:1786562542.289743:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652837120:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562542.289767:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.289778:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.289782:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.289786:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.289797:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.290483:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11546 00000100:00100000:0.0:1786562542.290492:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2348:x1873345652837248:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562542.290517:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.290527:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.290531:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562542.290536:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.290546:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294583:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294604:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294613:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294621:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562542.294626:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294636:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294656:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.294663:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006e9a26/0x5c655bf66689f2b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.294720:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2351:x1873345652836480:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 25090us (25425us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562542.294731:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11540 00010000:00010000:0.0:1786562542.295363:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.295375:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.295382:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.295388:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562542.296568:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.296588:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.296607:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.296616:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c943b82/0x5c655bf66689f2ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.296685:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652836352:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 50399us (53334us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562542.296695:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11539 00010000:00010000:3.0:1786562542.324676:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.324698:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.324708:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.324715:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ea00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562542.324721:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.324736:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.324761:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.324768:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f2bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.324855:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652836608:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 38348us (38847us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562542.324872:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11541 00010000:00010000:2.0:1786562542.339534:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.339557:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.339567:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.339575:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562542.339581:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.339590:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.339611:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.339621:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8cfe931/0x5c655bf66689f2d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.339741:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652836992:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 50750us (52274us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562542.339753:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11544 00010000:00010000:3.0:1786562542.349568:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.353383:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.353400:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.353408:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562542.353414:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.353442:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.353471:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.353480:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000787707c0/0x5c655bf66689f2d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.353738:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652837120:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 63986us (66241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562542.353754:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11545 00010000:00010000:2.0:1786562542.365225:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.365246:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.365257:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.365265:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99176fe00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562542.365270:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.365279:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.365304:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.365312:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eb1797e/0x5c655bf66689f2ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.365410:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652836864:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 77746us (78024us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562542.365421:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11543 00010000:00010000:3.0:1786562542.366313:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.366336:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.366346:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.366363:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562542.366369:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.366379:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.366403:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.366414:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aeb8895/0x5c655bf66689f2c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.366515:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652836736:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 79684us (80417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562542.366528:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11542 00010000:00010000:2.0:1786562542.373349:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562542.373564:0:13965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.373582:0:13965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.373590:0:13965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.373597:0:13965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ee00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562542.373603:0:13965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.373612:0:13965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.373637:0:13965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.373645:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a77d/0x5c655bf66689f2df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.373880:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652837248:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 83383us (86369us total) trans 0 rc 988320/988320 00000100:00100000:2.0:1786562542.373891:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11546 00000100:00100000:1.0:1786562542.387713:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.387870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562542.388069:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837504 00000100:00100000:2.0:1786562542.388081:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837504 00000100:00100000:2.0:1786562542.388178:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837376 00000100:00100000:2.0:1786562542.388182:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837376 00000100:00100000:2.0:1786562542.388286:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11547 00000100:00100000:2.0:1786562542.388299:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652837504:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562542.388363:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.388390:0:16005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 14 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.388401:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72d:0x0].0x0 since=14s v=(0 0) 00010000:00010000:2.0:1786562542.388407:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562542.388412:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.388585:0:16005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 14 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.388907:0:16005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 14 pid: 29965 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.388927:0:16005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:16005:1873345654885120:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562542.389070:0:16005:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562542.389175:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11548 00000100:00100000:3.0:1786562542.389191:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652837376:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562542.389217:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.389230:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x72d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.389235:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562542.389240:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.389250:0:29460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.395748:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562542.397340:0:16005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:16005:1873345654885120:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562542.397446:0:16005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.397494:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837632 00000100:00100000:2.0:1786562542.397620:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837632 00010000:00010000:2.0:1786562542.399183:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 15 pid: 29965 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.399363:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8716 00000100:00100000:2.0:1786562542.399389:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652837632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562542.399419:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562542.399460:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 15 pid: 29965 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399476:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 15 pid: 29965 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399519:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000366281f8/0x5c655bf66689e2bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc49e expref: 15 pid: 29965 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399756:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.399762:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.399770:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399781:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399791:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.399794:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.399798:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399805:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.399866:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562542.399947:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652837632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 572us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562542.399957:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8716 00010000:00010000:0.0:1786562542.400127:0:29460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.400137:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.400904:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.400981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.401095:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.401125:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838144 00000100:00100000:3.0:1786562542.401136:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838144 00000100:00100000:3.0:1786562542.401199:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838400 00000100:00100000:3.0:1786562542.401203:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838400 00000100:00100000:3.0:1786562542.401228:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 431 00000100:00100000:3.0:1786562542.401239:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652838144:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562542.401297:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652838144:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.401305:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 431 00000100:00100000:3.0:1786562542.401320:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 432 00000100:00100000:3.0:1786562542.401326:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2348:x1873345652838400:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562542.401348:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2348:x1873345652838400:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.401360:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 432 00000100:00100000:3.0:1786562542.401397:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.401978:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.402054:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.402078:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.402103:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.402129:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838016 00000100:00100000:3.0:1786562542.402135:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838016 00000100:00100000:3.0:1786562542.402181:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838528 00000100:00100000:3.0:1786562542.402185:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838528 00000100:00100000:3.0:1786562542.402205:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 433 00000100:00100000:3.0:1786562542.402212:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652838016:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562542.402258:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652838016:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.402265:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 433 00000100:00100000:3.0:1786562542.402279:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 434 00000100:00100000:3.0:1786562542.402286:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2348:x1873345652838528:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562542.402308:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2348:x1873345652838528:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.402314:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 434 00000100:00100000:0.0:1786562542.405211:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837888 00000100:00100000:0.0:1786562542.405232:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837888 00000100:00100000:0.0:1786562542.405324:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838656 00000100:00100000:0.0:1786562542.405328:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838656 00000100:00100000:0.0:1786562542.405363:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838272 00000100:00100000:0.0:1786562542.405367:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838272 00000100:00100000:0.0:1786562542.405398:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:0.0:1786562542.405409:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+501:2348:x1873345652837888:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562542.405540:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+501:2348:x1873345652837888:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 132us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562542.405549:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:0.0:1786562542.405570:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 269 00000100:00100000:0.0:1786562542.405578:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2348:x1873345652838656:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562542.405606:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2348:x1873345652838656:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562542.405612:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 269 00000100:00100000:0.0:1786562542.405624:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:0.0:1786562542.405630:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652838272:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562542.405660:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2348:x1873345652838272:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562542.405671:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:0.0:1786562542.405698:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652837760 00000100:00100000:0.0:1786562542.405702:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652837760 00000100:00100000:0.0:1786562542.405730:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 244 00000100:00100000:0.0:1786562542.405737:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+16:2348:x1873345652837760:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562542.405762:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+16:2348:x1873345652837760:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562542.405769:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 244 00010000:00010000:3.0:1786562542.414361:0:16005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.417133:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562542.478941:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843584 is committed 00002000:00010000:1.0:1786562542.479071:0:29460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562526 -> 1786562541 00002000:00010000:1.0:1786562542.479076:0:29460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 1786562526 -> 1786562541 00010000:00010000:1.0:1786562542.479093:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.479108:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.479118:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.479125:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562542.479131:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.479140:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.479176:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.479191:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f2ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.479319:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652837376:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 90127us (91442us total) trans 21474843584 rc 0/0 00000100:00100000:1.0:1786562542.479332:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11548 00010000:00010000:2.0:1786562542.530923:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.530958:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.530968:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.530977:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562542.530984:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.530993:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.531057:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.531066:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.531214:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652837504:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 142911us (143509us total) trans 21474843585 rc 0/0 00000100:00100000:2.0:1786562542.531229:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11547 00000001:00080000:3.0:1786562542.534597:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843585 is committed 00000100:00100000:3.0:1786562542.554751:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.554800:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.555066:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838784 00000100:00100000:1.0:1786562542.555081:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838784 00000100:00100000:1.0:1786562542.555187:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839040 00000100:00100000:1.0:1786562542.555191:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839040 00000100:00100000:1.0:1786562542.555223:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11549 00000100:00100000:1.0:1786562542.555234:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652838784:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562542.555282:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.555309:0:16007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 13 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.555319:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x731:0x0].0x0 since=14s v=(0 0) 00010000:00010000:1.0:1786562542.555324:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562542.555329:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.555389:0:16007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 13 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.555412:0:16007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 13 pid: 28861 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.555554:0:16007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9a05500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:16007:1873345654885248:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562542.555673:0:16007:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8811869c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562542.556809:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11550 00000100:00100000:2.0:1786562542.556832:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652839040:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562542.556883:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.556907:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x731:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562542.556913:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.556917:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.556927:0:16006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.564290:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562542.564451:0:16007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9a05500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:16007:1873345654885248:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562542.564489:0:16007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.567563:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652838912 00000100:00100000:3.0:1786562542.567584:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652838912 00000100:00100000:3.0:1786562542.567942:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11551 00000100:00100000:3.0:1786562542.567957:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652838912:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562542.568036:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.568063:0:16203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.568075:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x715:0x0].0x0 since=14s v=(0 0) 00010000:00010000:3.0:1786562542.568080:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.568086:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.568133:0:16203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 13 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.568147:0:16203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 13 pid: 29662 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.568176:0:16203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:16203:1873345654885376:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562542.568600:0:16203:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562542.574562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.574687:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562542.575123:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839296 00000100:00100000:2.0:1786562542.575136:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839296 00010000:00010000:2.0:1786562542.575219:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 14 pid: 28861 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.575268:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8717 00000100:00100000:2.0:1786562542.575281:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652839296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562542.575305:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562542.575337:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 14 pid: 28861 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575373:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 14 pid: 28861 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575409:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca79cb9/0x5c655bf66689e2c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4a5 expref: 14 pid: 28861 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575441:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=1s v=(2 0) 00010000:00010000:2.0:1786562542.575447:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.575455:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575467:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575479:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.575482:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1786562542.575486:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575494:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575542:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562542.575607:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2349:x1873345652839296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 329us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562542.575620:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8717 00010000:00010000:2.0:1786562542.575656:0:16007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.575666:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.578233:0:16203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:16203:1873345654885376:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562542.578279:0:16203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.578586:0:16006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.578598:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.582448:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.582771:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839424 00000100:00100000:3.0:1786562542.582783:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839424 00010000:00010000:3.0:1786562542.582840:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 14 pid: 29662 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.582885:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8718 00000100:00100000:3.0:1786562542.582898:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652839424:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562542.582917:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562542.582949:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 14 pid: 29662 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.582966:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 14 pid: 29662 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.583038:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d3db30d/0x5c655bf66689e2cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ac expref: 14 pid: 29662 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.583061:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.583066:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.583074:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.583084:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.583115:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562542.583195:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652839424:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 298us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562542.583204:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8718 00010000:00010000:2.0:1786562542.584030:0:16203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.584049:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.585072:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839168 00000100:00100000:0.0:1786562542.585088:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839168 00000100:00100000:0.0:1786562542.585196:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11552 00000100:00100000:0.0:1786562542.585208:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652839168:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562542.585252:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.585272:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562542.585277:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562542.585285:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.585298:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562542.726051:0:16203:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562526 -> 1786562541 00002000:00010000:0.0:1786562542.726064:0:16203:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562526 -> 1786562541 00010000:00010000:0.0:1786562542.726084:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.726100:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.726111:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.726120:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562542.726127:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.726137:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.726174:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.726182:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f302 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.726306:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2350:x1873345652838912:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 158347us (162034us total) trans 17179876064 rc 0/0 00000100:00100000:0.0:1786562542.726319:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11551 00000001:00080000:1.0:1786562542.729393:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876064 is committed 00002000:00010000:0.0:1786562542.745098:0:16007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562526 -> 1786562541 00002000:00010000:0.0:1786562542.745113:0:16007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562526 -> 1786562541 00010000:00010000:0.0:1786562542.745132:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.745159:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.745172:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.745181:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562542.745188:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.745198:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.745225:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.745233:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f2f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.745359:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2351:x1873345652838784:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 190107us (190605us total) trans 21474843586 rc 0/0 00000100:00100000:0.0:1786562542.745373:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11549 00010000:00010000:1.0:1786562542.745536:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.745547:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.745555:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.745562:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562542.745567:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.745575:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.745587:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.745594:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f2fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.745639:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652839040:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 188818us (190837us total) trans 21474843587 rc 0/0 00000100:00100000:1.0:1786562542.745648:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11550 00000001:00080000:3.0:1786562542.747928:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843587 is committed 00000001:00080000:2.0:1786562542.811638:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876065 is committed 00010000:00010000:3.0:1786562542.811806:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.811825:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.811836:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.811846:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1a800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562542.811854:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.811865:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.811892:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.811900:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a70f39e/0x5c655bf66689f309 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.812323:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652839168:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 227109us (237898us total) trans 17179876065 rc 0/0 00000100:00100000:3.0:1786562542.812337:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11552 00000100:00100000:0.0:1786562542.828501:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562542.829584:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839552 00000100:00100000:2.0:1786562542.829603:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839552 00000100:00100000:2.0:1786562542.829729:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11553 00000100:00100000:2.0:1786562542.829743:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652839552:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562542.829798:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.829825:0:29463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.829836:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x732:0x0].0x0 since=14s v=(0 0) 00010000:00010000:2.0:1786562542.829842:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562542.829848:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.829900:0:29463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.829918:0:29463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 11 pid: 6660 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562542.829937:0:29463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:29463:1873345654885504:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562542.830143:0:29463:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562542.836120:0:29463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:29463:1873345654885504:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562542.836169:0:29463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.836985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562542.839306:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839680 00000100:00100000:1.0:1786562542.839329:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839680 00010000:00010000:1.0:1786562542.839963:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 12 pid: 6660 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562542.840077:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8719 00000100:00100000:1.0:1786562542.840090:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652839680:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562542.840117:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562542.840158:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 12 pid: 6660 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.840181:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 12 pid: 6660 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.840212:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea116e8/0x5c655bf66689e2d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4b3 expref: 12 pid: 6660 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.840233:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562542.840238:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562542.840245:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.840258:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562542.840294:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562542.840394:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652839680:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 306us (3413us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562542.840404:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8719 00010000:00010000:0.0:1786562542.841882:0:29463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562542.841905:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.853674:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.854001:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839808 00000100:00100000:3.0:1786562542.854066:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839808 00000100:00100000:3.0:1786562542.854179:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11554 00000100:00100000:3.0:1786562542.854192:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652839808:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562542.854245:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.854270:0:13913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.854280:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x716:0x0].0x0 since=14s v=(0 0) 00010000:00010000:3.0:1786562542.854285:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.854291:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.854340:0:13913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.854368:0:13913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 12 pid: 6659 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.854387:0:13913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13913:1873345654885632:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562542.854500:0:13913:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562542.869337:0:13913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:13913:1873345654885632:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562542.869393:0:13913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562542.875111:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562542.879744:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652839936 00000100:00100000:3.0:1786562542.879767:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652839936 00010000:00010000:3.0:1786562542.879828:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 13 pid: 6659 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562542.879892:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8720 00000100:00100000:3.0:1786562542.879904:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652839936:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562542.879924:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562542.879956:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 13 pid: 6659 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.879973:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 13 pid: 6659 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.880045:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda1d3fa/0x5c655bf66689e2d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4ba expref: 13 pid: 6659 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.880072:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.880077:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562542.880084:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.880097:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562542.885692:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562542.886352:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652839936:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6440us (11251us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562542.886369:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8720 00010000:00010000:2.0:1786562542.895313:0:13913:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562542.895342:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562543.018319:0:29463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562526 -> 1786562542 00002000:00010000:0.0:1786562543.018334:0:29463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562526 -> 1786562542 00010000:00010000:0.0:1786562543.018356:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.018372:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.018382:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.018390:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562543.018395:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.018405:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.018430:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.018438:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.018569:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2348:x1873345652839552:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 188823us (190218us total) trans 21474843588 rc 0/0 00000100:00100000:0.0:1786562543.018583:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11553 00000001:00080000:3.0:1786562543.018979:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843588 is committed 00000001:00080000:0.0:1786562543.039275:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876066 is committed 00002000:00010000:2.0:1786562543.039534:0:13913:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562526 -> 1786562542 00002000:00010000:2.0:1786562543.039540:0:13913:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562526 -> 1786562542 00010000:00010000:2.0:1786562543.039558:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.039575:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.039586:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.039594:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562543.039600:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.039610:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.039636:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.039646:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f317 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.039814:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652839808:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 185617us (186157us total) trans 17179876066 rc 0/0 00000100:00100000:2.0:1786562543.039828:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11554 00000100:00100000:0.0:1786562543.068786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562543.068911:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840064 00000100:00100000:2.0:1786562543.068926:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840064 00000100:00100000:2.0:1786562543.069089:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11555 00000100:00100000:2.0:1786562543.069103:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2350:x1873345652840064:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562543.069161:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.069187:0:13965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.069199:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x733:0x0].0x0 since=14s v=(0 0) 00010000:00010000:2.0:1786562543.069204:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562543.069210:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.069259:0:13965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.069274:0:13965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 10 pid: 6658 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.069292:0:13965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:13965:1873345654885760:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562543.069430:0:13965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9a24150c0 going to sleep for 11 seconds 00000100:00080000:1.0:1786562543.070138:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562543.077893:0:13965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:13965:1873345654885760:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562543.077933:0:13965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.079347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562543.079672:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840192 00000100:00100000:3.0:1786562543.079685:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840192 00010000:00010000:3.0:1786562543.079738:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 11 pid: 6658 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562543.079789:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8721 00000100:00100000:3.0:1786562543.079801:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652840192:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562543.079818:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562543.079847:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 11 pid: 6658 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.079862:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 11 pid: 6658 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.079892:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000799bce89/0x5c655bf66689e2e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4c1 expref: 11 pid: 6658 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.079915:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562543.079920:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562543.079927:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.079938:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.079984:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562543.080628:0:13965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.080642:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562543.081906:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2348:x1873345652840192:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2096us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.081922:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8721 00000001:00080000:2.0:1786562543.252731:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843589 is committed 00002000:00010000:3.0:1786562543.253315:0:13965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5185536 00002000:00010000:3.0:1786562543.253322:0:13965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562527 -> 1786562542 00002000:00010000:3.0:1786562543.253325:0:13965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562527 -> 1786562542 00010000:00010000:3.0:1786562543.253342:0:13965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.253358:0:13965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.253368:0:13965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.253377:0:13965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562543.253383:0:13965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.253401:0:13965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.253501:0:13965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.253510:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fed97e64/0x5c655bf66689f31e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562543.253650:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2350:x1873345652840064:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 184544us (184872us total) trans 21474843589 rc 0/0 00000100:00100000:3.0:1786562543.253664:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11555 00000100:00100000:1.0:1786562543.275637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562543.275689:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562543.275717:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562543.275754:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562543.275849:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840320 00000100:00100000:3.0:1786562543.275861:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840320 00000100:00100000:3.0:1786562543.275959:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840576 00000100:00100000:3.0:1786562543.275963:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840576 00000100:00100000:3.0:1786562543.275989:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840448 00000100:00100000:3.0:1786562543.275992:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840448 00000100:00100000:3.0:1786562543.276042:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840704 00000100:00100000:3.0:1786562543.276046:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840704 00000100:00100000:3.0:1786562543.276073:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11556 00000100:00100000:3.0:1786562543.276086:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652840320:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562543.276136:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276174:0:16005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 22 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276187:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=14s v=(1 0) 00010000:00010000:3.0:1786562543.276193:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562543.276198:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276246:0:16005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 22 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276264:0:16005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 22 pid: 28861 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562543.276284:0:16005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:16005:1873345654885888:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562543.276395:0:16005:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562543.276437:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11557 00000100:00100000:3.0:1786562543.276446:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652840576:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562543.276467:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276477:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562543.276482:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562543.276486:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276495:0:6664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562543.276522:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11558 00000100:00100000:3.0:1786562543.276530:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652840448:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562543.276545:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276554:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562543.276557:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562543.276560:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.276567:0:29462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.276713:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11559 00000100:00100000:0.0:1786562543.276724:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2350:x1873345652840704:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562543.276743:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.276753:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562543.276757:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562543.276760:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.276768:0:29460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562543.282113:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562543.285618:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562543.285741:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840832 00000100:00100000:1.0:1786562543.285753:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840832 00010000:00010000:1.0:1786562543.285830:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562543.285886:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8722 00000100:00100000:1.0:1786562543.285899:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652840832:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562543.285919:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562543.285948:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.285965:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 23 pid: 28861 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.285998:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286040:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286048:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286060:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286070:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286073:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286077:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286087:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286094:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286097:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286101:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286109:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286116:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286119:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562543.286123:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286131:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286188:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562543.286252:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652840832:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 356us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.286261:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8722 00010000:00010000:1.0:1786562543.286298:0:29462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286314:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286461:0:6664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.286471:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.286801:0:29460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.286812:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.287259:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061434f8a/0x5c655bf66689e381 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc523 expref: 22 pid: 28861 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562543.287299:0:16005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:16005:1873345654885888:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562543.287327:0:16005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.287337:0:16005:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.287344:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786562543.287620:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562543.402566:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562543.422709:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876067 is committed 00002000:00010000:0.0:1786562543.423687:0:29462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562527 -> 1786562542 00002000:00010000:0.0:1786562543.423695:0:29462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562527 -> 1786562542 00010000:00010000:0.0:1786562543.423715:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.423732:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.423743:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.423752:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562543.423758:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.423769:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.423793:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.423801:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f333 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.423919:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+23:2350:x1873345652840448:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 147383us (148193us total) trans 17179876067 rc 0/0 00000100:00100000:0.0:1786562543.423932:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11558 00000001:00080000:2.0:1786562543.542579:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876070 is committed 00010000:00010000:0.0:1786562543.542640:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542659:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542669:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542678:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562543.542684:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542699:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542729:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542738:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f33a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.542868:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2350:x1873345652840704:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 266138us (267104us total) trans 17179876069 rc 0/0 00000100:00100000:0.0:1786562543.542881:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11559 00010000:00010000:0.0:1786562543.542939:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542948:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542956:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542963:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562543.542965:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542972:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542986:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.542994:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f325 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.543066:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.543078:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.543086:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.543093:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562543.543098:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.543108:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652840320:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 267022us (267484us total) trans 17179876070 rc 0/0 00010000:00010000:1.0:1786562543.543110:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.543124:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11556 00010000:00010000:1.0:1786562543.543131:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.543151:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f32c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562543.543205:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652840576:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 266759us (267513us total) trans 17179876068 rc 0/0 00000100:00100000:1.0:1786562543.543216:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11557 00000100:00100000:3.0:1786562543.570788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562543.570839:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562543.570873:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562543.571052:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841088 00000100:00100000:2.0:1786562543.571067:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841088 00000100:00100000:2.0:1786562543.571174:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841216 00000100:00100000:2.0:1786562543.571179:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841216 00000100:00100000:2.0:1786562543.571200:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841344 00000100:00100000:2.0:1786562543.571204:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841344 00000100:00100000:2.0:1786562543.571227:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11560 00000100:00100000:2.0:1786562543.571239:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652841088:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562543.571287:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.571325:0:6665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.571337:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x718:0x0].0x0 since=15s v=(0 0) 00010000:00010000:2.0:1786562543.571343:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562543.571349:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.571397:0:6665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 13 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.571421:0:6665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 13 pid: 29966 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.571440:0:6665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:6665:1873345654886016:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562543.571450:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11561 00000100:00100000:0.0:1786562543.571461:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652841216:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562543.571480:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.571490:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x718:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562543.571494:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562543.571497:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.571506:0:16007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562543.571534:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11562 00000100:00100000:0.0:1786562543.571540:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2350:x1873345652841344:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562543.571557:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.571563:0:6665:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af847c00 going to sleep for 11 seconds 00010000:00010000:0.0:1786562543.571566:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x718:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1786562543.571569:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562543.571573:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.571581:0:29463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.575849:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562543.581898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562543.582108:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841472 00000100:00100000:1.0:1786562543.582120:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841472 00000100:00100000:0.0:1786562543.582173:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652840960 00000100:00100000:0.0:1786562543.582178:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652840960 00010000:00010000:1.0:1786562543.582190:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 15 pid: 29966 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562543.582235:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8723 00000100:00100000:0.0:1786562543.582235:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11563 00000100:00100000:1.0:1786562543.582246:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652841472:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1786562543.582247:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2351:x1873345652840960:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562543.582265:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562543.582286:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.582296:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 15 pid: 29966 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.582306:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x718:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1786562543.582474:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1786562543.582482:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.582589:0:6665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:6665:1873345654886016:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562543.583298:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 15 pid: 29966 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583335:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3068f3b/0x5c655bf66689e303 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4d6 expref: 15 pid: 29966 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583357:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583361:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583368:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583377:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583387:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583390:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583395:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583403:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583410:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583413:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583417:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583425:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583431:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583434:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(4 0) 00010000:00010000:1.0:1786562543.583438:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583450:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583497:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562543.583574:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2349:x1873345652841472:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1327us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.583585:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8723 00010000:00010000:1.0:1786562543.583727:0:16007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.583738:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.585249:0:29463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.585270:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.590990:0:13913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.591035:0:13913:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.591047:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.591483:0:6665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.603785:0:6665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.603812:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562543.766780:0:16007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562527 -> 1786562542 00002000:00010000:1.0:1786562543.766795:0:16007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562527 -> 1786562542 00010000:00010000:1.0:1786562543.766815:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.766838:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.766849:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.766858:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562543.766864:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562543.766993:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876071 is committed 00010000:00010000:1.0:1786562543.767219:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.767248:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562543.767257:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f348 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562543.768289:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+22:2350:x1873345652841216:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 196817us (197435us total) trans 17179876071 rc 0/0 00000100:00100000:1.0:1786562543.768305:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11561 00010000:00010000:3.0:1786562543.892762:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.892789:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.892800:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.892809:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562543.892815:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.892825:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.892860:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.892913:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.892926:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.892934:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.892941:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562543.892944:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.892967:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f34f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.892974:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.892991:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.893000:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f356 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893177:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893188:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893195:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893202:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562543.893206:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893213:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893225:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.893232:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f341 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.896655:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652840960:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 314391us (320814us total) trans 17179876073 rc 0/0 00000100:00100000:2.0:1786562543.896679:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11563 00000001:00080000:2.0:1786562543.896769:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876074 is committed 00000100:00100000:2.0:1786562543.898514:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652841344:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 326956us (327623us total) trans 17179876072 rc 0/0 00000100:00100000:0.0:1786562543.898514:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2350:x1873345652841088:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 327260us (327727us total) trans 17179876074 rc 0/0 00000100:00100000:2.0:1786562543.898538:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11562 00000100:00100000:0.0:1786562543.901849:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11560 00000100:00100000:0.0:1786562543.905312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562543.905585:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841600 00000100:00100000:3.0:1786562543.905598:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841600 00000100:00100000:3.0:1786562543.905696:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11564 00000100:00100000:3.0:1786562543.905710:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652841600:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562543.905764:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.905792:0:13965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.905803:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x719:0x0].0x0 since=15s v=(0 0) 00010000:00010000:3.0:1786562543.905808:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562543.905814:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.905940:0:13965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562543.905960:0:13965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 10 pid: 28861 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562543.905980:0:13965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:13965:1873345654886144:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562543.906143:0:13965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562543.909381:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654886272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562543.909454:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654886528:0@lo:400:kworker.0 00000100:00100000:1.0:1786562543.909659:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654886400:0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.921900:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562543.921982:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654887040:0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.922059:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562543.922098:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786562543.922107:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654886656:0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.922145:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562543.922167:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654887168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562543.922199:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562543.922247:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654886528 00000100:00100000:2.0:1786562543.922258:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654886528 00000100:00100000:2.0:1786562543.922326:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654887040 00000100:00100000:2.0:1786562543.922330:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654887040 00000100:00100000:2.0:1786562543.922352:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654886656 00000100:00100000:2.0:1786562543.922354:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654886656 00000100:00100000:2.0:1786562543.922377:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786562543.924851:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.924998:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654886528:12345-0@lo:400:kworker.0 Request processed in 182us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562543.926066:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562543.926174:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654886912:0@lo:400:kworker.0 00000100:00100000:3.0:1786562543.926248:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562543.927018:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562543.927062:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654887168 00000100:00100000:1.0:1786562543.927076:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654887168 00000100:00100000:1.0:1786562543.927150:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654886272 00000100:00100000:1.0:1786562543.927155:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654886272 00000100:00100000:1.0:1786562543.927180:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1786562543.927193:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654887168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562543.927225:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 644153344 pending 0 free 3828350976 avail 3822059520 00000100:00100000:1.0:1786562543.927286:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654887168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (5086us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.927295:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1786562543.927319:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1786562543.927503:0:13965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:13965:1873345654886144:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562543.927540:0:13965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562543.927767:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654886272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562543.927785:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 535232512 pending 0 free 3829399552 avail 3815768064 00000100:00100000:1.0:1786562543.927836:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654886272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 510us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.927843:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1786562543.927868:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654886912 00000100:00100000:1.0:1786562543.927873:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654886912 00000100:00100000:1.0:1786562543.927903:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1786562543.927910:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654886912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562543.927946:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654886912:12345-0@lo:400:kworker.0 Request processed in 36us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.927953:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1786562543.928042:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876063 gen 2 00000004:00080000:3.0:1786562543.928049:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa16300, transno 17179876055 00000004:00080000:3.0:1786562543.928069:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa17b80, transno 17179876056 00000004:00080000:3.0:1786562543.928072:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa17800, transno 17179876057 00000004:00080000:3.0:1786562543.928074:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa15c00, transno 17179876058 00000004:00080000:3.0:1786562543.928077:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa17100, transno 17179876059 00000004:00080000:3.0:1786562543.928080:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa15500, transno 17179876060 00000004:00080000:3.0:1786562543.928083:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa14a80, transno 17179876061 00000004:00080000:3.0:1786562543.928086:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa15f80, transno 17179876062 00000004:00080000:3.0:1786562543.928089:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa16a00, transno 17179876063 00000100:00100000:3.0:1786562543.928095:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654886912:0@lo:400:kworker.0 00000100:00100000:3.0:1786562543.928115:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654886272:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1786562543.929063:0:33137:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1786562543.930068:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562543.930147:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654886784:0@lo:400:kworker.0 00000100:00100000:1.0:1786562543.930192:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562543.930220:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654886784 00000100:00100000:1.0:1786562543.930231:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654886784 00000100:00100000:1.0:1786562543.930281:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1786562543.930291:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654886784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562543.930362:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654886784:12345-0@lo:400:kworker.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562543.930369:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1786562543.930411:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843583 gen 2 00000004:00080000:1.0:1786562543.930419:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5d180, transno 21474843576 00000004:00080000:1.0:1786562543.930430:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5f100, transno 21474843577 00000004:00080000:1.0:1786562543.930433:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5ce00, transno 21474843578 00000004:00080000:1.0:1786562543.930436:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5e680, transno 21474843579 00000004:00080000:1.0:1786562543.930439:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5ca80, transno 21474843580 00000004:00080000:1.0:1786562543.930442:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5f800, transno 21474843581 00000004:00080000:1.0:1786562543.930461:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5df80, transno 21474843582 00000004:00080000:1.0:1786562543.930464:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5c380, transno 21474843583 00000100:00100000:1.0:1786562543.930472:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654886784:0@lo:400:kworker.0 00000100:00100000:0.0:1786562543.933156:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1786562543.933195:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654887040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562543.933324:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654887040:12345-0@lo:400:kworker.0 Request processed in 151us (11263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562543.933334:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1786562543.933376:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1786562543.933403:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562543.933441:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654886656:12345-0@lo:400:kworker.0 Request processed in 40us (11295us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562543.933448:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1786562543.944853:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786562543.944963:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841728 00000100:00100000:2.0:1786562543.944975:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841728 00010000:00010000:2.0:1786562543.945050:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 11 pid: 28861 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562543.945106:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8724 00000100:00100000:2.0:1786562543.945118:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2349:x1873345652841728:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562543.945149:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562543.945180:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 11 pid: 28861 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.945198:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 11 pid: 28861 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.945228:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a704f7bd/0x5c655bf66689e30a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfc4dd expref: 11 pid: 28861 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.945249:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562543.945254:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562543.945261:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.945272:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562543.945325:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1786562543.945702:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562543.945710:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562543.945715:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562543.946191:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:2349:x1873345652841728:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1070us (19189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562543.946203:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8724 00000100:00100000:2.0:1786562543.946244:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654886400 00000100:00100000:2.0:1786562543.946252:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654886400 00000100:00100000:2.0:1786562543.946293:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1786562543.946302:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654886400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.947629:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654886400:12345-0@lo:400:kworker.0 Request processed in 1319us (17559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562543.947645:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000004:00080000:2.0:1786562543.948296:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:2.0:1786562543.948364:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654886656:0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.948392:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654887168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562543.948408:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654886528:0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.948427:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654887040:0@lo:400:kworker.0 00000100:00100000:2.0:1786562543.948483:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654886400:0@lo:400:kworker.0 00010000:00010000:0.0:1786562543.948715:0:13965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562543.948733:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562544.077108:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876075 is committed 00002000:00010000:1.0:1786562544.077291:0:13965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5185536 00002000:00010000:1.0:1786562544.077297:0:13965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562527 -> 1786562543 00002000:00010000:1.0:1786562544.077300:0:13965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562527 -> 1786562543 00010000:00010000:1.0:1786562544.077318:0:13965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.077333:0:13965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.077342:0:13965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.077356:0:13965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562544.077361:0:13965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.077371:0:13965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.077397:0:13965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.077404:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f35d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.077651:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:2349:x1873345652841600:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 171936us (172347us total) trans 17179876075 rc 0/0 00000100:00100000:1.0:1786562544.077665:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11564 00000100:00100000:3.0:1786562544.134838:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562544.135593:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652841984 00000100:00100000:2.0:1786562544.135608:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652841984 00000100:00100000:2.0:1786562544.135719:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17118 00000100:00100000:2.0:1786562544.135733:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64168:x1873345652841984:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562544.135812:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562544.135855:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e88a26e600/0x5c655bf66689f276 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce06 expref: 9 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.135882:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562544.135889:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562544.136428:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.136447:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.136459:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562544.136545:0:33115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950669 00000004:00010000:2.0:1786562544.136574:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d92f046 reply state 00000000befa8567 transno 8589950670 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562544.136585:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562544.136727:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652841984:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 995us (1901us total) trans 8589950670 rc 0/0 00000100:00100000:2.0:1786562544.136739:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17118 00000020:00080000:2.0:1786562544.136745:0:33115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1786562544.137988:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562544.140841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562544.140937:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.140954:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.140963:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.140969:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562544.140975:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.140985:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.141026:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562544.141031:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562544.141038:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.141045:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f364 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.141222:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842112 00000100:00100000:3.0:1786562544.141235:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842112 00000100:00100000:3.0:1786562544.141307:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17775 00000100:00100000:3.0:1786562544.141320:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64168:x1873345652842112:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.141342:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.141366:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f36b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce37 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.141398:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:3.0:1786562544.141427:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.141433:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.141444:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f36b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce37 expref: 10 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.141463:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f36b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce37 expref: 10 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.141477:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:3.0:1786562544.141687:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652842112:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 368us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.141695:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17775 00000100:00100000:2.0:1786562544.148767:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.148891:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842240 00000100:00100000:3.0:1786562544.148904:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842240 00000100:00100000:3.0:1786562544.148985:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17776 00000100:00100000:3.0:1786562544.148998:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652842240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.149196:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.149225:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689f372 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce3e expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.149260:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:3.0:1786562544.149290:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.149296:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.149308:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689f372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce3e expref: 11 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.149327:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689f372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce3e expref: 11 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.149343:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365a00, rc 0) 00000100:00100000:3.0:1786562544.149429:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652842240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 433us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.149439:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17776 00000100:00100000:0.0:1786562544.164743:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.165047:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842368 00000100:00100000:3.0:1786562544.165060:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842368 00000100:00100000:3.0:1786562544.165150:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17777 00000100:00100000:3.0:1786562544.165163:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+9:64168:x1873345652842368:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.165187:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.165216:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f379 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce45 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.165257:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:3.0:1786562544.165289:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.165295:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.165306:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f379 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce45 expref: 10 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.165326:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f379 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce45 expref: 10 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.165343:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365200, rc 0) 00000100:00100000:3.0:1786562544.165425:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652842368:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 264us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.165433:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17777 00000100:00100000:2.0:1786562544.179741:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.179873:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842496 00000100:00100000:3.0:1786562544.179888:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842496 00000100:00100000:3.0:1786562544.179965:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17778 00000100:00100000:3.0:1786562544.179978:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652842496:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.180048:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.180076:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f380 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce4c expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.180115:0:29963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x732:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:3.0:1786562544.180159:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.180166:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.180178:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce4c expref: 12 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.180198:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce4c expref: 12 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.180213:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:3.0:1786562544.180285:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64168:x1873345652842496:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 309us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.180292:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17778 00000100:00100000:2.0:1786562544.185721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.188095:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842624 00000100:00100000:3.0:1786562544.188117:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842624 00000100:00100000:3.0:1786562544.188223:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17779 00000100:00100000:3.0:1786562544.188236:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652842624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.188263:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.188295:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f387 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce53 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.188332:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x716:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:3.0:1786562544.188363:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.188369:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.188381:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce53 expref: 11 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.188400:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce53 expref: 11 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.188421:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365800, rc 0) 00000100:00100000:3.0:1786562544.188582:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652842624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 348us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.188591:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17779 00000100:00100000:0.0:1786562544.193819:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.193941:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842752 00000100:00100000:1.0:1786562544.193955:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842752 00000100:00100000:1.0:1786562544.194070:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17780 00000100:00100000:1.0:1786562544.194083:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64168:x1873345652842752:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562544.194111:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562544.194152:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f38e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce5a expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562544.194189:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x733:0x0] initial LVB size: 5185536, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x7af 00010000:00010000:1.0:1786562544.194221:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=976s v=(0 0) 00010000:00010000:1.0:1786562544.194227:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562544.194238:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f38e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce5a expref: 13 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.194258:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f38e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce5a expref: 13 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.194278:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880c00, rc 0) 00000100:00100000:1.0:1786562544.194347:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64168:x1873345652842752:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 267us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562544.194355:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17780 00000100:00100000:1.0:1786562544.199356:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.199405:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562544.199743:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843008 00000100:00100000:2.0:1786562544.199756:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843008 00002000:00010000:2.0:1786562544.199814:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1815 (4194304->18446744073709551615) 00002000:00100000:2.0:1786562544.199821:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e6680 with x1873345652843008 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1786562544.199837:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b46e6680. 00000100:00100000:2.0:1786562544.199877:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652842880 00000100:00100000:2.0:1786562544.199881:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652842880 00002000:00010000:2.0:1786562544.199894:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1843 (5182624->18446744073709551615) 00002000:00100000:2.0:1786562544.199898:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e7100 with x1873345652842880 ext(5182624->18446744073709551615) 00002000:00010000:2.0:1786562544.199906:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b46e7100. 00000100:00100000:2.0:1786562544.199935:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11565 00000100:00100000:2.0:1786562544.199948:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2351:x1873345652843008:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562544.200418:0:29459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1786562544.200423:0:29459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562527 -> 1786562543 00002000:00010000:2.0:1786562544.200426:0:29459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562544.200428:0:29459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562527 -> 1786562543 00002000:00010000:2.0:1786562544.200430:0:29459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1786562544.200521:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:2351:x1873345652843008:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 575us (1181us total) trans 17179876076 rc 0/0 00000100:00100000:2.0:1786562544.200531:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11565 00002000:00010000:2.0:1786562544.200536:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1815 (4194304->18446744073709551615) 00002000:00100000:2.0:1786562544.200539:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e6680 with x1873345652843008 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1786562544.200545:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b46e6680. 00000100:00100000:2.0:1786562544.200567:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11566 00000100:00100000:2.0:1786562544.200575:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2351:x1873345652842880:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562544.200929:0:29459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5185536 -> 5182624 00002000:00010000:2.0:1786562544.200934:0:29459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562542 -> 1786562543 00002000:00010000:2.0:1786562544.200936:0:29459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562544.200938:0:29459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562542 -> 1786562543 00002000:00010000:2.0:1786562544.200941:0:29459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:2.0:1786562544.200969:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2351:x1873345652842880:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 394us (1562us total) trans 21474843590 rc 0/0 00000100:00100000:2.0:1786562544.200977:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11566 00002000:00010000:2.0:1786562544.200980:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1843 (5182624->18446744073709551615) 00002000:00100000:2.0:1786562544.200983:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e7100 with x1873345652842880 ext(5182624->18446744073709551615) 00002000:00010000:2.0:1786562544.200988:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b46e7100. 00000100:00100000:0.0:1786562544.206163:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562544.206622:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843136 00000100:00100000:2.0:1786562544.206637:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843136 00000100:00100000:2.0:1786562544.206721:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17119 00000100:00100000:2.0:1786562544.206733:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+10:64168:x1873345652843136:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562544.206767:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562544.206798:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f395 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce61 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.206918:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f39c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.206935:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f39c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.206948:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f39c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562544.206982:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:2.0:1786562544.206988:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562544.207456:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f39c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.207571:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f395 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce61 expref: 12 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.207598:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f39c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce61 expref: 11 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.207607:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562544.207610:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562544.207614:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca800, rc 0) 00000100:00100000:2.0:1786562544.207761:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652843136:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1029us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562544.207771:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17119 00000100:00100000:0.0:1786562544.224613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.224730:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843392 00000100:00100000:3.0:1786562544.224744:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843392 00000100:00100000:3.0:1786562544.224826:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17120 00000100:00100000:3.0:1786562544.224838:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:64168:x1873345652843392:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562544.224912:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562544.224949:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f39c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce61 expref: 11 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.224976:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562544.224982:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562544.225376:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.225395:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.225407:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562544.225474:0:34450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950671 00000004:00010000:3.0:1786562544.225504:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc76d565 reply state 00000000044fdaa4 transno 8589950672 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.225520:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562544.225642:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64168:x1873345652843392:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 805us (1044us total) trans 8589950672 rc 0/0 00000100:00100000:3.0:1786562544.225651:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17120 00000020:00080000:3.0:1786562544.225657:0:34450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786562544.227377:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.227398:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.227411:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.227418:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562544.227423:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.227432:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.227452:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562544.227455:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562544.227461:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.227468:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364e00/0x5c655bf66689f3a3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.242165:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.244755:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843520 00000100:00100000:1.0:1786562544.244776:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843520 00000100:00100000:1.0:1786562544.244876:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17781 00000100:00100000:1.0:1786562544.244890:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64168:x1873345652843520:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562544.244916:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562544.244945:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f3aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce68 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562544.244981:0:37002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:1.0:1786562544.245065:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=976s v=(0 0) 00010000:00010000:1.0:1786562544.245072:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562544.245084:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce68 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.245103:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce68 expref: 13 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.245130:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881c00, rc 0) 00000100:00100000:1.0:1786562544.245225:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64168:x1873345652843520:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 338us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562544.245233:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17781 00000100:00100000:1.0:1786562544.250267:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.250431:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843648 00000100:00100000:3.0:1786562544.250444:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843648 00000100:00100000:3.0:1786562544.250533:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17782 00000100:00100000:3.0:1786562544.250546:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64168:x1873345652843648:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.250571:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.250601:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f3b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce6f expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.250640:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x718:0x0] initial LVB size: 8388608, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:3.0:1786562544.250677:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.250683:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.250697:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce6f expref: 14 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.250722:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce6f expref: 14 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.250737:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364200, rc 0) 00000100:00100000:3.0:1786562544.250822:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64168:x1873345652843648:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 279us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.250832:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17782 00000100:00100000:0.0:1786562544.255170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.256459:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843776 00000100:00100000:3.0:1786562544.256476:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843776 00000100:00100000:3.0:1786562544.256582:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17783 00000100:00100000:3.0:1786562544.256596:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64168:x1873345652843776:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.256622:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.256650:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f3b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce76 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562544.256685:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x719:0x0] initial LVB size: 5185536, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:3.0:1786562544.256717:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=976s v=(0 0) 00010000:00010000:3.0:1786562544.256723:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.256734:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce76 expref: 15 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.256754:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce76 expref: 15 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.256770:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364a00, rc 0) 00000100:00100000:3.0:1786562544.256864:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64168:x1873345652843776:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 271us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.256872:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17783 00000100:00100000:0.0:1786562544.265368:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.265428:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562544.265541:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652843904 00000100:00100000:2.0:1786562544.265555:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652843904 00002000:00010000:2.0:1786562544.265614:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1817 (5182624->18446744073709551615) 00002000:00100000:2.0:1786562544.265620:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bae94000 with x1873345652843904 ext(5182624->18446744073709551615) 00002000:00010000:2.0:1786562544.265636:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bae94000. 00000100:00100000:2.0:1786562544.265674:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844032 00000100:00100000:2.0:1786562544.265678:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844032 00002000:00010000:2.0:1786562544.265692:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1844 (4194304->18446744073709551615) 00002000:00100000:2.0:1786562544.265696:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bae95500 with x1873345652844032 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1786562544.265704:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bae95500. 00000100:00100000:2.0:1786562544.265730:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11567 00000100:00100000:2.0:1786562544.265742:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652843904:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562544.266182:0:29460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5185536 -> 5182624 00002000:00010000:2.0:1786562544.266187:0:29460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562543 -> 1786562543 00002000:00010000:2.0:1786562544.266190:0:29460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562544.266192:0:29460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:2.0:1786562544.266195:0:29460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:2.0:1786562544.266272:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652843904:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 531us (919us total) trans 17179876077 rc 0/0 00000100:00100000:2.0:1786562544.266281:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11567 00002000:00010000:2.0:1786562544.266285:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1817 (5182624->18446744073709551615) 00002000:00100000:2.0:1786562544.266288:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bae94000 with x1873345652843904 ext(5182624->18446744073709551615) 00002000:00010000:2.0:1786562544.266293:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bae94000. 00000100:00100000:2.0:1786562544.266314:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11568 00000100:00100000:2.0:1786562544.266322:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652844032:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562544.266506:0:29460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1786562544.266510:0:29460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562527 -> 1786562543 00002000:00010000:2.0:1786562544.266512:0:29460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562544.266514:0:29460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562527 -> 1786562543 00002000:00010000:2.0:1786562544.266516:0:29460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1786562544.266540:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652844032:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 218us (1110us total) trans 21474843591 rc 0/0 00000100:00100000:2.0:1786562544.266547:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11568 00002000:00010000:2.0:1786562544.266550:0:29460:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1844 (4194304->18446744073709551615) 00002000:00100000:2.0:1786562544.266553:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bae95500 with x1873345652844032 ext(4194304->18446744073709551615) 00002000:00010000:2.0:1786562544.266559:0:29460:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bae95500. 00000100:00100000:1.0:1786562544.271620:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562544.271887:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844288 00000100:00100000:2.0:1786562544.271900:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844288 00000100:00100000:2.0:1786562544.271984:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17121 00000100:00100000:2.0:1786562544.271996:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+12:64168:x1873345652844288:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562544.272194:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.272215:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.272228:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562544.272696:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b504bfb reply state 00000000b71f4703 transno 8589950673 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562544.272708:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562544.272844:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:64168:x1873345652844288:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 846us (1235us total) trans 8589950673 rc 0/0 00000100:00100000:2.0:1786562544.272852:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17121 00000100:00100000:0.0:1786562544.279268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562544.279379:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.279396:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.279404:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.279411:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562544.279416:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.279425:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.279447:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562544.279451:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562544.279456:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.279462:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f3bf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.280408:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844416 00000100:00100000:3.0:1786562544.280426:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844416 00000100:00100000:3.0:1786562544.280521:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17784 00000100:00100000:3.0:1786562544.280533:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64168:x1873345652844416:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.280562:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.280588:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce7d expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.280633:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.280645:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562544.280651:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.280657:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce7d expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.280702:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.280717:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.280734:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654887296:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562544.280863:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562544.289772:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654887296:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562544.289829:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce7d expref: 17 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.289858:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364c00, rc 0) 00000100:00100000:3.0:1786562544.289943:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64168:x1873345652844416:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 9410us (10690us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.289954:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17784 00000100:00100000:1.0:1786562544.301985:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.302164:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844544 00000100:00100000:0.0:1786562544.302177:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844544 00010000:00010000:0.0:1786562544.302236:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.302286:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8725 00000100:00100000:0.0:1786562544.302299:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652844544:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562544.302318:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562544.302351:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.302368:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.302400:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3984d42/0x5c655bf66689f27d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce0d expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.302423:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.302428:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.302439:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce7d expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.302451:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce7d expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.302523:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce7d expref: 16 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.302543:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654887424:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562544.302657:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562544.325922:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.326146:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873345654887424:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562544.326179:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562544.326258:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2348:x1873345652844544:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 23961us (24289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562544.326272:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8725 00000100:00100000:3.0:1786562544.326479:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844672 00000100:00100000:3.0:1786562544.326498:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844672 00000100:00100000:3.0:1786562544.326567:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17785 00000100:00100000:3.0:1786562544.326580:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64168:x1873345652844672:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.326606:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.326631:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce84 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.326676:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 16 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.326688:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562544.326693:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.326698:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce84 expref: 16 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.326741:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 16 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.326757:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.326774:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654887552:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562544.326843:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562544.330977:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.331149:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844800 00000100:00100000:0.0:1786562544.331161:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844800 00010000:00010000:0.0:1786562544.331217:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.331269:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8726 00000100:00100000:0.0:1786562544.331280:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652844800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562544.331302:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562544.331342:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.331358:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.331391:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.331396:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.331406:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce84 expref: 17 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.331423:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce84 expref: 17 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.331472:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce84 expref: 17 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.331502:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654887680:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562544.331605:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5000 going to sleep for 11 seconds 00010000:00010000:3.0:1786562544.332728:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f869d53/0x5c655bf66689f284 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce14 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.332757:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654887552:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562544.332793:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce84 expref: 16 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.332808:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:3.0:1786562544.334763:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64168:x1873345652844672:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8167us (8839us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.334780:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17785 00000100:00100000:3.0:1786562544.343847:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654887680:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562544.343884:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562544.343966:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652844800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12686us (13002us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.343981:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8726 00000100:00100000:2.0:1786562544.348408:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.348650:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652844928 00000100:00100000:3.0:1786562544.348664:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652844928 00000100:00100000:3.0:1786562544.348743:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17786 00000100:00100000:3.0:1786562544.348756:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64168:x1873345652844928:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.348783:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.348809:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce8b expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.348859:0:29967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 16 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.348870:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562544.348876:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.348881:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce8b expref: 16 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.348928:0:29967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 16 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.348943:0:29967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.348959:0:29967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654887808:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562544.350801:0:29967:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562544.371500:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.371820:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845056 00000100:00100000:1.0:1786562544.371832:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845056 00010000:00010000:1.0:1786562544.371888:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.371939:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8727 00000100:00100000:1.0:1786562544.371950:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652845056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562544.371969:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562544.371999:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.372060:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.372095:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562544.372100:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562544.372111:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce8b expref: 17 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.372134:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce8b expref: 17 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.372184:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce8b expref: 17 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.372201:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654887936:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562544.372306:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227f00 going to sleep for 11 seconds 00010000:00010000:3.0:1786562544.372854:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2bca6ca/0x5c655bf66689f28b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce1b expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.372874:0:29967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:29967:1873345654887808:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562544.372908:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce8b expref: 16 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.372924:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:3.0:1786562544.372977:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64168:x1873345652844928:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 24224us (24584us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.372985:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17786 00000100:00100000:0.0:1786562544.383740:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562544.383982:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845184 00000100:00100000:2.0:1786562544.383996:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845184 00000100:00100000:2.0:1786562544.384137:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17787 00000100:00100000:2.0:1786562544.384150:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64168:x1873345652845184:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562544.384177:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562544.384202:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce92 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.384247:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.384258:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786562544.384264:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562544.384270:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce92 expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.384328:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.384344:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562544.384363:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654888064:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562544.384459:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af847480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562544.385147:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654887936:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562544.385176:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562544.385227:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2348:x1873345652845056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13278us (13751us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562544.385239:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8727 00000100:00100000:2.0:1786562544.387561:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654888064:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562544.387611:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce92 expref: 17 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.387638:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca800, rc 0) 00000100:00100000:2.0:1786562544.387709:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64168:x1873345652845184:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3561us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562544.387723:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17787 00000100:00100000:2.0:1786562544.397229:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.398555:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845312 00000100:00100000:0.0:1786562544.398573:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845312 00010000:00010000:0.0:1786562544.398642:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.398707:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8728 00000100:00100000:0.0:1786562544.398721:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2348:x1873345652845312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562544.398744:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562544.398777:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.398795:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.398827:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ecbff61/0x5c655bf66689f299 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce22 expref: 17 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.398853:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.398859:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.398868:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce92 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.398881:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce92 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.398934:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce92 expref: 16 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.398953:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654888192:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562544.399154:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562544.402917:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.403051:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845440 00000100:00100000:1.0:1786562544.403063:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845440 00000100:00100000:1.0:1786562544.403150:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17788 00000100:00100000:1.0:1786562544.403164:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64168:x1873345652845440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562544.403189:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562544.403215:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfce99 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.403259:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.403270:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786562544.403276:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562544.403282:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce99 expref: 18 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.403600:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.403619:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.403636:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654888320:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562544.403756:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562544.404569:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654888192:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562544.404597:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562544.404655:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2348:x1873345652845312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5937us (7442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562544.404667:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8728 00000100:00100000:0.0:1786562544.412146:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.412255:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845568 00000100:00100000:3.0:1786562544.412266:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845568 00010000:00010000:3.0:1786562544.412332:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.412383:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8729 00000100:00100000:3.0:1786562544.412394:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652845568:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562544.412415:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562544.412447:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.412464:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.412509:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.412515:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.412526:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce99 expref: 18 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.412537:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce99 expref: 18 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.412588:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce99 expref: 18 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.412606:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654888448:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562544.412725:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1786562544.414145:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f292 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce29 expref: 18 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.414171:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654888320:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562544.414205:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce99 expref: 17 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.414220:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880000, rc 0) 00000100:00100000:1.0:1786562544.414285:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:64168:x1873345652845440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11124us (11383us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562544.414295:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17788 00000100:00100000:3.0:1786562544.416396:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6673:1873345654888448:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562544.416434:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562544.416798:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652845568:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4402us (4666us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.416814:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8729 00010000:00010000:1.0:1786562544.422635:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562544.422786:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.422884:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845696 00000100:00100000:3.0:1786562544.422898:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845696 00000100:00100000:3.0:1786562544.422975:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17789 00000100:00100000:3.0:1786562544.422987:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:64168:x1873345652845696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562544.423051:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562544.423076:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcea0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.423128:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.423139:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562544.423143:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562544.423148:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea0 expref: 16 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.423195:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.423210:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.423226:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654888576:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562544.423338:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562544.433682:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.433842:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654888576:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562544.433893:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea0 expref: 16 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.433922:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92d600, rc 0) 00000100:00100000:3.0:1786562544.434050:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:64168:x1873345652845696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11019us (11228us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562544.434061:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17789 00000100:00100000:0.0:1786562544.434669:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845824 00000100:00100000:0.0:1786562544.434680:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845824 00010000:00010000:0.0:1786562544.434728:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.434768:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8730 00000100:00100000:0.0:1786562544.434779:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652845824:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562544.434797:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562544.434828:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.434844:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.434874:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058091fd6/0x5c655bf66689f2a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce30 expref: 16 pid: 29964 timeout: 1076 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.434893:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.434899:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562544.434909:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea0 expref: 15 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.434920:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea0 expref: 15 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.434967:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea0 expref: 15 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.434984:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654888704:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562544.435138:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562544.448252:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654888704:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562544.448292:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562544.448379:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652845824:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13600us (14713us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562544.448397:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8730 00000100:00100000:0.0:1786562544.451422:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.451465:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.451615:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652845952 00000100:00100000:1.0:1786562544.451630:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652845952 00000100:00100000:1.0:1786562544.451703:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846208 00000100:00100000:1.0:1786562544.451707:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846208 00000100:00100000:1.0:1786562544.451741:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17790 00000100:00100000:1.0:1786562544.451753:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652845952:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562544.452074:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1786562544.452078:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.452081:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562536 -> 1786562540 00002000:00010000:1.0:1786562544.452084:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562540 -> 1786562543 00002000:00010000:1.0:1786562544.452086:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562544.452166:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652845952:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 414us (758us total) trans 17179876078 rc 0/0 00000100:00100000:1.0:1786562544.452174:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17790 00000100:00100000:1.0:1786562544.452196:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17791 00000100:00100000:1.0:1786562544.452203:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+15:2349:x1873345652846208:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562544.452328:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562544.452331:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.452333:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562539 -> 1786562540 00002000:00010000:1.0:1786562544.452334:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562540 -> 1786562543 00002000:00010000:1.0:1786562544.452336:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562544.452358:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+16:2349:x1873345652846208:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 155us (893us total) trans 21474843592 rc 0/0 00000100:00100000:1.0:1786562544.452364:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17791 00000100:00100000:0.0:1786562544.452741:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.452776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.452806:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.452870:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.452944:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846464 00000100:00100000:3.0:1786562544.452950:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846464 00000100:00100000:3.0:1786562544.452997:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846080 00000100:00100000:3.0:1786562544.453000:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846080 00000100:00100000:3.0:1786562544.453040:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846336 00000100:00100000:3.0:1786562544.453043:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846336 00000100:00100000:3.0:1786562544.453058:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846592 00000100:00100000:3.0:1786562544.453061:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846592 00000100:00100000:3.0:1786562544.453079:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17792 00000100:00100000:3.0:1786562544.453088:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652846464:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562544.453246:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:3.0:1786562544.453249:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.453252:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.453254:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562540 -> 1786562543 00002000:00010000:3.0:1786562544.453256:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:3.0:1786562544.453293:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652846464:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 206us (555us total) trans 17179876079 rc 0/0 00000100:00100000:3.0:1786562544.453300:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17792 00000100:00100000:3.0:1786562544.453316:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17793 00000100:00100000:3.0:1786562544.453323:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652846080:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562544.453409:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562544.453413:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.453415:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562537 -> 1786562540 00002000:00010000:3.0:1786562544.453417:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562540 -> 1786562543 00002000:00010000:3.0:1786562544.453419:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1786562544.453442:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652846080:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 120us (666us total) trans 21474843593 rc 0/0 00000100:00100000:3.0:1786562544.453448:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17793 00000100:00100000:3.0:1786562544.453460:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17794 00000100:00100000:3.0:1786562544.453467:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652846336:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562544.453545:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562544.453548:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562539 -> 1786562540 00002000:00010000:3.0:1786562544.453550:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562538 -> 1786562540 00002000:00010000:3.0:1786562544.453553:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562539 -> 1786562543 00002000:00010000:3.0:1786562544.453556:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1786562544.453578:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2349:x1873345652846336:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 112us (772us total) trans 17179876080 rc 0/0 00000100:00100000:3.0:1786562544.453585:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17794 00000100:00100000:3.0:1786562544.453598:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17795 00000100:00100000:3.0:1786562544.453605:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+17:2349:x1873345652846592:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562544.453690:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562544.453693:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.453695:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.453697:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562540 -> 1786562543 00002000:00010000:3.0:1786562544.453699:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562544.453723:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2349:x1873345652846592:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 119us (853us total) trans 21474843594 rc 0/0 00000100:00100000:3.0:1786562544.453730:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17795 00000100:00100000:2.0:1786562544.471541:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562544.471724:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846848 00000100:00100000:3.0:1786562544.471739:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846848 00000100:00100000:3.0:1786562544.471813:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6287 00000100:00100000:3.0:1786562544.471826:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:64168:x1873345652846848:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:3.0:1786562544.471918:0:34647:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1be00/0x5c655bf66689f229 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdf8 expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.471991:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.472052:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.472063:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.472109:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.472136:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 13 pid: 33140 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562544.472154:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654888832:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562544.472256:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff63cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562544.474725:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654888832:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562544.474768:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562544.481742:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562544.481891:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652846976 00000100:00100000:1.0:1786562544.481905:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652846976 00010000:00010000:1.0:1786562544.481963:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 14 pid: 33140 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.482063:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8731 00000100:00100000:1.0:1786562544.482078:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2348:x1873345652846976:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562544.482098:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562544.482107:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 14 pid: 33140 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.482135:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 14 pid: 33140 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.482167:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a400/0x5c655bf66689f268 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdff expref: 14 pid: 33140 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.482190:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562544.482197:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.482209:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.482217:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562544.482258:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562544.482323:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2348:x1873345652846976:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562544.482332:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8731 00010000:00010000:3.0:1786562544.482644:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562544.482654:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562544.506773:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4397, 88 off357184 00000004:00080000:0.0:1786562544.506800:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976948793959ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.506888:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4372, 88 off354808 00000004:00080000:0.0:1786562544.506896:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976948890617ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.506923:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4373, 88 off354896 00000004:00080000:0.0:1786562544.506927:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976948921640ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.506943:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4398, 88 off357272 00000004:00080000:0.0:1786562544.506946:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976948939929ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.506958:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4399, 88 off357360 00000004:00080000:0.0:1786562544.506962:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976948956292ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.506977:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4374, 88 off354984 00000004:00080000:0.0:1786562544.506981:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976948975187ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.506995:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4375, 88 off355072 00000004:00080000:0.0:1786562544.506998:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976948992640ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.507064:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4376, 88 off355160 00000004:00080000:0.0:1786562544.507069:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976949063667ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.507088:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4400, 88 off357448 00000004:00080000:0.0:1786562544.507091:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976949085702ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.507108:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4377, 88 off355248 00000004:00080000:0.0:1786562544.507113:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976949106898ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.507145:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4401, 88 off357536 00000004:00080000:0.0:1786562544.507150:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976949144049ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.507169:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4378, 88 off355336 00000004:00080000:0.0:1786562544.507173:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976949167427ns, next at 911624464511ns, rc = 0 00000040:00080000:0.0:1786562544.507188:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4402, 88 off357624 00000004:00080000:0.0:1786562544.507191:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976949185444ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.507206:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4403, 88 off357712 00000004:00080000:0.0:1786562544.507210:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976949203944ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.507225:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4404, 88 off357800 00000004:00080000:0.0:1786562544.507229:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976949223527ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.507244:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4405, 88 off357888 00000004:00080000:0.0:1786562544.507248:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 976949242452ns, next at 911624567946ns, rc = 0 00000040:00080000:0.0:1786562544.507264:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4379, 88 off355424 00000004:00080000:0.0:1786562544.507267:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 976949261478ns, next at 911624464511ns, rc = 0 00000001:00080000:2.0:1786562544.605442:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950674 is committed 00000004:00080000:2.0:1786562544.605462:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2887 committed 00000004:00080000:2.0:1786562544.605486:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2915 committed 00000004:00080000:2.0:1786562544.605501:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2914 committed 00000004:00080000:2.0:1786562544.605503:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2913 committed 00000004:00080000:2.0:1786562544.605505:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2912 committed 00000004:00080000:2.0:1786562544.605507:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2886 committed 00000004:00080000:2.0:1786562544.605509:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2911 committed 00000004:00080000:2.0:1786562544.605511:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2885 committed 00000004:00080000:2.0:1786562544.605513:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2910 committed 00000004:00080000:2.0:1786562544.605515:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2884 committed 00000004:00080000:2.0:1786562544.605517:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2883 committed 00000004:00080000:2.0:1786562544.605519:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2882 committed 00000004:00080000:2.0:1786562544.605521:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2909 committed 00000004:00080000:2.0:1786562544.605523:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2908 committed 00000004:00080000:2.0:1786562544.605526:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2881 committed 00000004:00080000:2.0:1786562544.605528:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2880 committed 00000004:00080000:2.0:1786562544.605530:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2907 committed 00000100:00100000:1.0:1786562544.605769:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654889088:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1786562544.605839:0:34647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb52844 reply state 00000000783db55f transno 8589950674 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562544.605856:0:34647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562544.605869:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00000100:00100000:1.0:1786562544.605873:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786562544.605873:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562544.605883:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1be00/0x5c655bf66689f229 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcdf8 expref: 7 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.605927:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654889600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.605951:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.605972:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654890112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.605989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1786562544.606075:0:34647:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1786562544.606098:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:64168:x1873345652846848:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 134269us (134568us total) trans 8589950674 rc 0/0 00000100:00100000:0.0:1786562544.606122:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6287 00000100:00100000:2.0:1786562544.606136:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654888960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562544.606202:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889088 00000100:00100000:3.0:1786562544.606210:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889088 00000100:00100000:3.0:1786562544.606261:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889600 00000100:00100000:3.0:1786562544.606265:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889600 00000100:00100000:3.0:1786562544.606283:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890112 00000100:00100000:3.0:1786562544.606286:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890112 00000100:00100000:3.0:1786562544.606307:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17796 00000100:00100000:3.0:1786562544.606332:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654889088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562544.606616:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654890624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.606644:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1786562544.606682:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1786562544.606683:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889216:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562544.606686:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.606689:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.606692:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:3.0:1786562544.606694:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x713:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1786562544.606710:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786562544.606813:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.606825:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.606834:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.606841:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bf92c600 already unused, calling callback (ffffffffc1f8c4f0) 00000100:00100000:1.0:1786562544.606842:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889728:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1786562544.606846:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.606855:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.606865:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786562544.606876:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562544.606879:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1786562544.606881:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890240:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1786562544.606884:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562544.606890:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f3f0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562544.606899:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.606916:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.606935:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.606967:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1786562544.606973:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.607032:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562544.607048:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654889088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 719us (1175us total) trans 17179876081 rc 0/0 00000100:00100000:1.0:1786562544.607051:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562544.607057:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17796 00000100:00100000:1.0:1786562544.607070:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.607086:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.607107:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562544.608606:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890624 00000100:00100000:3.0:1786562544.608635:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890624 00000100:00100000:3.0:1786562544.608718:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889216 00000100:00100000:3.0:1786562544.608722:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889216 00000100:00100000:3.0:1786562544.608750:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889728 00000100:00100000:3.0:1786562544.608753:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889728 00000100:00100000:3.0:1786562544.608764:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890240 00000100:00100000:3.0:1786562544.608767:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890240 00000100:00100000:3.0:1786562544.608776:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890752 00000100:00100000:3.0:1786562544.608778:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890752 00000100:00100000:3.0:1786562544.608788:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889344 00000100:00100000:3.0:1786562544.608791:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889344 00000100:00100000:3.0:1786562544.608800:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889856 00000100:00100000:3.0:1786562544.608803:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889856 00000100:00100000:3.0:1786562544.608823:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17797 00000100:00100000:3.0:1786562544.608833:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3292:x1873345654889600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562544.609196:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562544.609200:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.609203:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.609206:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:3.0:1786562544.609209:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562544.609305:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3292:x1873345654889600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 472us (3350us total) trans 21474843595 rc 0/0 00000100:00100000:3.0:1786562544.610977:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17797 00000100:00100000:2.0:1786562544.611037:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17798 00000100:00100000:3.0:1786562544.611045:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17799 00000100:00100000:3.0:1786562544.611061:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3292:x1873345654890624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562544.611062:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3292:x1873345654890112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.613383:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.613491:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.613555:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890368 00000100:00100000:1.0:1786562544.613566:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890368 00000100:00100000:1.0:1786562544.613619:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890880 00000100:00100000:1.0:1786562544.613622:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890880 00000100:00100000:1.0:1786562544.613638:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17800 00000100:00100000:1.0:1786562544.613649:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654889216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562544.614032:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:1.0:1786562544.614037:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.614040:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.614042:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.614045:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x714:0x0] updating lvb blocks from disk: 6151 -> 6151 00000100:00100000:1.0:1786562544.614104:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654889216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 456us (7392us total) trans 17179876082 rc 0/0 00000100:00100000:1.0:1786562544.614126:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17800 00000100:00100000:1.0:1786562544.614150:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17801 00000100:00100000:1.0:1786562544.614158:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654889728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562544.614281:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562544.614284:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb mtime from disk: 1786562542 -> 1786562542 00002000:00010000:1.0:1786562544.614286:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562544.614288:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb ctime from disk: 1786562542 -> 1786562542 00002000:00010000:1.0:1786562544.614290:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x716:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562544.614321:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654889728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (7454us total) trans 17179876083 rc 0/0 00000100:00100000:1.0:1786562544.614327:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17801 00000100:00100000:1.0:1786562544.614340:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17802 00000100:00100000:1.0:1786562544.614347:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654890240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562544.614440:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1786562544.614444:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb mtime from disk: 1786562542 -> 1786562542 00002000:00010000:1.0:1786562544.614447:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562544.614449:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb ctime from disk: 1786562542 -> 1786562542 00002000:00010000:1.0:1786562544.614451:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x712:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1786562544.614476:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3289:x1873345654890240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (7576us total) trans 17179876084 rc 0/0 00000100:00100000:1.0:1786562544.614482:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17802 00000100:00100000:1.0:1786562544.614494:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17803 00000100:00100000:1.0:1786562544.614502:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654890752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562544.614618:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:1.0:1786562544.614621:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb mtime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.614624:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562544.614626:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.614628:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x733:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:1.0:1786562544.614656:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654890752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (7720us total) trans 21474843596 rc 0/0 00000100:00100000:1.0:1786562544.614662:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17803 00000100:00100000:1.0:1786562544.614674:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17804 00000100:00100000:1.0:1786562544.614681:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654889344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562544.618228:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562544.618245:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb mtime from disk: 1786562542 -> 1786562542 00002000:00010000:3.0:1786562544.618248:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562544.618251:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb ctime from disk: 1786562542 -> 1786562542 00002000:00010000:3.0:1786562544.618254:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x732:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562544.619937:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654890624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8871us (13277us total) trans 21474843597 rc 0/0 00000100:00100000:3.0:1786562544.619955:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17799 00000100:00100000:3.0:1786562544.620022:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17805 00000100:00100000:3.0:1786562544.620040:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654889856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562544.620520:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17806 00000100:00100000:0.0:1786562544.620533:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654890368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562544.620700:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1786562544.620705:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb mtime from disk: 1786562541 -> 1786562541 00002000:00010000:0.0:1786562544.620708:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562544.620710:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb ctime from disk: 1786562541 -> 1786562541 00002000:00010000:0.0:1786562544.620713:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x731:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562544.621548:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654890368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1013us (14433us total) trans 21474843598 rc 0/0 00000100:00100000:0.0:1786562544.621559:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17806 00000100:00100000:0.0:1786562544.621592:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17807 00000100:00100000:0.0:1786562544.621603:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1873345654890880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.621972:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.622054:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654889472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562544.622106:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.622137:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654889984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562544.622160:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.622175:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654890496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562544.622194:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.622232:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654888960 00000100:00100000:1.0:1786562544.622241:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654888960 00000100:00100000:1.0:1786562544.622277:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889472 00000100:00100000:1.0:1786562544.622280:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889472 00000100:00100000:1.0:1786562544.622295:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654889984 00000100:00100000:1.0:1786562544.622298:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654889984 00000100:00100000:1.0:1786562544.622313:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654890496 00000100:00100000:1.0:1786562544.622316:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654890496 00000100:00100000:1.0:1786562544.622332:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17808 00000100:00100000:1.0:1786562544.622339:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3291:x1873345654888960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562544.624882:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1786562544.624899:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.624902:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:3.0:1786562544.624904:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:3.0:1786562544.624906:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x730:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562544.625033:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654889856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4997us (17955us total) trans 21474843599 rc 0/0 00000100:00100000:3.0:1786562544.625045:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17805 00000100:00100000:3.0:1786562544.625082:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17809 00000100:00100000:3.0:1786562544.625098:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3291:x1873345654889472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562544.625341:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1786562544.625345:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb mtime from disk: 1786562541 -> 1786562541 00002000:00010000:3.0:1786562544.625347:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562544.625349:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb ctime from disk: 1786562541 -> 1786562541 00002000:00010000:3.0:1786562544.625351:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x715:0x0] updating lvb blocks from disk: 4103 -> 4103 00002000:00010000:0.0:1786562544.625580:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562544.625584:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb mtime from disk: 1786562543 -> 1786562543 00002000:00010000:0.0:1786562544.625587:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562544.625588:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:0.0:1786562544.625590:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x734:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1786562544.625625:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654890880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4025us (12140us total) trans 21474843600 rc 0/0 00000100:00100000:0.0:1786562544.625634:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17807 00000100:00100000:0.0:1786562544.625655:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17810 00000100:00100000:0.0:1786562544.625664:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654889984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562544.625678:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1786562544.625681:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.625683:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.625686:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.625688:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x711:0x0] updating lvb blocks from disk: 2055 -> 2055 00002000:00010000:0.0:1786562544.625758:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1786562544.625762:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb mtime from disk: 1786562543 -> 1786562543 00002000:00010000:0.0:1786562544.625764:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562544.625766:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:0.0:1786562544.625767:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x717:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1786562544.625889:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3291:x1873345654889472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 798us (3781us total) trans 17179876085 rc 0/0 00000100:00100000:3.0:1786562544.625897:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17809 00000100:00100000:1.0:1786562544.625961:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654888960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3621us (3989us total) trans 17179876086 rc 0/0 00000100:00100000:1.0:1786562544.625969:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17808 00000100:00100000:1.0:1786562544.626596:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17811 00000100:00100000:1.0:1786562544.626613:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3291:x1873345654890496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562544.626941:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb size from disk: 8388608 -> 8388608 00002000:00010000:1.0:1786562544.626946:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb mtime from disk: 1786562542 -> 1786562542 00002000:00010000:1.0:1786562544.626948:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562544.626951:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb ctime from disk: 1786562542 -> 1786562542 00002000:00010000:1.0:1786562544.626953:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x718:0x0] updating lvb blocks from disk: 8199 -> 8199 00000100:00100000:1.0:1786562544.627037:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654890496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 430us (4840us total) trans 17179876088 rc 0/0 00000100:00100000:1.0:1786562544.627046:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17811 00000004:00080000:1.0:1786562544.627181:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e4700/2, rc 0, transno 17179876081 00000100:00100000:1.0:1786562544.627201:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654889088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562544.627218:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4380/2, rc 0, transno 21474843595 00000100:00100000:1.0:1786562544.627223:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654889600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562544.627235:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9921880/2, rc 0, transno 21474843597 00000100:00100000:1.0:1786562544.627239:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654890624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562544.627317:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562544.627333:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654891008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562544.627376:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562544.627411:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891008 00000100:00100000:1.0:1786562544.627419:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891008 00000004:00080000:3.0:1786562544.628989:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e6d80/2, rc 0, transno 17179876086 00000100:00100000:3.0:1786562544.629024:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654888960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562544.629043:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e7480/2, rc 0, transno 17179876085 00000100:00100000:3.0:1786562544.629048:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654889472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562544.629255:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17812 00000100:00100000:1.0:1786562544.629280:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3292:x1873345654891008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1786562544.630136:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562544.630144:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb mtime from disk: 1786562541 -> 1786562541 00002000:00010000:2.0:1786562544.630147:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562544.630150:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb ctime from disk: 1786562541 -> 1786562541 00002000:00010000:2.0:1786562544.630153:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72d:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562544.630266:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654890112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 19215us (24272us total) trans 21474843601 rc 0/0 00000100:00100000:2.0:1786562544.630278:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17798 00002000:00010000:1.0:1786562544.630891:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb size from disk: 5182624 -> 5182624 00002000:00010000:1.0:1786562544.630898:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb mtime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.630900:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562544.630902:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.630905:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x719:0x0] updating lvb blocks from disk: 1967 -> 1967 00000100:00100000:1.0:1786562544.630951:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3292:x1873345654891008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1682us (3572us total) trans 17179876089 rc 0/0 00000100:00100000:1.0:1786562544.630960:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17812 00000004:00080000:1.0:1786562544.632102:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5ce00/2, rc 0, transno 17179876089 00000100:00100000:1.0:1786562544.632130:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654891008:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562544.632155:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f5f80/2, rc 0, transno 21474843601 00000100:00100000:1.0:1786562544.632161:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654890112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562544.632201:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f6680/2, rc 0, transno 21474843599 00000100:00100000:1.0:1786562544.632205:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562544.632215:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4700/2, rc 0, transno 21474843598 00000100:00100000:1.0:1786562544.632219:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562544.632229:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9923480/2, rc 0, transno 21474843600 00000100:00100000:1.0:1786562544.632232:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562544.632244:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e5880/2, rc 0, transno 17179876082 00000100:00100000:1.0:1786562544.632247:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889216:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562544.632257:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e6a00/2, rc 0, transno 17179876083 00000100:00100000:1.0:1786562544.632260:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562544.632270:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e4000/2, rc 0, transno 17179876084 00000100:00100000:1.0:1786562544.632274:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890240:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1786562544.632285:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9921f80/2, rc 0, transno 21474843596 00000100:00100000:1.0:1786562544.632288:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654890752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562544.633174:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654889984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7501us (11002us total) trans 17179876087 rc 0/0 00000100:00100000:0.0:1786562544.633192:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17810 00000004:00080000:3.0:1786562544.633436:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e4380/2, rc 0, transno 17179876087 00000100:00100000:3.0:1786562544.633444:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654889984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562544.633457:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e5500/2, rc 0, transno 17179876088 00000100:00100000:3.0:1786562544.633461:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654890496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562544.636920:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:1.0:1786562544.637397:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562544.637403:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb mtime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.637406:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb atime from disk: 1786562540 -> 1786562540 00002000:00010000:1.0:1786562544.637408:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb ctime from disk: 1786562543 -> 1786562543 00002000:00010000:1.0:1786562544.637411:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72e:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1786562544.637519:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3289:x1873345654889344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 22835us (30482us total) trans 21474843602 rc 0/0 00000100:00100000:1.0:1786562544.637533:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17804 00000004:00080000:0.0:1786562544.637996:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f7100/2, rc 0, transno 21474843602 00000100:00100000:0.0:1786562544.638020:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654889344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562544.649684:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652847104 00000100:00100000:2.0:1786562544.649706:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652847104 00000100:00100000:2.0:1786562544.649821:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17122 00000100:00100000:2.0:1786562544.649833:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:64168:x1873345652847104:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562544.649870:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562544.649901:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f3f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcea7 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.650216:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea7 expref: 7 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.650238:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea7 expref: 7 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562544.650266:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:2.0:1786562544.650271:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562544.650276:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca600, rc 0) 00000100:00100000:2.0:1786562544.650362:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:64168:x1873345652847104:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 531us (13458us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562544.650371:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17122 00000100:00100000:3.0:1786562544.665525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562544.666077:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652847360 00000100:00100000:0.0:1786562544.666091:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652847360 00000100:00100000:0.0:1786562544.666178:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6288 00000100:00100000:0.0:1786562544.666190:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:64168:x1873345652847360:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562544.668651:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:64168:x1873345652847360:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 2447us (3127us total) trans 8589950675 rc 0/0 00000100:00100000:0.0:1786562544.668679:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6288 00010000:00010000:1.0:1786562545.448121:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562546.470803:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562547.495598:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562547.515493:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515545:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515581:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515612:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515630:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515671:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515692:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515750:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562547.515788:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652847872 00000100:00100000:1.0:1786562547.515799:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652847872 00000100:00100000:1.0:1786562547.515870:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848128 00000100:00100000:1.0:1786562547.515873:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848128 00000100:00100000:1.0:1786562547.515894:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848640 00000100:00100000:1.0:1786562547.515896:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848640 00000100:00100000:1.0:1786562547.515915:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652847744 00000100:00100000:1.0:1786562547.515917:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652847744 00000100:00100000:1.0:1786562547.515933:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848256 00000100:00100000:1.0:1786562547.515936:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848256 00000100:00100000:1.0:1786562547.515955:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848512 00000100:00100000:1.0:1786562547.515958:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848512 00000100:00100000:1.0:1786562547.515986:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 437 00000100:00100000:1.0:1786562547.515998:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652847872:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562547.516154:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652847872:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 159us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562547.516166:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 437 00000100:00100000:1.0:1786562547.516191:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 438 00000100:00100000:1.0:1786562547.516199:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2351:x1873345652848128:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562547.516228:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2351:x1873345652848128:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562547.516234:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 438 00000100:00100000:1.0:1786562547.516245:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 439 00000100:00100000:2.0:1786562547.516644:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652847616 00000100:00100000:2.0:1786562547.516651:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652847616 00000100:00100000:2.0:1786562547.516694:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848384 00000100:00100000:2.0:1786562547.516697:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848384 00000100:00100000:2.0:1786562547.516717:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848000 00000100:00100000:2.0:1786562547.516720:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848000 00000100:00100000:2.0:1786562547.516740:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 274 00000100:00100000:2.0:1786562547.516747:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+501:2351:x1873345652847616:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562547.516786:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+501:2351:x1873345652847616:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562547.516793:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 274 00000100:00100000:2.0:1786562547.516806:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 275 00000100:00100000:2.0:1786562547.516813:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:2351:x1873345652848384:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562547.516843:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+8:2351:x1873345652848384:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562547.516849:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 275 00000100:00100000:2.0:1786562547.516861:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 276 00000100:00100000:2.0:1786562547.516867:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2351:x1873345652848000:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562547.516895:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2351:x1873345652848000:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562547.516903:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 276 00000100:00100000:2.0:1786562547.516929:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 440 00000100:00100000:2.0:1786562547.516936:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652847744:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562547.516965:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652847744:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562547.516971:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 440 00000100:00100000:2.0:1786562547.516986:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 441 00000100:00100000:2.0:1786562547.516992:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2351:x1873345652848256:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562547.517049:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2351:x1873345652848256:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 56us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562547.517068:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 441 00000100:00100000:2.0:1786562547.517082:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 442 00000100:00100000:2.0:1786562547.517088:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652848512:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562547.517114:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+18:2351:x1873345652848512:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562547.517119:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 442 00000100:00100000:0.0:1786562547.517299:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652847488 00000100:00100000:0.0:1786562547.517305:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652847488 00000100:00100000:0.0:1786562547.517351:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 246 00000100:00100000:0.0:1786562547.517358:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+16:2351:x1873345652847488:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562547.517381:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+16:2351:x1873345652847488:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562547.517388:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 246 00000100:00100000:1.0:1786562547.517639:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2351:x1873345652848640:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562547.517673:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+19:2351:x1873345652848640:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1422us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562547.517681:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 439 00000100:00080000:3.0:1786562547.517822:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562547.517829:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562547.517832:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562548.517660:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562548.662169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562548.662483:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562548.662512:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562548.662543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562548.662633:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848768 00000100:00100000:1.0:1786562548.662649:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848768 00000100:00100000:1.0:1786562548.662722:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652849024 00000100:00100000:1.0:1786562548.662725:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652849024 00000100:00100000:1.0:1786562548.662746:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652848896 00000100:00100000:1.0:1786562548.662749:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652848896 00000100:00100000:1.0:1786562548.662775:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 974 00000100:00100000:1.0:1786562548.662785:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+18:2348:x1873345652848768:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562548.662805:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562548.662834:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e88a26f600/0x5c655bf66689a9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa69f expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562548.662855:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562548.662919:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+17:2348:x1873345652848768:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 135us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562548.662928:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 974 00000100:00100000:1.0:1786562548.663482:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 975 00000100:00100000:1.0:1786562548.663509:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+16:2348:x1873345652849024:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562548.663531:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562548.663555:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb268a00/0x5c655bf66689a9cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa6d0 expref: 16 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562548.663573:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562548.663630:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+15:2348:x1873345652849024:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 134us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562548.663639:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 975 00000100:00100000:2.0:1786562548.664535:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 976 00000100:00100000:2.0:1786562548.664556:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b4bd338-b43c-4989-b811-79054f6124e2+15:2348:x1873345652848896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562548.664576:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562548.664598:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb269200/0x5c655bf66689a9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa6c9 expref: 15 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562548.664616:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562548.664658:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b4bd338-b43c-4989-b811-79054f6124e2+14:2348:x1873345652848896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 113us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562548.664666:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 976 00000100:00100000:3.0:1786562548.669885:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652849152 00000100:00100000:3.0:1786562548.669906:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652849152 00000100:00100000:3.0:1786562548.669979:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17813 00000100:00100000:3.0:1786562548.669990:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2347:x1873345652849152:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:3.0:1786562548.670068:0:6660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689a9e4 00000100:00080000:3.0:1786562548.670081:0:6660:0:(import.c:65:import_set_state_nolock()) ffff90e9c1dc8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786562548.670135:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179876089 00010000:00010000:1.0:1786562548.670346:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562548.672967:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+2:2347:x1873345652849152:12345-192.168.204.29@tcp:9:umount.0 Request processed in 2959us (10402us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562548.673913:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17813 00000001:00080000:3.0:1786562548.682931:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843600 is committed 00000001:00080000:3.0:1786562548.682960:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843602 is committed 00000001:00080000:3.0:1786562548.682970:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843592 is committed 00000001:00080000:3.0:1786562548.683165:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843594 is committed 00000100:00100000:2.0:1786562548.698586:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562548.698898:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652849280 00000100:00100000:0.0:1786562548.698913:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652849280 00000100:00100000:0.0:1786562548.698988:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17814 00000100:00100000:0.0:1786562548.698997:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2347:x1873345652849280:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:3.0:1786562548.699454:0:28861:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689a9dd 00000100:00080000:3.0:1786562548.699473:0:28861:0:(import.c:65:import_set_state_nolock()) ffff90e88bfb3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786562548.699543:0:28861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843602 00000100:00100000:3.0:1786562548.699931:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+2:2347:x1873345652849280:12345-192.168.204.29@tcp:9:umount.0 Request processed in 930us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562548.699944:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17814 00010000:00010000:1.0:1786562548.700063:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562548.725701:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562548.725808:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652849536 00000100:00100000:0.0:1786562548.725824:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652849536 00000100:00100000:0.0:1786562548.725907:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17123 00000100:00100000:0.0:1786562548.725920:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+6:2347:x1873345652849536:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:0.0:1786562548.725965:0:33113:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689a9d6 00000020:00010000:0.0:1786562548.725978:0:33113:0:(genops.c:1942:obd_stale_export_put()) Put export ffff90e88bd2d000: total 0 00000100:00080000:0.0:1786562548.725984:0:33113:0:(import.c:65:import_set_state_nolock()) ffff90e88bd2c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786562548.726059:0:33113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589950675 00000100:00100000:0.0:1786562548.726642:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b3dc1ca5-a8ed-4b97-b774-56a52e1a472d+5:2347:x1873345652849536:12345-192.168.204.29@tcp:39:umount.0 Request processed in 721us (955us total) trans 8589950676 rc 0/0 00000100:00100000:0.0:1786562548.726652:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17123 00000020:00010000:1.0:1786562548.726750:0:8412:0:(genops.c:1928:obd_stale_export_get()) Get export ffff90e88bd2d000: total 0 00010000:00010000:1.0:1786562548.726755:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562548.726813:0:8412:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e88bd2d000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1786562548.726860:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562548.726864:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786562548.726873:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cb400/0x5c655bf66689aa93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa778 expref: 4 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562548.726894:0:8412:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e88bd2d000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1786562548.726906:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562548.726908:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562548.726910:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562549.029576:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654891392:0@lo:400:kworker.0 00000100:00100000:1.0:1786562549.029671:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562549.029746:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786562549.029752:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654891264:0@lo:400:kworker.0 00000100:00100000:1.0:1786562549.029772:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562549.029787:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654891776:0@lo:400:kworker.0 00000100:00100000:1.0:1786562549.029808:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562549.029854:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891392 00000100:00100000:1.0:1786562549.029865:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891392 00000100:00100000:3.0:1786562549.029909:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654891520:0@lo:400:kworker.0 00000100:00100000:1.0:1786562549.029931:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891264 00000100:00100000:1.0:1786562549.029937:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891264 00000100:00100000:1.0:1786562549.029962:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891776 00000100:00100000:1.0:1786562549.029964:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891776 00000100:00100000:3.0:1786562549.030039:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562549.030086:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786562549.030096:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654891136:0@lo:400:kworker.0 00000100:00080000:2.0:1786562549.030124:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562549.030132:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562549.030173:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654891648:0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.030206:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562549.030268:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1786562549.030285:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654891392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.030362:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654891392:12345-0@lo:400:kworker.0 Request processed in 84us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562549.030371:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1786562549.030405:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1786562549.030415:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654891264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.030465:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654891264:12345-0@lo:400:kworker.0 Request processed in 53us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562549.030478:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1786562549.030495:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1786562549.030504:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654891776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.030552:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654891776:12345-0@lo:400:kworker.0 Request processed in 46us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562549.030559:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1786562549.030645:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891520 00000100:00100000:3.0:1786562549.030654:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891520 00000100:00100000:2.0:1786562549.030664:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891648 00000100:00100000:2.0:1786562549.030672:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891648 00000100:00100000:3.0:1786562549.030735:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1786562549.030756:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654891520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.030794:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654891520:12345-0@lo:400:kworker.0 Request processed in 52us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562549.030801:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1786562549.030875:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654891904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562549.030928:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562549.030963:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1786562549.030986:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654891264:0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.030995:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654891648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562549.031038:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654891776:0@lo:400:kworker.0 00000100:00100000:1.0:1786562549.031059:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654891392:0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.031097:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654891648:12345-0@lo:400:kworker.0 Request processed in 107us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562549.031108:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1786562549.031114:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891904 00000100:00100000:1.0:1786562549.031119:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891904 00000100:00100000:0.0:1786562549.031612:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562549.031627:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654892032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562549.031671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562549.033471:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654891136 00000100:00100000:2.0:1786562549.033490:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654891136 00000100:00100000:2.0:1786562549.033551:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1786562549.033563:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654891136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562549.033658:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654891136:12345-0@lo:400:kworker.0 Request processed in 96us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562549.033667:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1786562549.033736:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562549.033743:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562549.033802:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654891136:0@lo:400:kworker.0 00000100:00100000:2.0:1786562549.033822:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654891648:0@lo:400:kworker.0 00000100:00100000:2.0:1786562549.033843:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843602 gen 2 00000004:00080000:2.0:1786562549.033849:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4380, transno 21474843595 00000004:00080000:2.0:1786562549.033860:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9921f80, transno 21474843596 00000004:00080000:2.0:1786562549.033864:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9921880, transno 21474843597 00000004:00080000:2.0:1786562549.033867:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4700, transno 21474843598 00000004:00080000:2.0:1786562549.033871:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f6680, transno 21474843599 00000004:00080000:2.0:1786562549.033873:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9923480, transno 21474843600 00000004:00080000:2.0:1786562549.033876:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f5f80, transno 21474843601 00000004:00080000:2.0:1786562549.033879:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f7100, transno 21474843602 00000100:00100000:2.0:1786562549.033884:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654891520:0@lo:400:kworker.0 00000100:00100000:3.0:1786562549.035678:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654892032 00000100:00100000:3.0:1786562549.035695:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654892032 00000100:00100000:3.0:1786562549.035767:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1786562549.035891:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654892032:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1786562549.035923:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00002000:00000024:3.0:1786562549.035940:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 565772288 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1786562549.036127:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654892032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 349us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562549.036138:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1786562549.036194:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654892032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562549.036370:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1786562549.036388:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654891904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562549.036427:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 460259328 pending 0 free 3829399552 avail 3827302400 00000100:00100000:1.0:1786562549.036507:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654891904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (5581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562549.036515:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1786562549.036586:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654891904:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786562549.128418:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876087 is committed 00000001:00080000:3.0:1786562549.128848:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876089 is committed 00000001:00080000:3.0:1786562549.128867:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876078 is committed 00000001:00100000:3.0:1786562549.129437:0:27136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b3dc1ca5-a8ed-4b97-b774-56a52e1a472d 00000020:00000080:3.0:1786562549.129442:0:27136:0:(genops.c:906:class_export_put()) final put ffff90e9c1dcf800/b3dc1ca5-a8ed-4b97-b774-56a52e1a472d 00000001:00080000:3.0:1786562549.129517:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876080 is committed 00000020:00000080:1.0:1786562549.129555:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff90e9c1dcf800/b3dc1ca5-a8ed-4b97-b774-56a52e1a472d for lustre-OST0001 00000020:00000080:1.0:1786562549.129814:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e9c1dc8800 for lustre-OST0001 00010000:00010000:2.0:1786562549.541955:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786562549.574463:0:33119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b3dc1ca5-a8ed-4b97-b774-56a52e1a472d 00000001:00080000:2.0:1786562549.574482:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950676 is committed 00000020:00000080:2.0:1786562549.574487:0:33119:0:(genops.c:906:class_export_put()) final put ffff90e88bd2d000/b3dc1ca5-a8ed-4b97-b774-56a52e1a472d 00000001:00080000:2.0:1786562549.574510:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950675 is committed 00000020:00000080:0.0:1786562549.574589:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff90e88bd2d000/b3dc1ca5-a8ed-4b97-b774-56a52e1a472d for lustre-MDT0000 00000020:00000080:0.0:1786562549.574658:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e88bd2c800 for lustre-MDT0000 00010000:00010000:1.0:1786562550.565236:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562551.536210:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.536263:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.536303:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.536443:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652851072 00000100:00100000:1.0:1786562551.536455:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652851072 00000100:00100000:1.0:1786562551.536526:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652850944 00000100:00100000:1.0:1786562551.536530:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652850944 00000100:00100000:1.0:1786562551.536551:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652851200 00000100:00100000:1.0:1786562551.536554:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652851200 00000100:00100000:1.0:1786562551.536575:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 977 00000100:00100000:1.0:1786562551.536595:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+15:2351:x1873345652851072:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562551.536611:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562551.536632:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb268800/0x5c655bf66689a9f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa724 expref: 15 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.536649:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562551.536707:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+14:2351:x1873345652851072:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 123us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562551.536714:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 977 00000100:00100000:1.0:1786562551.536733:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 978 00000100:00100000:1.0:1786562551.536739:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+13:2351:x1873345652850944:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562551.536746:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562551.536756:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4881a00/0x5c655bf66689a9eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa6fa expref: 13 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.536766:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562551.536784:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+12:2351:x1873345652850944:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 45us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562551.536790:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 978 00000100:00100000:1.0:1786562551.536802:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 979 00000100:00100000:1.0:1786562551.536809:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+11:2351:x1873345652851200:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562551.536815:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562551.536826:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4880200/0x5c655bf66689a9f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa72b expref: 11 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.536836:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562551.536853:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652851200:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 45us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562551.536859:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 979 00000100:00100000:3.0:1786562551.538498:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.538618:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652850816 00000100:00100000:0.0:1786562551.538633:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652850816 00000100:00100000:0.0:1786562551.538715:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17815 00000100:00100000:0.0:1786562551.538725:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+14:2347:x1873345652850816:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:0.0:1786562551.538752:0:28862:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689aa0e 00000020:00010000:0.0:1786562551.538760:0:28862:0:(genops.c:1942:obd_stale_export_put()) Put export ffff90e9b452d800: total 0 00000100:00080000:0.0:1786562551.538765:0:28862:0:(import.c:65:import_set_state_nolock()) ffff90e99cfe3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786562551.538811:0:28862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179876089 00000020:00010000:3.0:1786562551.539431:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff90e9b452d800: total 0 00010000:00010000:3.0:1786562551.539467:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e9b452d800, canceled 0 locks, left on hash table 9. 00010000:00010000:3.0:1786562551.539527:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d6a94a/0x5c655bf66689f3c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce7d expref: 12 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539563:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f3e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce99 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539595:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f3aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce68 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539618:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f379 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce45 expref: 9 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539644:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689b34c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfabd1 expref: 8 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539663:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e389c32/0x5c655bf66689f387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce53 expref: 7 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539683:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f3b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce76 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539701:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058300657/0x5c655bf66689f3b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce6f expref: 5 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539718:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c665d958/0x5c655bf66689f3db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce92 expref: 4 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.539731:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e9b452d800, canceled 9 locks, left on hash table 0. 00010000:00010000:3.0:1786562551.539743:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562551.539744:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562551.539746:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562551.540355:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+2:2347:x1873345652850816:12345-192.168.204.29@tcp:9:umount.0 Request processed in 1628us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562551.540366:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17815 00000100:00080000:2.0:1786562551.540481:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562551.550452:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.550738:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652852352 00000100:00100000:2.0:1786562551.550750:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652852352 00000100:00100000:2.0:1786562551.550876:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17816 00000100:00100000:2.0:1786562551.550887:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+13:2347:x1873345652852352:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:2.0:1786562551.550927:0:29963:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689aa07 00000020:00010000:2.0:1786562551.550936:0:29963:0:(genops.c:1942:obd_stale_export_put()) Put export ffff90e9b4528800: total 0 00000100:00080000:2.0:1786562551.550941:0:29963:0:(import.c:65:import_set_state_nolock()) ffff90e9b452f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786562551.550995:0:29963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843602 00000100:00100000:2.0:1786562551.551214:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+11:2347:x1873345652852352:12345-192.168.204.29@tcp:9:umount.0 Request processed in 329us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562551.551222:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17816 00000020:00010000:1.0:1786562551.553311:0:8414:0:(genops.c:1928:obd_stale_export_get()) Get export ffff90e9b4528800: total 0 00010000:00010000:1.0:1786562551.553367:0:8414:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e9b4528800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1786562551.553428:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb2291b0/0x5c655bf66689f372 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce3e expref: 10 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553469:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f380 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce4c expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553491:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef5f58f/0x5c655bf66689f3d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce8b expref: 8 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553515:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f38e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce5a expref: 7 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553535:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54282c9/0x5c655bf66689b37d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfabf4 expref: 6 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553554:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f36b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce37 expref: 5 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553578:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8898bc9/0x5c655bf66689f3cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfce84 expref: 4 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553598:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f096aa1e/0x5c655bf66689f3e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea0 expref: 3 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.553612:0:8414:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e9b4528800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1786562551.553624:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562551.553627:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562551.553628:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786562551.556373:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562551.567682:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.567920:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652852736 00000100:00100000:2.0:1786562551.567930:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652852736 00000100:00100000:2.0:1786562551.568053:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17124 00000100:00100000:2.0:1786562551.568063:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+7:2347:x1873345652852736:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:2.0:1786562551.568107:0:33140:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689aa00 00000020:00010000:2.0:1786562551.568115:0:33140:0:(genops.c:1942:obd_stale_export_put()) Put export ffff90e88bfb5800: total 0 00000100:00080000:2.0:1786562551.568120:0:33140:0:(import.c:65:import_set_state_nolock()) ffff90e88bfb4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786562551.568355:0:33140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589950676 00000100:00100000:2.0:1786562551.568776:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf847b5-1bd8-403d-8348-e3c7e3ebae2d+6:2347:x1873345652852736:12345-192.168.204.29@tcp:39:umount.0 Request processed in 712us (1102us total) trans 8589950677 rc 0/0 00000100:00100000:2.0:1786562551.568785:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17124 00000100:00080000:0.0:1786562551.568938:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1786562551.578074:0:8412:0:(genops.c:1928:obd_stale_export_get()) Get export ffff90e88bfb5800: total 0 00010000:00010000:1.0:1786562551.578148:0:8412:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e88bfb5800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1786562551.578196:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:1.0:1786562551.578200:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562551.578211:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f3f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcea7 expref: 5 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.578244:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562551.578247:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786562551.578251:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6dc00/0x5c655bf66689aa1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa755 expref: 4 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.578262:0:8412:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e88bfb5800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1786562551.578273:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562551.578275:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562551.578277:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562551.589666:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562551.651535:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.651691:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652852864 00000100:00100000:0.0:1786562551.651701:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652852864 00000100:00100000:0.0:1786562551.651781:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17125 00000100:00100000:0.0:1786562551.651791:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+501:64214:x1873345652852864:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562551.651812:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562551.651834:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f3fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfceae expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.651900:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.651914:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.651926:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.651954:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.651962:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.651969:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652561:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652574:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652596:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562551.652632:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:0.0:1786562551.652636:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562551.652654:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652667:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652676:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652683:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652689:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652695:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1ba00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562551.652699:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652706:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652717:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:0.0:1786562551.652720:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562551.652724:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652730:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ba00/0x5c655bf66689f405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652740:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652745:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652750:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652755:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562551.652757:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652763:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652769:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9a98db100) 00010000:00010000:0.0:1786562551.652771:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562551.652773:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652778:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b800/0x5c655bf66689f40c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652809:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f3fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 503 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652821:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 502 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.652827:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:0.0:1786562551.652829:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562551.652831:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1a200, rc 0) 00000100:00100000:0.0:1786562551.652888:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+502:64214:x1873345652852864:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1098us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562551.652899:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17125 00000100:00100000:3.0:1786562551.657223:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.658893:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652853120 00000100:00100000:0.0:1786562551.658909:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652853120 00000100:00100000:0.0:1786562551.659002:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17126 00000100:00080000:2.0:1786562551.659573:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562551.660257:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+502:64214:x1873345652853120:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562551.660289:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562551.660313:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a000/0x5c655bf66689f41a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfceb5 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.660432:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.660462:0:33113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 503 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.660471:0:33113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.660514:0:33113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 503 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.660530:0:33113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 503 pid: 35929 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562551.660545:0:33113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654892160:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562551.660654:0:33113:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562551.665140:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.665272:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652853248 00000100:00100000:1.0:1786562551.665285:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652853248 00010000:00010000:1.0:1786562551.665344:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 504 pid: 35929 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562551.665395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8732 00000100:00100000:1.0:1786562551.665408:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:2348:x1873345652853248:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562551.665427:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562551.665435:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 504 pid: 35929 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.665451:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 504 pid: 35929 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.665481:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:1.0:1786562551.665488:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.665500:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.665509:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.665532:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562551.665604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:2348:x1873345652853248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 198us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562551.665613:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8732 00010000:00010000:0.0:1786562551.665997:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f413 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceae expref: 503 pid: 35929 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562551.666048:0:33113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654892160:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562551.666076:0:33113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.666087:0:33113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.666094:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562551.666119:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:0.0:1786562551.666443:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a000/0x5c655bf66689f41a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 504 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.666462:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 503 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.666471:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:0.0:1786562551.666474:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562551.666478:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1ac00, rc 0) 00000100:00100000:0.0:1786562551.666607:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+503:64214:x1873345652853120:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 7575us (9399us total) trans 8589950678 rc 0/0 00000100:00100000:0.0:1786562551.666615:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17126 00000100:00100000:3.0:1786562551.675831:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.680855:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652853376 00000100:00100000:0.0:1786562551.680877:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652853376 00000100:00100000:1.0:1786562551.681075:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17127 00000100:00100000:1.0:1786562551.681089:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:64214:x1873345652853376:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562551.681122:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562551.681149:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f42f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcebc expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.681298:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.681317:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 504 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.681328:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.681378:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 504 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.681396:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 504 pid: 33113 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562551.681414:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654892288:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562551.681543:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88202acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562551.686257:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.686324:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652853504 00000100:00100000:2.0:1786562551.686337:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652853504 00010000:00010000:2.0:1786562551.686403:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 505 pid: 33113 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562551.686453:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8733 00000100:00100000:2.0:1786562551.686468:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+505:2348:x1873345652853504:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562551.686492:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562551.686502:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 505 pid: 33113 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.686520:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 505 pid: 33113 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.686566:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:2.0:1786562551.686575:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.686588:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.686597:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.688501:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562551.688617:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+505:2348:x1873345652853504:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2141us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562551.688640:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8733 00010000:00010000:1.0:1786562551.689417:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1ac00/0x5c655bf66689f421 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceb5 expref: 504 pid: 33113 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562551.689445:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654892288:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562551.689476:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.689490:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.689497:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562551.689573:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:1.0:1786562551.689579:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562551.689606:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.689656:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f42f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcebc expref: 504 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.689695:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcebc expref: 503 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.689705:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:1.0:1786562551.689708:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562551.689712:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880200, rc 0) 00000100:00100000:1.0:1786562551.689776:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:64214:x1873345652853376:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8690us (14156us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562551.689786:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17127 00000100:00100000:2.0:1786562551.701731:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562551.701856:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652853632 00000100:00100000:3.0:1786562551.701870:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652853632 00000100:00100000:3.0:1786562551.701955:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17128 00000100:00100000:3.0:1786562551.701968:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+503:64214:x1873345652853632:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562551.702042:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562551.702072:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d200/0x5c655bf66689f43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcec3 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702162:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702191:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702205:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702224:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702231:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702248:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702680:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702691:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702699:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562551.702750:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:3.0:1786562551.702756:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562551.702778:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702791:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702801:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702808:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702815:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702822:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bf92c600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562551.702827:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702835:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702849:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:3.0:1786562551.702852:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562551.702858:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702865:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c600/0x5c655bf66689f444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702885:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702891:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702897:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702902:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bf92d600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562551.702905:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702911:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702918:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e99172ed00) 00010000:00010000:3.0:1786562551.702920:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562551.702923:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702929:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d600/0x5c655bf66689f44b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702966:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d200/0x5c655bf66689f43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcec3 expref: 505 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.702993:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcec3 expref: 504 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.703040:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:3.0:1786562551.703043:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562551.703046:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364400, rc 0) 00000100:00100000:3.0:1786562551.703142:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+504:64214:x1873345652853632:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1177us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562551.703152:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17128 00000100:00100000:3.0:1786562551.713654:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562551.713727:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.713849:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652853888 00000100:00100000:1.0:1786562551.713861:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652853888 00000100:00100000:1.0:1786562551.713935:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17129 00000100:00100000:1.0:1786562551.713947:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:64214:x1873345652853888:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562551.713994:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562551.714052:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfceca expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.714199:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f460 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.714217:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f460 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.714230:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f460 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562551.714244:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:1.0:1786562551.714423:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880c00/0x5c655bf66689f459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceca expref: 507 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.714449:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f460 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceca expref: 506 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.714458:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:1.0:1786562551.714461:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786562551.714466:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881200, rc 0) 00000100:00100000:1.0:1786562551.714546:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+506:64214:x1873345652853888:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 600us (908us total) trans 8589950679 rc 0/0 00000100:00100000:1.0:1786562551.714555:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17129 00000100:00100000:0.0:1786562551.714750:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854016 00000100:00100000:0.0:1786562551.714756:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854016 00000100:00100000:0.0:1786562551.714815:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 980 00000100:00100000:0.0:1786562551.714825:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+506:2350:x1873345652854016:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562551.714839:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562551.714858:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364400/0x5c655bf66689f452 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcec3 expref: 506 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.714873:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:0.0:1786562551.714877:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562551.714909:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+505:2350:x1873345652854016:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 86us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562551.714917:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 980 00000100:00100000:1.0:1786562551.725509:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.725605:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854272 00000100:00100000:0.0:1786562551.725618:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854272 00000100:00100000:0.0:1786562551.725701:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17130 00000100:00100000:0.0:1786562551.725713:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+505:64214:x1873345652854272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562551.725746:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562551.725773:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f46e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfced1 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.725906:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f475 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.725926:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f475 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.725940:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f475 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562551.725964:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00010000:00010000:0.0:1786562551.726184:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1a200/0x5c655bf66689f46e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced1 expref: 508 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.726206:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f475 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced1 expref: 507 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.726216:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:0.0:1786562551.726219:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562551.726223:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1bc00, rc 0) 00000100:00100000:0.0:1786562551.726312:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+507:64214:x1873345652854272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 600us (816us total) trans 8589950680 rc 0/0 00000100:00100000:0.0:1786562551.726321:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17130 00000100:00100000:2.0:1786562551.816209:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.816295:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.816416:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854400 00000100:00100000:0.0:1786562551.816428:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854400 00000100:00100000:0.0:1786562551.816515:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854528 00000100:00100000:0.0:1786562551.816520:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854528 00000100:00100000:0.0:1786562551.816553:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17817 00000100:00100000:0.0:1786562551.816568:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:2350:x1873345652854400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562551.816593:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562551.816619:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfced8 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562551.816654:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x711:0x0] initial LVB size: 1048576, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x807 00010000:00010000:0.0:1786562551.816695:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=984s v=(0 0) 00010000:00010000:0.0:1786562551.816701:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562551.816716:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 23 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.816739:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 23 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.816756:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1a200, rc 0) 00000100:00100000:0.0:1786562551.816824:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652854400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 260us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562551.816832:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17817 00000100:00100000:0.0:1786562551.816856:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17818 00000100:00100000:0.0:1786562551.816864:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+12:2350:x1873345652854528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562551.816872:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562551.816887:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcedf expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562551.816905:0:12119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72e:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x809 00010000:00010000:0.0:1786562551.816919:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=984s v=(0 0) 00010000:00010000:0.0:1786562551.816922:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562551.816929:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.816942:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 13 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.816951:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1b800, rc 0) 00000100:00100000:0.0:1786562551.816989:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:2350:x1873345652854528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 126us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562551.816996:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17818 00000100:00080000:2.0:1786562551.817352:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562551.817359:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562551.828186:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.828232:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.828326:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562551.828478:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854656 00000100:00100000:3.0:1786562551.828491:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854656 00000100:00100000:3.0:1786562551.828558:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854784 00000100:00100000:3.0:1786562551.828562:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854784 00000100:00100000:3.0:1786562551.828580:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855040 00000100:00100000:3.0:1786562551.828584:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855040 00000100:00100000:3.0:1786562551.828608:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17819 00000100:00100000:3.0:1786562551.828621:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+14:2350:x1873345652854656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562551.828646:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562551.828688:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f491 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcee6 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562551.828724:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72f:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x807 00010000:00010000:3.0:1786562551.828751:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=984s v=(0 0) 00010000:00010000:3.0:1786562551.828757:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562551.828770:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcee6 expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.828798:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcee6 expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.828814:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365000, rc 0) 00000100:00100000:3.0:1786562551.828888:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652854656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 270us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562551.828896:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17819 00000100:00100000:3.0:1786562551.828917:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17820 00000100:00100000:3.0:1786562551.828924:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:2351:x1873345652854784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562551.828931:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562551.828945:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f498 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfceed expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562551.828966:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x713:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x809 00010000:00010000:3.0:1786562551.828987:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=984s v=(0 0) 00010000:00010000:3.0:1786562551.828991:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562551.828997:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceed expref: 24 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.829052:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceed expref: 24 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.829062:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb364e00, rc 0) 00000100:00100000:3.0:1786562551.829086:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652854784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 163us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562551.829092:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17820 00000100:00100000:3.0:1786562551.829107:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17821 00000100:00100000:3.0:1786562551.829113:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+14:2351:x1873345652855040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562551.829120:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562551.829131:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f49f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcefb expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562551.829145:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x730:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x1007 00010000:00010000:3.0:1786562551.829157:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=984s v=(0 0) 00010000:00010000:3.0:1786562551.829161:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562551.829167:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f49f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcefb expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.829177:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f49f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcefb expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562551.829185:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb365c00, rc 0) 00000100:00100000:3.0:1786562551.829204:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652855040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 91us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562551.829209:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17821 00000100:00100000:1.0:1786562551.833735:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562551.833856:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652854912 00000100:00100000:0.0:1786562551.833869:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652854912 00000100:00100000:0.0:1786562551.833944:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17822 00000100:00100000:0.0:1786562551.833957:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652854912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562551.833995:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562551.834073:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f4a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcef4 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562551.834111:0:28862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x714:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x1807 00010000:00010000:0.0:1786562551.834138:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=984s v=(0 0) 00010000:00010000:0.0:1786562551.834143:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562551.834156:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcef4 expref: 25 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.834188:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcef4 expref: 25 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.834206:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e986a1ba00, rc 0) 00000100:00100000:0.0:1786562551.834283:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652854912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 329us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562551.834291:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17822 00000100:00100000:2.0:1786562551.841222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.841351:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855168 00000100:00100000:1.0:1786562551.841364:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855168 00000100:00100000:1.0:1786562551.841462:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11569 00000100:00100000:1.0:1786562551.841475:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652855168:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562551.841529:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.841551:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562551.841556:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562551.841563:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.841580:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866476:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866503:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866512:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866521:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562551.866527:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866538:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866561:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.866569:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562551.866689:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652855168:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 25210us (25476us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562551.866700:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11569 00000100:00100000:3.0:1786562551.890411:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562551.890628:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855296 00000100:00100000:1.0:1786562551.890641:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855296 00000100:00100000:1.0:1786562551.890737:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11570 00000100:00100000:1.0:1786562551.890750:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652855296:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:1.0:1786562551.890817:0:16007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:1.0:1786562551.890829:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.890849:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=984s v=(0 0) 00010000:00010000:1.0:1786562551.890854:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562551.890861:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.890883:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908108:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908135:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908144:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908152:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562551.908157:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908167:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908201:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562551.908210:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562551.908347:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652855296:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 17593us (17945us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562551.908361:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11570 00000100:00100000:3.0:1786562551.920331:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562551.920502:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855424 00000100:00100000:2.0:1786562551.920516:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855424 00000100:00100000:2.0:1786562551.920615:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11571 00000100:00100000:2.0:1786562551.920628:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652855424:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562551.920700:0:29463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:2.0:1786562551.920712:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.920740:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=984s v=(0 0) 00010000:00010000:2.0:1786562551.920745:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562551.920753:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562551.920770:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936575:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936608:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936617:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936624:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562551.936630:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936639:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936664:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562551.936673:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f4bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562551.936826:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652855424:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 16193us (16504us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562551.936844:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11571 00000100:00100000:3.0:1786562552.061427:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.061600:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855552 00000100:00100000:0.0:1786562552.061613:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855552 00000100:00100000:0.0:1786562552.061717:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11572 00000100:00100000:0.0:1786562552.061729:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652855552:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562552.061778:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.061800:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.061805:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.061812:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.061828:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079108:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079137:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079147:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079155:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.079170:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079186:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079216:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.079223:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067538fa9/0x5c655bf66689f4c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.079494:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652855552:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 17760us (18073us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.079507:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11572 00000100:00100000:3.0:1786562552.102558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562552.102873:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855680 00000100:00100000:2.0:1786562552.102886:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855680 00000100:00100000:2.0:1786562552.102993:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11573 00000100:00100000:2.0:1786562552.103034:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652855680:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562552.103102:0:29459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:2.0:1786562552.103113:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.103135:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=984s v=(0 0) 00010000:00010000:2.0:1786562552.103140:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562552.103147:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.103172:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127543:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127570:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127581:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127589:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562552.127595:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127606:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127630:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.127639:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f4c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562552.127789:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652855680:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 24779us (25236us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562552.127801:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11573 00000100:00100000:3.0:1786562552.139619:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.139759:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855808 00000100:00100000:0.0:1786562552.139773:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855808 00000100:00100000:0.0:1786562552.139867:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11574 00000100:00100000:0.0:1786562552.139880:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652855808:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562552.139949:0:16203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:0.0:1786562552.139972:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.139995:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=984s v=(0 0) 00010000:00010000:0.0:1786562552.140000:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.140025:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.140041:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154274:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154297:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154306:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154314:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562552.154318:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154326:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154346:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.154353:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e057773d/0x5c655bf66689f4d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562552.154462:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652855808:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 14580us (14854us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562552.154473:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11574 00000100:00100000:3.0:1786562552.244878:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562552.244942:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.245089:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652855936 00000100:00100000:0.0:1786562552.245102:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652855936 00000100:00100000:0.0:1786562552.245200:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856064 00000100:00100000:0.0:1786562552.245204:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856064 00000100:00100000:0.0:1786562552.245252:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11575 00000100:00100000:0.0:1786562552.245264:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652855936:12345-192.168.204.29@tcp:3:lfs.0 00000100:00100000:1.0:1786562552.245421:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11576 00000100:00100000:1.0:1786562552.245432:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652856064:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562552.245484:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.245506:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562552.245512:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562552.245519:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.245536:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.248658:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.248685:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.248690:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.248697:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.248715:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274072:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274099:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274110:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274123:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.274128:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274138:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274173:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.274183:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f4de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.274303:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652855936:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 29034us (29432us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.274316:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11575 00010000:00010000:1.0:1786562552.275376:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.275393:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.275403:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.275410:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562552.275415:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.275423:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.275444:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.275452:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f4d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562552.275530:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652856064:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 30097us (30583us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562552.275540:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11576 00000100:00100000:0.0:1786562552.307416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562552.307598:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856192 00000100:00100000:1.0:1786562552.307612:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856192 00000100:00100000:1.0:1786562552.307704:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11577 00000100:00100000:1.0:1786562552.307717:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652856192:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:1.0:1786562552.307785:0:16006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:1.0:1786562552.307796:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.307817:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=984s v=(0 0) 00010000:00010000:1.0:1786562552.307822:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562552.307829:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.307844:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562552.320074:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562552.320178:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856320 00000100:00100000:1.0:1786562552.320192:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856320 00000100:00100000:1.0:1786562552.325157:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11578 00000100:00100000:1.0:1786562552.325183:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652856320:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:1.0:1786562552.325268:0:29461:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:1.0:1786562552.325280:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.325302:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=984s v=(0 0) 00010000:00010000:1.0:1786562552.325307:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562552.325324:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.325350:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.366889:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.366937:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.366948:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.366972:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.366978:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.366988:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.367037:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.367046:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f4e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.367178:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652856192:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 59457us (59772us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.367190:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11577 00010000:00010000:0.0:1786562552.389295:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.389325:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.389336:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.389350:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.389356:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.389366:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.389391:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.389399:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a97444f1/0x5c655bf66689f4ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.389549:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652856320:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 64370us (69484us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.389561:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11578 00000100:00100000:3.0:1786562552.421628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562552.421681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.421810:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856448 00000100:00100000:0.0:1786562552.421821:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856448 00000100:00100000:0.0:1786562552.421902:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856576 00000100:00100000:0.0:1786562552.421905:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856576 00000100:00100000:0.0:1786562552.421938:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11579 00000100:00100000:0.0:1786562552.421950:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345652856448:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562552.422059:0:6665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:0.0:1786562552.422071:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.422097:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=984s v=(0 0) 00010000:00010000:0.0:1786562552.422102:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.422110:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.422127:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562552.423324:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11580 00000100:00100000:1.0:1786562552.423348:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652856576:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562552.423391:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.423411:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562552.423415:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562552.423421:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.423436:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441173:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441199:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441209:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441218:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.441237:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441247:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441284:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.441299:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f4f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.441434:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652856448:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 19479us (19813us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.441445:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11579 00010000:00010000:2.0:1786562552.447166:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.447195:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.447206:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.447216:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb38ec00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562552.447222:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.447242:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.447343:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.447354:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f4fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562552.447483:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652856576:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 24138us (25792us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562552.447494:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11580 00000100:00100000:1.0:1786562552.575634:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.575880:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856704 00000100:00100000:0.0:1786562552.575895:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856704 00000100:00100000:0.0:1786562552.576035:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11581 00000100:00100000:0.0:1786562552.576048:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652856704:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562552.576105:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.576132:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562552.576137:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.576145:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.576166:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562552.598610:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562552.598759:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856832 00000100:00100000:2.0:1786562552.598773:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856832 00000100:00100000:2.0:1786562552.598863:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11582 00000100:00100000:2.0:1786562552.598876:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652856832:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562552.598942:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.598976:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562552.598991:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562552.599000:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.599073:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618109:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618138:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618155:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618165:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.618171:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618181:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618208:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.618225:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057475577/0x5c655bf66689f501 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.618380:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652856704:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 42329us (42753us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.618393:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11581 00010000:00010000:1.0:1786562552.618624:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562552.626224:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562552.626254:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562552.626361:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562552.626370:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988557e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562552.626376:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562552.626386:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562552.626412:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562552.626420:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075eb5e7d/0x5c655bf66689f508 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562552.626582:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652856832:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 27701us (27982us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562552.626596:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11582 00000100:00100000:1.0:1786562552.636762:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562552.636819:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562552.638538:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652856960 00000100:00100000:2.0:1786562552.638556:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652856960 00000100:00100000:2.0:1786562552.638661:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 248 00000100:00100000:2.0:1786562552.638673:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652856960:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562552.638795:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652856960:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 124us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562552.638804:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 248 00000100:00100000:3.0:1786562552.643524:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857088 00000100:00100000:3.0:1786562552.643546:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857088 00000100:00100000:3.0:1786562552.643644:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 280 00000100:00100000:3.0:1786562552.643657:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+507:2348:x1873345652857088:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562552.643773:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+507:2348:x1873345652857088:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 119us (6952us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562552.643781:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 280 00000100:00100000:1.0:1786562552.656230:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.656379:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857216 00000100:00100000:0.0:1786562552.656393:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857216 00000100:00100000:0.0:1786562552.656494:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11583 00000100:00100000:0.0:1786562552.656506:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652857216:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562552.656575:0:16203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:0.0:1786562552.656587:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.656609:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=985s v=(0 0) 00010000:00010000:0.0:1786562552.656614:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.656622:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.656640:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.670085:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562552.670200:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857344 00000100:00100000:2.0:1786562552.670215:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857344 00000100:00100000:2.0:1786562552.670321:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11584 00000100:00100000:2.0:1786562552.670334:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652857344:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562552.670403:0:29460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:2.0:1786562552.670415:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.670439:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=985s v=(0 0) 00010000:00010000:2.0:1786562552.670444:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562552.670451:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.670469:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717312:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717344:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717355:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717364:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99176fe00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562552.717369:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717377:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717402:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.717410:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001eb1797e/0x5c655bf66689f516 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562552.717543:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652857344:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 47205us (47465us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562552.717555:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11584 00010000:00010000:1.0:1786562552.717837:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.717847:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.717854:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.717861:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26f000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562552.717865:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.717871:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.717883:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562552.717890:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057475577/0x5c655bf66689f50f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562552.717934:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652857216:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 61432us (61731us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562552.717941:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11583 00000100:00100000:1.0:1786562552.760870:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562552.760921:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562552.761064:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857472 00000100:00100000:0.0:1786562552.761077:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857472 00000100:00100000:0.0:1786562552.761169:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857600 00000100:00100000:0.0:1786562552.761172:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857600 00000100:00100000:0.0:1786562552.761196:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11585 00000100:00100000:0.0:1786562552.761208:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345652857472:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562552.761285:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x718:0x0] initial LVB size: 8388608, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:0.0:1786562552.761297:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.761318:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=985s v=(0 0) 00010000:00010000:0.0:1786562552.761323:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562552.761331:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562552.761353:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562552.763674:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11586 00000100:00100000:2.0:1786562552.763704:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652857600:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562552.763763:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.763786:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562552.763791:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562552.763798:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.763813:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805316:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805346:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805359:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805368:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562552.805374:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805385:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805415:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.805422:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090feda1a/0x5c655bf66689f51d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562552.805537:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652857472:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 44323us (44670us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562552.805549:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11585 00010000:00010000:2.0:1786562552.821936:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.821976:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.821995:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.822023:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af415600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562552.822031:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.822042:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.822067:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562552.822074:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f524 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562552.826514:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652857600:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 62803us (65571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562552.826539:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11586 00000100:00100000:0.0:1786562553.042214:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.044811:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562553.044967:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857728 00000100:00100000:2.0:1786562553.044981:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857728 00000100:00100000:2.0:1786562553.045130:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857856 00000100:00100000:2.0:1786562553.045134:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857856 00000100:00100000:2.0:1786562553.045179:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11587 00000100:00100000:2.0:1786562553.045192:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652857728:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562553.045262:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.045284:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.045290:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.045298:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.045317:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562553.045791:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562553.045799:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562553.045831:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11588 00000100:00100000:0.0:1786562553.045849:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652857856:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562553.045885:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.045901:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562553.045904:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562553.045909:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.045919:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073209:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073241:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073261:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073271:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562553.073277:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073287:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073318:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.073325:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f52b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562553.073440:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652857728:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 28244us (31236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562553.073453:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11587 00010000:00010000:1.0:1786562553.081092:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.081121:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.081132:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.081140:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562553.081147:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.081157:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.081185:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.081195:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f532 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562553.081335:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652857856:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 35486us (36534us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562553.081347:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11588 00000100:00100000:3.0:1786562553.112582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.112643:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562553.112775:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652857984 00000100:00100000:0.0:1786562553.112791:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652857984 00000100:00100000:0.0:1786562553.112894:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858112 00000100:00100000:0.0:1786562553.112898:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858112 00000100:00100000:0.0:1786562553.112941:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11589 00000100:00100000:0.0:1786562553.112963:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652857984:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562553.113092:0:14369:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x732:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:0.0:1786562553.113106:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.113132:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=985s v=(0 0) 00010000:00010000:0.0:1786562553.113140:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562553.113151:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.113167:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562553.114146:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11590 00000100:00100000:1.0:1786562553.114172:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652858112:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:1.0:1786562553.114246:0:29462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x716:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:1.0:1786562553.114256:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.114273:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=985s v=(0 0) 00010000:00010000:1.0:1786562553.114277:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562553.114283:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.114296:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133184:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133215:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133227:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133235:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562553.133241:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133252:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133287:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.133296:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d24a5c/0x5c655bf66689f540 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562553.133425:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652858112:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 19255us (20772us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562553.133439:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11590 00010000:00010000:3.0:1786562553.154327:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.154359:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.154369:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.154377:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562553.154383:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.154393:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.154424:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.154431:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006a016c/0x5c655bf66689f539 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562553.154580:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652857984:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 41612us (42002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562553.154593:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11589 00000100:00100000:0.0:1786562553.186677:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.186796:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858240 00000100:00100000:3.0:1786562553.186810:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858240 00000100:00100000:3.0:1786562553.186935:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11591 00000100:00100000:3.0:1786562553.186958:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652858240:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562553.188126:0:29459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x718:0x0] initial LVB size: 8388608, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:2.0:1786562553.188148:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.188171:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=985s v=(0 0) 00010000:00010000:2.0:1786562553.188176:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.188186:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.188203:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562553.206735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.210197:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858368 00000100:00100000:3.0:1786562553.210229:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858368 00000100:00100000:3.0:1786562553.210350:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11592 00000100:00100000:3.0:1786562553.210362:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652858368:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562553.210412:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.210433:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562553.210439:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562553.210446:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.210469:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225882:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225909:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225920:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225928:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26e200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562553.225934:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225955:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225981:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.225989:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c943b82/0x5c655bf66689f547 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562553.226154:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345652858240:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 39193us (39487us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562553.226167:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11591 00010000:00010000:3.0:1786562553.254481:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.254510:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.254521:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.254529:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e88a26ea00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562553.254535:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.254545:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.254584:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.254592:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b80f1dcc/0x5c655bf66689f54e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562553.255230:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652858368:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 44862us (48502us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562553.255247:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11592 00000100:00100000:1.0:1786562553.439960:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562553.440176:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858496 00000100:00100000:2.0:1786562553.440191:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858496 00000100:00100000:2.0:1786562553.440309:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11593 00000100:00100000:2.0:1786562553.440322:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652858496:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562553.440372:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.440401:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.440406:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.440414:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.440431:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479798:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479826:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479837:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479846:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562553.479853:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479865:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479891:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.479906:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f555 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562553.480087:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+25:2351:x1873345652858496:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 39760us (40147us total) trans 0 rc 988320/988320 00000100:00100000:2.0:1786562553.480101:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11593 00000100:00100000:1.0:1786562553.508788:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.511120:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858624 00000100:00100000:3.0:1786562553.511143:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858624 00000100:00100000:3.0:1786562553.511301:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11594 00000100:00100000:3.0:1786562553.511315:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652858624:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:3.0:1786562553.511387:0:29458:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x733:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:3.0:1786562553.511399:0:29458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.511424:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=985s v=(0 0) 00010000:00010000:3.0:1786562553.511430:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562553.511438:0:29458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.511456:0:29458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572189:0:29458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572224:0:29458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572234:0:29458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572251:0:29458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562553.572258:0:29458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572268:0:29458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572300:0:29458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.572308:0:29458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf66689f55c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562553.572449:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652858624:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 61129us (63671us total) trans 0 rc 988320/988320 00000100:00100000:0.0:1786562553.572461:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11594 00000100:00100000:0.0:1786562553.602925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562553.603414:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858752 00000100:00100000:2.0:1786562553.603429:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858752 00000100:00100000:2.0:1786562553.603535:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11595 00000100:00100000:2.0:1786562553.603547:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652858752:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562553.603614:0:13913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x719:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:2.0:1786562553.603625:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.603645:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=986s v=(0 0) 00010000:00010000:2.0:1786562553.603651:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.603658:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.603676:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.640030:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562553.645632:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.645660:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.645671:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.645686:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562553.645692:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.645703:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.645728:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.645737:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188b620f/0x5c655bf66689f563 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562553.645857:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652858752:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 42305us (42943us total) trans 0 rc 988320/988320 00000100:00100000:3.0:1786562553.645869:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11595 00000100:00100000:3.0:1786562553.694074:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562553.694174:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652858880 00000100:00100000:1.0:1786562553.694188:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652858880 00000100:00100000:1.0:1786562553.694309:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 981 00000100:00100000:1.0:1786562553.694323:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:64214:x1873345652858880:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:1.0:1786562553.694343:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562553.694387:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f475 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced1 expref: 507 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.694412:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:1.0:1786562553.694418:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562553.694491:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+506:64214:x1873345652858880:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 172us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562553.694500:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 981 00000100:00080000:3.0:1786562553.695919:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562553.703819:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562553.703963:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652859136 00000100:00100000:1.0:1786562553.703976:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652859136 00000100:00100000:1.0:1786562553.704099:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6289 00000100:00100000:1.0:1786562553.704112:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+506:64214:x1873345652859136:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562553.704462:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:64214:x1873345652859136:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 351us (657us total) trans 8589950681 rc 0/0 00000100:00100000:1.0:1786562553.704471:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6289 00000100:00100000:1.0:1786562553.709781:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562553.709875:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652859392 00000100:00100000:0.0:1786562553.709888:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652859392 00000100:00100000:0.0:1786562553.709963:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6290 00000100:00100000:0.0:1786562553.709976:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+507:64214:x1873345652859392:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562553.710343:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+508:64214:x1873345652859392:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 369us (576us total) trans 8589950682 rc 0/0 00000100:00100000:0.0:1786562553.710353:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6290 00000100:00100000:3.0:1786562553.768474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562553.768582:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652859520 00000100:00100000:2.0:1786562553.768597:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652859520 00000100:00100000:2.0:1786562553.768682:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17131 00000100:00100000:2.0:1786562553.768697:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+508:64216:x1873345652859520:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562553.768817:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.768840:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.768854:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.768876:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.768884:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.768900:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769590:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769605:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769613:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562553.769664:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d6:0x0]: returning size 9376928 00000004:00200000:2.0:1786562553.769670:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562553.769685:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769704:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769711:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769719:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769726:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1bc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562553.769731:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769740:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769754:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:2.0:1786562553.769758:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562553.769764:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769770:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1bc00/0x5c655bf66689f56a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769786:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769793:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769799:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769805:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562553.769809:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769814:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769822:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9b6332800) 00010000:00010000:2.0:1786562553.769825:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562553.769827:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769833:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b000/0x5c655bf66689f571 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769849:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769855:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769861:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769865:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562553.769868:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769873:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769884:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:2.0:1786562553.769887:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562553.769890:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.769896:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e986a1b200/0x5c655bf66689f578 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562553.770078:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+508:64216:x1873345652859520:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1379us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562553.770090:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17131 00000001:00100000:1.0:1786562553.823896:0:25627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdf847b5-1bd8-403d-8348-e3c7e3ebae2d 00000020:00000080:1.0:1786562553.823911:0:25627:0:(genops.c:906:class_export_put()) final put ffff90e9b4528800/fdf847b5-1bd8-403d-8348-e3c7e3ebae2d 00000001:00100000:1.0:1786562553.823952:0:25627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b3dc1ca5-a8ed-4b97-b774-56a52e1a472d 00000020:00000080:1.0:1786562553.823955:0:25627:0:(genops.c:906:class_export_put()) final put ffff90e88bfb0800/b3dc1ca5-a8ed-4b97-b774-56a52e1a472d 00000020:00000080:3.0:1786562553.824066:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff90e9b4528800/fdf847b5-1bd8-403d-8348-e3c7e3ebae2d for lustre-OST0000 00000020:00000080:3.0:1786562553.824139:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff90e88bfb0800/b3dc1ca5-a8ed-4b97-b774-56a52e1a472d for lustre-OST0000 00000020:00000080:3.0:1786562553.824161:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e9b452f800 for lustre-OST0000 00000020:00000080:3.0:1786562553.824166:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e88bfb3000 for lustre-OST0000 00000100:00100000:3.0:1786562553.948515:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.948592:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562553.948656:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562553.948862:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652859648 00000100:00100000:1.0:1786562553.948878:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652859648 00000100:00100000:1.0:1786562553.948994:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652859776 00000100:00100000:1.0:1786562553.948998:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652859776 00000100:00100000:1.0:1786562553.949072:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652859904 00000100:00100000:1.0:1786562553.949075:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652859904 00000100:00100000:1.0:1786562553.949105:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11596 00000100:00100000:1.0:1786562553.949118:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652859648:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562553.949166:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.949188:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786562553.949194:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562553.949202:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562553.949218:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562553.950074:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11597 00000100:00100000:0.0:1786562553.950091:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652859776:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562553.950130:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.950146:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786562553.950150:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562553.950157:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562553.950170:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562553.952053:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11598 00000100:00100000:3.0:1786562553.952077:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652859904:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562553.952126:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.952146:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786562553.952152:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562553.952159:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562553.952174:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562553.962857:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562553.973842:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562553.989319:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562553.992935:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860032 00000100:00100000:2.0:1786562553.992966:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860032 00000100:00100000:2.0:1786562553.993154:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860288 00000100:00100000:2.0:1786562553.993159:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860288 00000100:00100000:2.0:1786562553.994283:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11599 00000100:00100000:2.0:1786562553.994313:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652860032:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562553.994379:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.994402:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786562553.994407:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.994415:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.994431:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562553.996045:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11600 00000100:00100000:2.0:1786562553.996066:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652860288:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562553.996123:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.996145:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562553.996150:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562553.996156:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562553.996171:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.004734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562554.004796:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860416 00000100:00100000:0.0:1786562554.004808:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860416 00000100:00100000:1.0:1786562554.005025:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860544 00000100:00100000:1.0:1786562554.005030:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860544 00000100:00100000:1.0:1786562554.005068:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.005095:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.005438:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860160 00000100:00100000:1.0:1786562554.005443:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860160 00000100:00100000:1.0:1786562554.005484:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860672 00000100:00100000:1.0:1786562554.005486:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860672 00000100:00100000:1.0:1786562554.005513:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11601 00000100:00100000:1.0:1786562554.005525:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652860416:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562554.005579:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.005609:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786562554.005615:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.005623:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.005640:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.006867:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11602 00000100:00100000:3.0:1786562554.006905:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:2349:x1873345652860160:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562554.006953:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.006971:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.006975:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.006983:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.006997:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.007495:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11603 00000100:00100000:0.0:1786562554.007510:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345652860672:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562554.007542:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.007553:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.007557:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.007561:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.007572:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.019073:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.019100:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.019111:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.019119:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988267e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562554.022685:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.022713:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.022725:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.022734:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a068c400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562554.022740:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.022750:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.022775:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.022783:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda1d3fa/0x5c655bf66689f586 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.022854:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652859776:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 72760us (74253us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562554.022866:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11597 00010000:00010000:1.0:1786562554.023082:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.023099:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.023113:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.023128:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d67ad9c8/0x5c655bf66689f57f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.023185:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+33:2348:x1873345652859648:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 74070us (74697us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.023193:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11596 00000100:00100000:0.0:1786562554.026768:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11604 00000100:00100000:0.0:1786562554.026806:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652860544:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562554.026870:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.026906:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.026912:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.026922:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.026957:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028363:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028388:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028398:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028407:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562554.028414:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028425:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028447:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.028455:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96ef253/0x5c655bf66689f58d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.028536:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652859904:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 76462us (79872us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562554.028549:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11598 00010000:00010000:1.0:1786562554.060614:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.060643:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.060653:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.060661:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.060668:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.060679:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.060705:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.060719:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f5a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.060849:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652860416:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 55318us (71540us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.060862:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11601 00010000:00010000:3.0:1786562554.069314:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.069345:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.069357:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.069365:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562554.069373:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.069384:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.069411:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.069420:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f594 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.069530:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345652860032:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 75224us (106684us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562554.069542:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11599 00010000:00010000:2.0:1786562554.077282:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.077309:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.077319:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.077327:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562554.077333:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.077348:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.077373:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.077382:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000188b620f/0x5c655bf66689f59b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.077507:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652860288:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 81441us (103674us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562554.077519:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11600 00010000:00010000:1.0:1786562554.081243:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.081270:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.081281:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.081289:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.081295:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.081304:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.081330:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.081344:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033bf96a5/0x5c655bf66689f5a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.081443:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:2349:x1873345652860160:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 74555us (76366us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.081454:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11602 00010000:00010000:1.0:1786562554.100741:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.100772:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.100783:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.100791:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.100797:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.100807:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.100832:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.100846:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000026e4f4c/0x5c655bf66689f5b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.100986:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652860672:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 93473us (95882us total) trans 0 rc 988320/988320 00000100:00100000:1.0:1786562554.100998:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11603 00010000:00010000:2.0:1786562554.106804:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.106835:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.106847:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.106856:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562554.106861:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.106889:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.106915:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.106935:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689f5b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.107103:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652860544:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 80313us (102376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562554.107115:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11604 00000100:00100000:2.0:1786562554.149460:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562554.149494:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562554.149596:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562554.149696:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654892416 00000100:00100000:2.0:1786562554.149707:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654892416 00000100:00100000:2.0:1786562554.149780:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1786562554.149791:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654892416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562554.149836:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 349503488 pending 0 free 3829399552 avail 3827302400 00000100:00100000:2.0:1786562554.149900:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654892416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562554.149908:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:2.0:1786562554.149943:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562554.149979:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876089 gen 2 00000004:00080000:2.0:1786562554.149985:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e4700, transno 17179876081 00000004:00080000:2.0:1786562554.149995:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e5880, transno 17179876082 00000004:00080000:2.0:1786562554.149998:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e6a00, transno 17179876083 00000004:00080000:2.0:1786562554.150000:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e4000, transno 17179876084 00000004:00080000:2.0:1786562554.150026:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e7480, transno 17179876085 00000004:00080000:2.0:1786562554.150030:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e6d80, transno 17179876086 00000004:00080000:2.0:1786562554.150032:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e4380, transno 17179876087 00000004:00080000:2.0:1786562554.150034:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e5500, transno 17179876088 00000004:00080000:2.0:1786562554.150037:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5ce00, transno 17179876089 00000100:00100000:2.0:1786562554.150050:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562554.151506:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654892928:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.151583:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562554.151634:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562554.151641:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654892800:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.151666:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562554.151697:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654892928 00000100:00100000:0.0:1786562554.151705:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654892928 00000100:00100000:0.0:1786562554.151770:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654892800 00000100:00100000:0.0:1786562554.151773:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654892800 00000100:00100000:0.0:1786562554.151801:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786562554.151811:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654892928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.151868:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654892928:12345-0@lo:400:kworker.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.151889:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786562554.151910:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1786562554.151916:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.151957:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654892800:12345-0@lo:400:kworker.0 Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.151963:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1786562554.151994:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562554.152057:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654892800:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152069:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654892928:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152117:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654892672:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152168:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562554.152379:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654893184:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152408:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562554.152431:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786562554.152437:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654892544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562554.152464:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562554.152484:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654893056:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152506:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562554.152537:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654892672 00000100:00100000:0.0:1786562554.152541:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654892672 00000100:00100000:0.0:1786562554.152575:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1786562554.152582:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654892672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152618:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654892672:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.152625:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1786562554.152657:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893184 00000100:00100000:0.0:1786562554.152660:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893184 00000100:00100000:0.0:1786562554.152686:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1786562554.152692:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654893184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.152723:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654893184:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.152729:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1786562554.152750:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654892544 00000100:00100000:0.0:1786562554.152753:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654892544 00000100:00100000:0.0:1786562554.152789:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1786562554.152796:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654892544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562554.152836:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 509542400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1786562554.152874:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654892544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.152964:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1786562554.152990:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893056 00000100:00100000:0.0:1786562554.152993:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893056 00000100:00100000:0.0:1786562554.153058:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1786562554.153066:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654893056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.153099:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654893056:12345-0@lo:400:kworker.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.153105:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:0.0:1786562554.153275:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562554.153312:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654892544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562554.153323:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654893056:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.153331:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654892672:0@lo:400:kworker.0 00000100:00100000:0.0:1786562554.153339:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654893184:0@lo:400:kworker.0 00000004:00080000:0.0:1786562554.153690:0:33137:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000001:00100000:3.0:1786562554.208311:0:27136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdf847b5-1bd8-403d-8348-e3c7e3ebae2d 00000020:00000080:3.0:1786562554.208322:0:27136:0:(genops.c:906:class_export_put()) final put ffff90e9b452d800/fdf847b5-1bd8-403d-8348-e3c7e3ebae2d 00000020:00000080:2.0:1786562554.208409:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff90e9b452d800/fdf847b5-1bd8-403d-8348-e3c7e3ebae2d for lustre-OST0001 00000020:00000080:2.0:1786562554.208494:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e99cfe3800 for lustre-OST0001 00000100:00100000:1.0:1786562554.430809:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.430867:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.430902:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562554.431057:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860800 00000100:00100000:2.0:1786562554.431071:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860800 00000100:00100000:2.0:1786562554.431160:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652860928 00000100:00100000:2.0:1786562554.431164:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652860928 00000100:00100000:2.0:1786562554.431198:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861056 00000100:00100000:2.0:1786562554.431201:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861056 00000100:00100000:2.0:1786562554.431230:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11605 00000100:00100000:2.0:1786562554.431240:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652860800:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562554.431306:0:14017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:2.0:1786562554.431317:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.431339:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=986s v=(0 0) 00010000:00010000:2.0:1786562554.431345:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.431353:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.431373:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.432470:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11606 00000100:00100000:2.0:1786562554.432484:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+18:2351:x1873345652860928:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562554.432515:0:29458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.432531:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.432535:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.432540:0:29458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.432552:0:29458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.433934:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11607 00000100:00100000:0.0:1786562554.433959:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652861056:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562554.434077:0:29460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:0.0:1786562554.434090:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.434112:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=986s v=(0 0) 00010000:00010000:0.0:1786562554.434118:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.434125:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.434140:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.440999:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562554.443194:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861184 00000100:00100000:2.0:1786562554.443214:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861184 00000100:00100000:2.0:1786562554.443336:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11608 00000100:00100000:2.0:1786562554.443349:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652861184:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562554.443423:0:16203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:2.0:1786562554.443435:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.443454:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=986s v=(0 0) 00010000:00010000:2.0:1786562554.443460:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.443468:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.443483:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.446531:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.446579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.446595:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.446608:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.446645:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861440 00000100:00100000:1.0:1786562554.446658:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861440 00000100:00100000:1.0:1786562554.446731:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861312 00000100:00100000:1.0:1786562554.446734:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861312 00000100:00100000:1.0:1786562554.446759:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861568 00000100:00100000:1.0:1786562554.446762:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861568 00000100:00100000:1.0:1786562554.446780:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861696 00000100:00100000:1.0:1786562554.446783:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861696 00000100:00100000:1.0:1786562554.446810:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11609 00000100:00100000:1.0:1786562554.446822:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652861440:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562554.447117:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 3/1,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.447142:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.447148:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.447156:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.447172:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.448110:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11610 00000100:00100000:0.0:1786562554.448133:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2350:x1873345652861312:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562554.448171:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.448187:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.448191:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.448197:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.448210:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.449183:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11611 00000100:00100000:3.0:1786562554.449213:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652861568:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:3.0:1786562554.449283:0:29461:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x732:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:3.0:1786562554.449294:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.449313:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=986s v=(0 0) 00010000:00010000:3.0:1786562554.449318:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.449326:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.449339:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11612 00010000:00010000:3.0:1786562554.449349:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.449359:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652861696:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:0.0:1786562554.449425:0:16005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x716:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:0.0:1786562554.449436:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.449455:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=986s v=(0 0) 00010000:00010000:0.0:1786562554.449459:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.449465:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.449476:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.453676:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562554.454049:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861824 00000100:00100000:2.0:1786562554.454060:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861824 00000100:00100000:2.0:1786562554.454128:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17823 00000100:00100000:2.0:1786562554.454140:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:2350:x1873345652861824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562554.454165:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562554.454203:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068f8c621/0x5c655bf66689f5f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf02 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.454237:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.454243:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.454258:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068f8c621/0x5c655bf66689f5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf02 expref: 26 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.459415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562554.459455:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652861952 00000100:00100000:3.0:1786562554.459466:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652861952 00000100:00100000:3.0:1786562554.459525:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17824 00000100:00100000:3.0:1786562554.459538:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:2350:x1873345652861952:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562554.459559:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562554.459580:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f5fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf09 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.459609:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.459614:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.459624:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f5fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf09 expref: 28 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.459643:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f5fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf09 expref: 28 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.459660:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880e00, rc 0) 00000100:00100000:1.0:1786562554.460128:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.460164:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.460186:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.460211:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.460232:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.460350:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862208 00000100:00100000:1.0:1786562554.460359:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862208 00010000:00010000:2.0:1786562554.463500:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068f8c621/0x5c655bf66689f5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf02 expref: 29 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.463538:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988f23a00, rc 0) 00000100:00100000:0.0:1786562554.463669:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862464 00000100:00100000:0.0:1786562554.463679:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862464 00000100:00100000:3.0:1786562554.467642:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652861952:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8093us (8225us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562554.467656:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17824 00000100:00100000:1.0:1786562554.476869:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862080 00000100:00100000:1.0:1786562554.476891:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862080 00000100:00100000:1.0:1786562554.476974:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862336 00000100:00100000:1.0:1786562554.476978:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862336 00000100:00100000:1.0:1786562554.476996:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862592 00000100:00100000:1.0:1786562554.477000:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862592 00000100:00100000:1.0:1786562554.477051:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17825 00000100:00100000:1.0:1786562554.477064:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652862208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562554.477093:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562554.477120:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b11c20f/0x5c655bf66689f604 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf17 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477157:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477163:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477177:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b11c20f/0x5c655bf66689f604 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf17 expref: 31 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477199:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b11c20f/0x5c655bf66689f604 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf17 expref: 31 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477215:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99cd80200, rc 0) 00000100:00100000:1.0:1786562554.477279:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+31:2350:x1873345652862208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 220us (17162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562554.477287:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17825 00000100:00100000:1.0:1786562554.477318:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17826 00000100:00100000:1.0:1786562554.477328:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652862080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562554.477338:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562554.477353:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8e55f0a/0x5c655bf66689f60b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf10 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477369:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477373:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477390:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e55f0a/0x5c655bf66689f60b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf10 expref: 34 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477405:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8e55f0a/0x5c655bf66689f60b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf10 expref: 34 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477417:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99cd80800, rc 0) 00000100:00100000:1.0:1786562554.477444:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+34:2351:x1873345652862080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 118us (17256us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562554.477454:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17826 00000100:00100000:1.0:1786562554.477472:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17827 00000100:00100000:1.0:1786562554.477480:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652862336:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562554.477489:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562554.477501:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f612 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477517:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477521:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477527:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f612 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf1e expref: 34 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477540:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f612 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf1e expref: 34 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477551:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb38ec00, rc 0) 00000100:00100000:1.0:1786562554.477576:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+34:2351:x1873345652862336:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 90us (17356us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562554.477582:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17827 00000100:00100000:1.0:1786562554.477598:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17828 00000100:00100000:1.0:1786562554.477605:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652862592:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562554.477612:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562554.477624:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689f619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562554.477659:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x717:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x3 00010000:00010000:1.0:1786562554.477670:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x717:0x0].0x0 since=986s v=(0 0) 00010000:00010000:1.0:1786562554.477674:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.477679:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689f619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf2c expref: 34 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477692:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689f619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf2c expref: 34 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.477700:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb38e200, rc 0) 00000100:00100000:1.0:1786562554.477715:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+34:2351:x1873345652862592:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 111us (17482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562554.477721:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17828 00010000:00010000:1.0:1786562554.478504:0:29458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478525:0:29458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478534:0:29458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478541:0:29458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.478546:0:29458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478556:0:29458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478574:0:29458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478583:0:29458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036baa0f9/0x5c655bf66689f5c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.478641:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+29:2351:x1873345652860928:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 46158us (47770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.478649:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11606 00010000:00010000:1.0:1786562554.478758:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478767:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478775:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478781:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.478785:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478791:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478802:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.478809:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c6af3e3/0x5c655bf66689f5be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.478845:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345652860800:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 47606us (48051us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.478852:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11605 00000100:00100000:2.0:1786562554.488928:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:2350:x1873345652861824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 34760us (35236us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562554.488950:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17823 00010000:00010000:1.0:1786562554.494848:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.494877:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.494888:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.494896:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.494902:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.494912:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.494950:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.494959:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f5cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.495087:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652861056:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 61131us (64175us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.495098:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11607 00000100:00100000:0.0:1786562554.498151:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17829 00000100:00100000:0.0:1786562554.498202:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:2350:x1873345652862464:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562554.498231:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562554.498261:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f620 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf25 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562554.498299:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x733:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:0.0:1786562554.498329:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=986s v=(0 0) 00010000:00010000:0.0:1786562554.498335:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.498348:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf25 expref: 24 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.498367:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf25 expref: 24 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.498401:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e988267000, rc 0) 00000100:00100000:0.0:1786562554.498499:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+24:2350:x1873345652862464:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 331us (38332us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.498507:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17829 00010000:00010000:3.0:1786562554.512570:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.512589:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.512598:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.512606:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988267e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562554.512610:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.512618:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.512644:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.512653:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67ad9c8/0x5c655bf66689f5e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.515029:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2350:x1873345652861312:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 66880us (68421us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562554.515045:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11610 00010000:00010000:2.0:1786562554.540912:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.540942:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.540951:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.540958:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af415600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562554.540963:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.540972:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.540992:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.540999:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040951e5/0x5c655bf66689f5d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.541108:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652861184:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 97758us (100120us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562554.541119:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11608 00000100:00100000:0.0:1786562554.543692:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562554.545721:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.545740:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.545750:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.545757:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99cd81400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562554.545763:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.545771:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.545799:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.545806:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153bf7f7/0x5c655bf66689f5da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.545890:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652861440:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 99067us (99370us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562554.545900:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11609 00000100:00100000:3.0:1786562554.545946:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862720 00000100:00100000:3.0:1786562554.545955:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862720 00000100:00100000:1.0:1786562554.548131:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11613 00000100:00100000:0.0:1786562554.548303:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652862720:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562554.548349:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.548365:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.548369:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.548375:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.548389:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567356:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567378:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567720:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567729:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562554.567735:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567744:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567810:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.567819:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a72c07/0x5c655bf66689f5e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.573202:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+21:2350:x1873345652861568:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 123990us (126590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562554.573219:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11611 00010000:00010000:1.0:1786562554.574047:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.574064:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.574074:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.574082:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e988266200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562554.574087:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.574096:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.574131:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.574145:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80526c2/0x5c655bf66689f5ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.574208:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+28:2350:x1873345652861696:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 124856us (127595us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562554.574217:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11612 00010000:00010000:0.0:1786562554.592197:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.592219:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.592229:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.592238:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562554.592243:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.592252:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.592272:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.592280:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf66689f627 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.592359:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652862720:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 44210us (48675us total) trans 0 rc 988320/988320 00000100:00100000:0.0:1786562554.592369:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11613 00010000:00010000:2.0:1786562554.664062:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562554.765756:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950682 is committed 00000001:00100000:2.0:1786562554.765793:0:33119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdf847b5-1bd8-403d-8348-e3c7e3ebae2d 00000001:00080000:2.0:1786562554.765799:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950677 is committed 00000020:00000080:2.0:1786562554.765803:0:33119:0:(genops.c:906:class_export_put()) final put ffff90e88bfb5800/fdf847b5-1bd8-403d-8348-e3c7e3ebae2d 00000020:00000080:0.0:1786562554.766072:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff90e88bfb5800/fdf847b5-1bd8-403d-8348-e3c7e3ebae2d for lustre-MDT0000 00000020:00000080:0.0:1786562554.766168:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e88bfb4000 for lustre-MDT0000 00000100:00100000:1.0:1786562554.917937:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.918000:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.918089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562554.918253:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862848 00000100:00100000:2.0:1786562554.918274:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862848 00000100:00100000:2.0:1786562554.918398:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652862976 00000100:00100000:2.0:1786562554.918403:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652862976 00000100:00100000:2.0:1786562554.918425:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863104 00000100:00100000:2.0:1786562554.918428:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863104 00000100:00100000:2.0:1786562554.918455:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11614 00000100:00100000:2.0:1786562554.918468:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+30:2351:x1873345652862848:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:2.0:1786562554.918552:0:29459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:2.0:1786562554.918579:0:29459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.918607:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=987s v=(0 0) 00010000:00010000:2.0:1786562554.918614:0:29459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.918623:0:29459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.918645:0:29459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.920103:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11615 00000100:00100000:2.0:1786562554.920122:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+31:2351:x1873345652862976:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562554.920180:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.920208:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.920213:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.920220:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.920238:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.921361:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11616 00000100:00100000:0.0:1786562554.921400:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:2351:x1873345652863104:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562554.921445:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.921464:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.921469:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.921476:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.921491:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.927228:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.927314:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.927341:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.927360:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562554.927847:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863232 00000100:00100000:3.0:1786562554.927878:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863232 00000100:00100000:3.0:1786562554.927983:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863360 00000100:00100000:3.0:1786562554.927987:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863360 00000100:00100000:3.0:1786562554.928039:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863488 00000100:00100000:3.0:1786562554.928043:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863488 00000100:00100000:3.0:1786562554.928065:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863616 00000100:00100000:3.0:1786562554.928069:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863616 00000100:00100000:3.0:1786562554.928099:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11617 00000100:00100000:3.0:1786562554.928112:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+36:2351:x1873345652863232:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562554.928164:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.928188:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.928195:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.928205:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.928228:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562554.929401:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11618 00000100:00100000:3.0:1786562554.929420:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+37:2351:x1873345652863360:12345-192.168.204.29@tcp:3:lfs.0 00002000:00010000:3.0:1786562554.929483:0:6665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x718:0x0] initial LVB size: 8388608, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:3.0:1786562554.929496:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.929516:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=987s v=(0 0) 00010000:00010000:3.0:1786562554.929522:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562554.929530:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562554.929547:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.932450:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.932780:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.932805:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.932822:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.932852:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562554.932923:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863744 00000100:00100000:1.0:1786562554.932937:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863744 00000100:00100000:1.0:1786562554.933038:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11619 00000100:00100000:1.0:1786562554.933049:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+38:2351:x1873345652863488:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562554.933097:0:29458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.933125:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.933130:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.933137:0:29458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.933152:0:29458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562554.934279:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11620 00000100:00100000:1.0:1786562554.934296:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+39:2351:x1873345652863616:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562554.934336:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.934356:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.934360:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562554.934367:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.936227:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652863872 00000100:00100000:0.0:1786562554.936246:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652863872 00000100:00100000:0.0:1786562554.936325:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864000 00000100:00100000:0.0:1786562554.936328:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864000 00000100:00100000:0.0:1786562554.936342:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864128 00000100:00100000:0.0:1786562554.936345:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864128 00000100:00100000:0.0:1786562554.936358:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864256 00000100:00100000:0.0:1786562554.936360:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864256 00000100:00100000:0.0:1786562554.936404:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17830 00000100:00100000:0.0:1786562554.936415:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+42:2351:x1873345652863872:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562554.936439:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562554.936461:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc13064/0x5c655bf66689f65f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf33 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936499:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.936505:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.936517:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc13064/0x5c655bf66689f65f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf33 expref: 43 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936536:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002bc13064/0x5c655bf66689f65f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf33 expref: 43 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936569:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6dc00, rc 0) 00000100:00100000:0.0:1786562554.936656:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+43:2351:x1873345652863872:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 242us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.936664:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17830 00000100:00100000:0.0:1786562554.936690:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17831 00000100:00100000:0.0:1786562554.936697:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+42:2351:x1873345652864000:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562554.936704:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562554.936712:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f666 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936724:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.936728:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.936734:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf3a expref: 43 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936745:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf3a expref: 43 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936754:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d800, rc 0) 00000100:00100000:0.0:1786562554.936774:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+43:2351:x1873345652864000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 79us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.936780:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17831 00000100:00100000:0.0:1786562554.936793:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17832 00000100:00100000:0.0:1786562554.936800:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+42:2351:x1873345652864128:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562554.936808:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562554.936824:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f66d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf41 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562554.936857:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x719:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:0.0:1786562554.936884:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=987s v=(0 0) 00010000:00010000:0.0:1786562554.936888:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.936894:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf41 expref: 43 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936916:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf41 expref: 43 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.936926:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92d600, rc 0) 00000100:00100000:0.0:1786562554.936950:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+43:2351:x1873345652864128:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 150us (4126us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.936957:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17832 00000100:00100000:0.0:1786562554.936970:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17833 00000100:00100000:0.0:1786562554.936980:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345652864256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562554.936988:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562554.937003:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f674 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf48 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562554.937065:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x734:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x3 00010000:00010000:0.0:1786562554.937077:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x734:0x0].0x0 since=987s v=(0 0) 00010000:00010000:0.0:1786562554.937081:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.937088:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf48 expref: 20 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.937098:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf48 expref: 20 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.937106:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bf92c600, rc 0) 00000100:00100000:0.0:1786562554.937128:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345652864256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 152us (4276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562554.937134:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17833 00000100:00100000:0.0:1786562554.937172:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11621 00000100:00100000:0.0:1786562554.937180:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+42:2351:x1873345652863744:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562554.937210:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.937221:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.937225:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562554.937230:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.937241:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 7 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562554.946276:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562554.959116:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562554.959185:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864384 00000100:00100000:2.0:1786562554.959196:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864384 00000100:00100000:2.0:1786562554.959281:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11622 00000100:00100000:2.0:1786562554.959294:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+46:2349:x1873345652864384:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562554.959345:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.959368:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.959375:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562554.959385:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562554.959402:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998062:0:29459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998101:0:29459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998112:0:29459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998120:0:29459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99261c400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562554.998127:0:29459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998136:0:29459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998161:0:29459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562554.998169:0:29459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a97b96b/0x5c655bf66689f62e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562554.998272:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+47:2351:x1873345652862848:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 79799us (80362us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562554.998284:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11614 00010000:00010000:0.0:1786562555.011325:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.011357:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.011371:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.011380:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562555.011387:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.011400:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.011431:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.018687:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001211f00b/0x5c655bf66689f63c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562555.019781:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+45:2351:x1873345652863104:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 98394us (101677us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562555.019800:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11616 00010000:00010000:2.0:1786562555.073733:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.073766:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.073776:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.073784:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562555.073790:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.073801:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.073832:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.073841:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035c433c5/0x5c655bf66689f643 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562555.073992:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+43:2351:x1873345652863232:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 145875us (146773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562555.074060:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11617 00010000:00010000:3.0:1786562555.101899:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562555.101943:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562555.101954:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562555.101969:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bf92d200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562555.101976:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562555.101987:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562555.102573:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562555.102590:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbedfffe/0x5c655bf66689f67b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562555.102733:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+41:2351:x1873345652863744:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 165546us (170292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562555.102747:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11621 00010000:00010000:0.0:1786562555.106756:0:29458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.106784:0:29458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.106796:0:29458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.106804:0:29458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb364a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562555.106811:0:29458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.106821:0:29458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.106848:0:29458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.106856:0:29458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eef900b/0x5c655bf66689f651 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562555.106997:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+39:2351:x1873345652863488:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 173943us (179646us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562555.107039:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11619 00010000:00010000:2.0:1786562555.112342:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.112380:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.112390:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.112399:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99261de00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562555.112405:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.112415:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.112450:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562555.112459:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21cfb95/0x5c655bf66689f635 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562555.112553:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+37:2351:x1873345652862976:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 192430us (194546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562555.112564:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11615 00010000:00010000:0.0:1786562555.144603:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.144630:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.144640:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.144648:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e986a1b400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562555.144653:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.144668:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.144694:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.144703:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067538fa9/0x5c655bf66689f64a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562555.144805:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+35:2351:x1873345652863360:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 215384us (217483us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562555.144817:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11618 00010000:00010000:1.0:1786562555.177848:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562555.178299:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562555.178312:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562555.178322:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb365200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562555.178329:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562555.178341:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562555.178371:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562555.178379:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009414159e/0x5c655bf66689f658 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562555.183607:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+33:2351:x1873345652863616:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 249297us (256225us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562555.183628:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11620 00010000:00010000:0.0:1786562555.205353:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.205381:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.205392:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.205401:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a0515200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562555.205408:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.205417:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.205453:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562555.205462:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1820d4f/0x5c655bf66689f682 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [4194304->5185535] (req 4194304->5185535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562555.205589:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652864384:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 246291us (246484us total) trans 0 rc 988320/988320 00000100:00100000:0.0:1786562555.205612:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11622 00010000:00010000:1.0:1786562555.685613:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562556.711193:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562557.734758:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562557.757059:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562557.757124:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562557.757165:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562557.757181:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864512 00000100:00100000:1.0:1786562557.757199:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562557.757234:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864640 00000100:00100000:1.0:1786562557.757242:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864640 00000100:00100000:0.0:1786562557.757242:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864512 00000100:00100000:1.0:1786562557.757296:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 284 00000100:00100000:0.0:1786562557.757302:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 250 00000100:00100000:1.0:1786562557.757308:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+503:2348:x1873345652864640:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562557.757308:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652864512:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562557.757388:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652864512:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562557.757394:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864768 00000100:00100000:0.0:1786562557.757397:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 250 00000100:00100000:2.0:1786562557.757398:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864768 00000100:00100000:2.0:1786562557.757428:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652864896 00000100:00100000:2.0:1786562557.757431:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652864896 00000100:00100000:2.0:1786562557.757466:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 446 00000100:00100000:2.0:1786562557.757473:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652864768:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562557.757477:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 447 00000100:00100000:0.0:1786562557.757483:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652864896:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562557.761650:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+503:2348:x1873345652864640:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 4328us (4467us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562557.761666:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 284 00000100:00080000:1.0:1786562557.761731:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562557.761737:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562557.761741:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562557.762053:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652864768:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 4578us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562557.762064:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 446 00000100:00100000:0.0:1786562557.775942:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652864896:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 18445us (18729us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562557.775963:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 447 00010000:00010000:1.0:1786562558.760204:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562559.269429:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654893312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562559.269535:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562559.269635:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893312 00000100:00100000:0.0:1786562559.269645:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893312 00000100:00100000:0.0:1786562559.269716:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1786562559.269727:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654893312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562559.269777:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 509542400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1786562559.269844:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654893312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.269852:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:0.0:1786562559.269879:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562559.269925:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654893312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562559.271390:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654893568:0@lo:400:kworker.0 00000100:00100000:2.0:1786562559.271470:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562559.271514:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654894080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562559.271542:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562559.271566:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562559.271572:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654893696:0@lo:400:kworker.0 00000100:00100000:2.0:1786562559.271595:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562559.272760:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654893440:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.272850:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562559.272896:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654893952:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.273229:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562559.273273:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562559.273282:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654893824:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.273340:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562559.273392:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893568 00000100:00100000:0.0:1786562559.273403:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893568 00000100:00100000:0.0:1786562559.273466:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893696 00000100:00100000:0.0:1786562559.273470:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893696 00000100:00100000:0.0:1786562559.273491:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893952 00000100:00100000:0.0:1786562559.273496:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893952 00000100:00100000:0.0:1786562559.273520:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1786562559.273531:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654893568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.273602:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654893568:12345-0@lo:400:kworker.0 Request processed in 73us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.273611:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1786562559.273631:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1786562559.273637:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654893696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.273669:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654893696:12345-0@lo:400:kworker.0 Request processed in 33us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.273675:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1786562559.273688:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1786562559.273694:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654893952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.273727:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654893952:12345-0@lo:400:kworker.0 Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.273733:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1786562559.273758:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894080 00000100:00100000:0.0:1786562559.273762:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894080 00000100:00100000:0.0:1786562559.273791:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1786562559.273798:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654894080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562559.273847:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 349503488 pending 0 free 3829399552 avail 3827302400 00000100:00100000:0.0:1786562559.273886:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654894080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.273893:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1786562559.273920:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893440 00000100:00100000:0.0:1786562559.273924:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893440 00000100:00100000:0.0:1786562559.273950:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1786562559.273957:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.273987:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654893440:12345-0@lo:400:kworker.0 Request processed in 31us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.273995:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1786562559.274084:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654893824 00000100:00100000:0.0:1786562559.274089:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654893824 00000100:00100000:0.0:1786562559.274119:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1786562559.274127:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654893824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.274157:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654893824:12345-0@lo:400:kworker.0 Request processed in 31us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562559.274163:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00080000:0.0:1786562559.274179:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562559.274184:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562559.274229:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654893824:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.274240:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654893440:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.274251:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654893952:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.274314:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654893696:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.274327:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654893568:0@lo:400:kworker.0 00000100:00100000:0.0:1786562559.274344:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654894080:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786562559.781442:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562560.805144:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562561.831145:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562562.853398:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562562.873507:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562562.873567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562562.873615:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562562.873656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562562.873763:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652865152 00000100:00100000:0.0:1786562562.873776:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652865152 00000100:00100000:0.0:1786562562.873862:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 288 00000100:00100000:0.0:1786562562.873874:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+503:2349:x1873345652865152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562562.873984:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+503:2349:x1873345652865152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 112us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562562.873992:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 288 00000100:00100000:0.0:1786562562.874362:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652865408 00000100:00100000:0.0:1786562562.874367:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652865408 00000100:00100000:0.0:1786562562.874400:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652865280 00000100:00100000:0.0:1786562562.874404:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652865280 00000100:00100000:0.0:1786562562.874428:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 449 00000100:00100000:0.0:1786562562.874436:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652865408:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562562.874470:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+31:2349:x1873345652865408:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562562.874477:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 449 00000100:00100000:0.0:1786562562.874489:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 450 00000100:00100000:0.0:1786562562.874495:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652865280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562562.874520:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652865280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562562.874527:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 450 00000100:00080000:1.0:1786562562.874810:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562562.874816:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562562.874819:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562562.875603:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652865024 00000100:00100000:3.0:1786562562.875616:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652865024 00000100:00100000:3.0:1786562562.875677:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 252 00000100:00100000:3.0:1786562562.875686:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652865024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562562.875762:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652865024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 77us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562562.875768:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 252 00010000:00010000:1.0:1786562563.878382:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562564.392974:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654894208:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393071:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.393126:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654894720:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393154:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.393182:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562564.393188:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654894592:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393209:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.393240:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654894336:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393265:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.393296:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654894848:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393318:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.393337:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562564.393342:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654894464:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393361:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.393838:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894208 00000100:00100000:2.0:1786562564.393847:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894208 00000100:00100000:2.0:1786562564.393901:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1786562564.393911:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654894208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.393968:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654894208:12345-0@lo:400:kworker.0 Request processed in 59us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.393977:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1786562564.394030:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894720 00000100:00100000:2.0:1786562564.394035:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894720 00000100:00100000:2.0:1786562564.394071:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894592 00000100:00100000:2.0:1786562564.394074:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894592 00000100:00100000:2.0:1786562564.394093:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1786562564.394099:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654894720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.394132:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654894720:12345-0@lo:400:kworker.0 Request processed in 33us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.394139:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1786562564.394151:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1786562564.394157:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654894592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.394188:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654894592:12345-0@lo:400:kworker.0 Request processed in 31us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.394194:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1786562564.394216:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894336 00000100:00100000:2.0:1786562564.394219:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894336 00000100:00100000:2.0:1786562564.394244:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894848 00000100:00100000:2.0:1786562564.394247:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894848 00000100:00100000:2.0:1786562564.394263:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894464 00000100:00100000:2.0:1786562564.394265:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894464 00000100:00100000:2.0:1786562564.396099:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786562564.396115:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654894336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.398096:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654894336:12345-0@lo:400:kworker.0 Request processed in 1978us (4821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.398109:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786562564.398146:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1786562564.398482:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1786562564.398495:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654894464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562564.398561:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654894464:12345-0@lo:400:kworker.0 Request processed in 70us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562564.398569:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1786562564.400178:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654894848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.400251:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654894848:12345-0@lo:400:kworker.0 Request processed in 2095us (6930us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.400261:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1786562564.401747:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562564.401756:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562564.401759:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562564.401923:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654894976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562564.401989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562564.403236:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654894976 00000100:00100000:3.0:1786562564.403248:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654894976 00000100:00100000:3.0:1786562564.403318:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1786562564.403328:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654894976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562564.403366:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 349503488 pending 0 free 3829399552 avail 3827302400 00000100:00100000:3.0:1786562564.403716:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654894976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 388us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562564.403736:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1786562564.403899:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654894976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562564.404949:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654894464:0@lo:400:kworker.0 00000100:00100000:3.0:1786562564.404965:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654894336:0@lo:400:kworker.0 00000100:00100000:3.0:1786562564.404976:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654894848:0@lo:400:kworker.0 00000100:00100000:3.0:1786562564.405031:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654894592:0@lo:400:kworker.0 00000100:00100000:3.0:1786562564.405042:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654894208:0@lo:400:kworker.0 00000100:00100000:3.0:1786562564.405052:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654894720:0@lo:400:kworker.0 00000100:00100000:2.0:1786562564.409931:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654895104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562564.410028:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562564.410089:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654895104 00000100:00100000:2.0:1786562564.410098:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654895104 00000100:00100000:2.0:1786562564.410144:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1786562564.410154:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654895104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562564.410190:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 509542400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1786562564.410236:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654895104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.410245:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1786562564.410305:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654895104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562564.768346:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562564.769149:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652865664 00000100:00100000:0.0:1786562564.769164:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652865664 00000100:00100000:0.0:1786562564.769242:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6291 00000100:00100000:0.0:1786562564.769254:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9c2064c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652865664:12345-192.168.204.29@tcp:35:rm.0 00000100:00100000:0.0:1786562564.769564:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9c2064c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+504:64649:x1873345652865664:12345-192.168.204.29@tcp:35:rm.0 Request processed in 308us (1230us total) trans 8589950683 rc 0/0 00000100:00100000:0.0:1786562564.769573:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6291 00000100:00080000:0.0:1786562564.769626:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562564.782856:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562564.784026:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652865920 00000100:00100000:1.0:1786562564.784046:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652865920 00000100:00100000:1.0:1786562564.784147:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17132 00000100:00100000:1.0:1786562564.784161:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+504:64649:x1873345652865920:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:1.0:1786562564.784248:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786562564.784290:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f460 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceca expref: 504 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784327:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f436 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcebc expref: 503 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784340:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9a98db600) 00010000:00010000:1.0:1786562564.784360:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881600/0x5c655bf66689aa54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfa763 expref: 502 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784369:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9a98dbb00) 00010000:00010000:1.0:1786562564.784377:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562564.784410:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784425:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784436:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784449:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784456:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.784462:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.794525:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.794557:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562564.794571:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786562564.817303:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4406, 64 off357952 00000004:00080000:1.0:1786562564.817338:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 997259331145ns, next at 998259325187ns, rc = 0 00000040:00080000:1.0:1786562564.826834:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4380, 64 off355488 00000004:00080000:1.0:1786562564.826874:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 997268866057ns, next at 998268859252ns, rc = 0 00000040:00080000:1.0:1786562564.827864:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4381, 64 off355552 00000040:00080000:1.0:1786562564.827940:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4407, 64 off358016 00000040:00080000:1.0:1786562564.827960:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4408, 64 off358080 00000040:00080000:1.0:1786562564.828804:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4382, 64 off355616 00000040:00080000:1.0:1786562564.828842:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4383, 64 off355680 00000040:00080000:1.0:1786562564.828859:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4384, 64 off355744 00000040:00080000:1.0:1786562564.828879:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4409, 64 off358144 00000040:00080000:1.0:1786562564.828894:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4385, 64 off355808 00000040:00080000:1.0:1786562564.828911:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4410, 64 off358208 00000040:00080000:1.0:1786562564.828927:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4386, 64 off355872 00000040:00080000:1.0:1786562564.828941:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4411, 64 off358272 00000040:00080000:1.0:1786562564.828957:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4412, 64 off358336 00000040:00080000:1.0:1786562564.828972:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4413, 64 off358400 00000040:00080000:0.0:1786562564.833639:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4414, 64 off358464 00000040:00080000:0.0:1786562564.833725:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4387, 64 off355936 00010000:00010000:0.0:1786562564.833871:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.833892:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.833905:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.833916:0:33113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.833924:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.833931:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.833966:0:33113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786562564.833992:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834000:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834042:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834049:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562564.834054:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834063:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834076:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:0.0:1786562564.834080:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786562564.834084:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834090:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880800/0x5c655bf66689f697 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834112:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834119:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834125:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834130:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562564.834133:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834139:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834147:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:0.0:1786562564.834150:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562564.834153:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.834163:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881c00/0x5c655bf66689f689 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562564.834180:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081f40241 reply state 000000004636218d transno 8589950684 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562564.834189:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562564.834293:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652865920:12345-192.168.204.29@tcp:36:rm.0 Request processed in 50131us (51926us total) trans 8589950684 rc 0/0 00000100:00100000:0.0:1786562564.834303:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17132 00010000:00010000:2.0:1786562564.834310:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562564.834319:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.834326:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562564.834331:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.834348:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.834359:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d6:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562564.834362:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786562564.834365:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.834372:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f69e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.834385:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562564.834387:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562564.834389:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562564.843774:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.843792:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.843799:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.843805:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562564.843810:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.843818:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.843836:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562564.843839:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562564.843844:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562564.843855:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880000/0x5c655bf66689f690 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562564.851562:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562564.851687:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866048 00000100:00100000:2.0:1786562564.851698:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866048 00000100:00100000:2.0:1786562564.851773:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17133 00000100:00100000:2.0:1786562564.851787:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+502:64649:x1873345652866048:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1786562564.851817:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562564.851843:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf4f expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.851919:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f6ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.851946:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.851959:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562564.852051:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562564.852055:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 36 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562564.852082:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.852109:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf4f expref: 504 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.852132:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf4f expref: 503 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.852141:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562564.852145:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562564.852148:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562564.852204:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652866048:12345-192.168.204.29@tcp:101:rm.0 Request processed in 420us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562564.852211:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17133 00000100:00100000:1.0:1786562564.867817:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562564.867987:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866176 00000100:00100000:2.0:1786562564.868002:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866176 00000100:00100000:2.0:1786562564.868097:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17134 00000100:00100000:2.0:1786562564.868108:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652866176:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1786562564.868129:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562564.868152:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f6b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf56 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868221:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868237:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868250:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868325:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868334:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868347:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868538:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868547:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868554:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868566:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562564.868570:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868579:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868593:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562564.868596:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562564.868601:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868607:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689f6ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868621:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868628:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868634:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868638:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af415600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562564.868641:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868647:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868658:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a1902b1 (ffff90e9b6332400) 00010000:00010000:2.0:1786562564.868661:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562564.868663:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868669:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868703:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f6b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf56 expref: 504 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868725:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562564.868728:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562564.868731:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf56 expref: 504 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.868742:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562564.868816:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652866176:12345-192.168.204.29@tcp:101:rm.0 Request processed in 709us (1017us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562564.868824:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17134 00000100:00100000:1.0:1786562564.880800:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562564.881156:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866304 00000100:00100000:2.0:1786562564.881171:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866304 00000100:00100000:2.0:1786562564.881266:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17135 00000100:00100000:2.0:1786562564.881279:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652866304:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1786562564.881302:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562564.881324:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf5d expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882587:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882605:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882617:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882633:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882640:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882647:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882866:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882873:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882879:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882885:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562564.882890:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882901:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882913:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562564.882917:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562564.882921:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.882927:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414600/0x5c655bf66689f6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883105:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883112:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883118:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883123:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af414800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562564.883126:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883133:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883141:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbdcc6f6 (ffff90e9b6332400) 00010000:00010000:2.0:1786562564.883144:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562564.883147:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883157:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414800/0x5c655bf66689f6d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883196:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf5d expref: 504 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883206:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562564.883208:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562564.883212:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf5d expref: 504 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562564.883221:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af415600, rc 0) 00000100:00100000:2.0:1786562564.883539:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:64649:x1873345652866304:12345-192.168.204.29@tcp:101:rm.0 Request processed in 2261us (2753us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562564.883550:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17135 00010000:00010000:3.0:1786562564.903801:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562565.021581:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950683 is committed 00000001:00080000:3.0:1786562565.021606:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950684 is committed 00000004:00080000:3.0:1786562565.021610:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2888 committed 00000004:00080000:3.0:1786562565.021625:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2916 committed 00000100:00100000:3.0:1786562565.021824:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654895232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786562565.021919:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562565.022037:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654895232 00000100:00100000:3.0:1786562565.022045:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654895232 00000100:00100000:3.0:1786562565.022097:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17834 00000100:00100000:3.0:1786562565.022107:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654895232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786562565.022142:0:12119:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1809 count 1 00010000:00010000:3.0:1786562565.022168:0:12119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.022193:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 30 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.022203:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562565.022208:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562565.022212:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.022241:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 30 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.022254:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 30 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562565.022265:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654895360:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562565.022326:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562565.025562:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12119:1873345654895360:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562565.025592:0:12119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562565.026547:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562565.026687:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866432 00000100:00100000:1.0:1786562565.026696:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866432 00010000:00010000:1.0:1786562565.026762:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 31 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562565.026801:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8734 00000100:00100000:1.0:1786562565.026812:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345652866432:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562565.026827:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562565.026833:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 31 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.026846:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 31 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.026870:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069d5078/0x5c655bf66689f483 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfced8 expref: 31 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.026886:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562565.026891:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562565.026896:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.026912:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.026935:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562565.026990:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652866432:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 180us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562565.026998:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8734 00000100:00080000:3.0:1786562565.027378:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786562565.027483:0:12119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.027494:0:12119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.027504:0:12119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.027512:0:12119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562565.027537:0:12119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786562565.028294:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654895232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6186us (6373us total) trans 17179876090 rc 0/0 00000100:00100000:3.0:1786562565.028305:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17834 00000004:00080000:3.0:1786562565.028358:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b46e5c00/2, rc 0, transno 17179876090 00000100:00100000:3.0:1786562565.028372:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654895232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786562565.029210:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562565.029220:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.029232:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562565.029237:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.029248:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.029268:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.029276:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689f6dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.029298:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562565.029300:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562565.029302:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562565.029614:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562565.029631:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654895488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562565.029714:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562565.029890:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654895488 00000100:00100000:0.0:1786562565.029897:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654895488 00000100:00100000:0.0:1786562565.029959:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17835 00000100:00100000:0.0:1786562565.029969:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654895488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786562565.030028:0:29963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1838 count 1 00010000:00010000:0.0:1786562565.030050:0:29963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562565.030069:0:29963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 19 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562565.030078:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=11s v=(0 0) 00010000:00010000:0.0:1786562565.030082:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562565.030087:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562565.030112:0:29963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 19 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562565.030124:0:29963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 19 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562565.030141:0:29963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654895616:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562565.030209:0:29963:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611180 going to sleep for 11 seconds 00000100:00100000:0.0:1786562565.042205:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562565.042324:0:29963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29963:1873345654895616:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562565.042353:0:29963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562565.042480:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866560 00000100:00100000:1.0:1786562565.042486:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866560 00010000:00010000:1.0:1786562565.042534:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 20 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562565.042578:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8735 00000100:00100000:1.0:1786562565.042588:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652866560:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562565.042604:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562565.042610:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 20 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.042622:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 20 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.042646:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b8d9d1/0x5c655bf66689f48a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcedf expref: 20 pid: 12119 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.042661:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562565.042679:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562565.042685:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.042695:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.042732:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562565.042779:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652866560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 193us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562565.042786:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8735 00010000:00010000:2.0:1786562565.043153:0:29963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562565.043164:0:29963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562565.043174:0:29963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562565.043183:0:29963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562565.043204:0:29963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786562565.043992:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654895488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14022us (14283us total) trans 21474843603 rc 0/0 00000100:00100000:2.0:1786562565.044002:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17835 00000004:00080000:0.0:1786562565.044263:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c52e680/2, rc 0, transno 21474843603 00000100:00100000:0.0:1786562565.044283:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654895488:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786562565.044641:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562565.044651:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.044673:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562565.044679:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.044691:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.044721:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.044730:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f6e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562565.044754:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562565.044756:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562565.044758:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786562565.045724:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786562565.925357:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562566.956613:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786562567.754139:0:37257:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 200c: layout change racing with open: LOVEA changes ========================================================== 15:22:44 (1786562564) 00010000:00010000:3.0:1786562567.975212:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562568.017126:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.017176:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.017217:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.017228:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866944 00000100:00100000:2.0:1786562568.017238:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866944 00000100:00100000:0.0:1786562568.017248:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.017274:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866816 00000100:00100000:0.0:1786562568.017279:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866816 00000100:00100000:2.0:1786562568.017300:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867072 00000100:00100000:2.0:1786562568.017305:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867072 00000100:00100000:2.0:1786562568.017335:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 453 00000100:00100000:0.0:1786562568.017340:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 292 00000100:00100000:2.0:1786562568.017348:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652866944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562568.017367:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+501:2348:x1873345652866816:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562568.017428:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652866944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.017437:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 453 00000100:00100000:1.0:1786562568.017440:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652866688 00000100:00100000:1.0:1786562568.017445:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652866688 00000100:00100000:2.0:1786562568.017456:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 454 00000100:00100000:2.0:1786562568.017466:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652867072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562568.017481:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 254 00000100:00100000:1.0:1786562568.017491:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652866688:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562568.017953:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+501:2348:x1873345652866816:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 602us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.017961:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 292 00000100:00080000:3.0:1786562568.021215:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562568.021226:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562568.021229:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562568.026411:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+30:2348:x1873345652867072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 8935us (9150us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.026427:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 454 00000100:00100000:0.0:1786562568.029901:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652866688:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 12399us (12771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.029918:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 254 00000100:00100000:2.0:1786562568.235312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.235600:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867200 00000100:00100000:3.0:1786562568.235612:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867200 00000100:00100000:3.0:1786562568.235678:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 255 00000100:00100000:3.0:1786562568.235688:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:64813:x1873345652867200:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786562568.235705:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562568.235723:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9850cbc00/0x5c655bf66689f6eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf64 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.235751:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9850cbc00/0x5c655bf66689f6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf64 expref: 11 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.235762:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9850cbc00/0x5c655bf66689f6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf64 expref: 11 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.235771:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cbc00, rc 0) 00000100:00100000:3.0:1786562568.235841:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+11:64813:x1873345652867200:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 155us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562568.235854:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 255 00000100:00100000:1.0:1786562568.252744:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.253106:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867328 00000100:00100000:0.0:1786562568.253117:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867328 00000100:00100000:0.0:1786562568.253174:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 256 00000100:00100000:0.0:1786562568.253185:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+11:64813:x1873345652867328:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786562568.253729:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+11:64813:x1873345652867328:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 544us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.253740:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 256 00000100:00100000:0.0:1786562568.265897:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.269098:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867456 00000100:00100000:2.0:1786562568.269119:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867456 00000100:00100000:2.0:1786562568.269221:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 257 00000100:00100000:2.0:1786562568.269234:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+11:64813:x1873345652867456:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786562568.269735:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+11:64813:x1873345652867456:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 501us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.269747:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 257 00000100:00100000:2.0:1786562568.280344:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.280440:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867584 00000100:00100000:0.0:1786562568.280453:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867584 00000100:00100000:0.0:1786562568.280520:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 258 00000100:00100000:0.0:1786562568.280532:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+11:64817:x1873345652867584:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786562568.281047:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+11:64817:x1873345652867584:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 472us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.281057:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 258 00000100:00100000:1.0:1786562568.314962:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.315177:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867712 00000100:00100000:3.0:1786562568.315190:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867712 00000100:00100000:3.0:1786562568.315261:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 259 00000100:00100000:3.0:1786562568.315274:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+11:64817:x1873345652867712:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786562568.315668:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+11:64817:x1873345652867712:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 396us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562568.315678:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 259 00000100:00100000:3.0:1786562568.324962:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.327882:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867840 00000100:00100000:2.0:1786562568.327903:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867840 00000100:00100000:2.0:1786562568.328053:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 260 00000100:00100000:2.0:1786562568.328067:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+11:64813:x1873345652867840:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786562568.328092:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562568.328121:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9af414800/0x5c655bf66689f6f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf8e expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.328160:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9af414800/0x5c655bf66689f6f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf8e expref: 12 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.328172:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9af414800/0x5c655bf66689f6f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf8e expref: 12 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.328183:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9af414800, rc 0) 00000100:00100000:2.0:1786562568.328286:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+12:64813:x1873345652867840:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 222us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.328295:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 260 00000100:00100000:2.0:1786562568.337875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.338046:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652867968 00000100:00100000:3.0:1786562568.338061:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652867968 00000100:00100000:3.0:1786562568.338135:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 261 00000100:00100000:3.0:1786562568.338147:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+12:64813:x1873345652867968:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:3.0:1786562568.338183:0:33107:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1786562568.338217:0:33107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1786562568.338222:0:33107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1786562568.338225:0:33107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1786562568.338228:0:33107:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 15 00000100:00100000:0.0:1786562568.341718:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+12:64813:x1873345652867968:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 3554us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.341739:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 261 00000100:00100000:0.0:1786562568.357496:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562568.357599:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868096 00000100:00100000:1.0:1786562568.357613:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868096 00000100:00100000:1.0:1786562568.357702:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 262 00000100:00100000:1.0:1786562568.357714:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+12:64813:x1873345652868096:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786562568.357738:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562568.357761:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4880c00/0x5c655bf66689f6f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcf95 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562568.357799:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4880c00/0x5c655bf66689f6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf95 expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562568.357812:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4880c00/0x5c655bf66689f6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf95 expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562568.357823:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880c00, rc 0) 00000100:00100000:1.0:1786562568.357905:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+13:64813:x1873345652868096:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 194us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562568.357914:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 262 00000100:00100000:2.0:1786562568.365632:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.365850:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868224 00000100:00100000:0.0:1786562568.365863:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868224 00000100:00100000:0.0:1786562568.365931:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 263 00000100:00100000:0.0:1786562568.365943:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+13:64813:x1873345652868224:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786562568.366370:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+13:64813:x1873345652868224:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 428us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.366379:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 263 00000100:00100000:3.0:1786562568.376289:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.376382:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868352 00000100:00100000:2.0:1786562568.376397:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868352 00000100:00100000:2.0:1786562568.376470:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 264 00000100:00100000:2.0:1786562568.376481:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+13:64813:x1873345652868352:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786562568.376994:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+13:64813:x1873345652868352:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 512us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.377033:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 264 00000100:00100000:3.0:1786562568.400368:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562568.400500:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868480 00000100:00100000:1.0:1786562568.400515:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868480 00000100:00100000:1.0:1786562568.400594:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 265 00000100:00100000:1.0:1786562568.400607:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+13:64821:x1873345652868480:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786562568.401002:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+13:64821:x1873345652868480:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 396us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562568.401052:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 265 00000100:00100000:3.0:1786562568.410210:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.410420:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868608 00000100:00100000:0.0:1786562568.410433:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868608 00000100:00100000:0.0:1786562568.410506:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 266 00000100:00100000:0.0:1786562568.410519:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+13:64821:x1873345652868608:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786562568.410894:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+13:64821:x1873345652868608:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 376us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.410904:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 266 00000100:00100000:3.0:1786562568.414259:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.414318:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.414358:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.414422:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869120 00000100:00100000:2.0:1786562568.414437:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869120 00000100:00100000:2.0:1786562568.414526:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 293 00000100:00100000:2.0:1786562568.414539:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+501:2350:x1873345652869120:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562568.414662:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+501:2350:x1873345652869120:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 126us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.414679:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 293 00000100:00100000:2.0:1786562568.414711:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869248 00000100:00100000:2.0:1786562568.414715:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869248 00000100:00100000:2.0:1786562568.414740:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869376 00000100:00100000:2.0:1786562568.414743:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869376 00000100:00100000:2.0:1786562568.414763:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 455 00000100:00100000:2.0:1786562568.414769:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652869248:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562568.414799:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652869248:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.414806:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 455 00000100:00100000:2.0:1786562568.414817:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 456 00000100:00100000:2.0:1786562568.414823:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652869376:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562568.414846:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:2350:x1873345652869376:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.414852:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 456 00000100:00100000:3.0:1786562568.420827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.422401:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868736 00000100:00100000:2.0:1786562568.422418:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868736 00000100:00100000:2.0:1786562568.422504:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17136 00000100:00100000:2.0:1786562568.422513:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2347:x1873345652868736:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786562568.422557:0:35929:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 16a695a0-b685-4180-8888-8ba29614d6e8@192.168.204.29@tcp t0 exp 0000000000000000 cur 1000 last 0 00000020:00000080:2.0:1786562568.422606:0:35929:0:(genops.c:1406:class_connect()) connect: client 16a695a0-b685-4180-8888-8ba29614d6e8, cookie 0x5c655bf66689f700 00000004:00100000:2.0:1786562568.422658:0:35929:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1786562568.422990:0:35929:0:(import.c:65:import_set_state_nolock()) ffff90e9b4528800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786562568.423149:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2347:x1873345652868736:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 634us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.423158:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17136 00000100:00100000:3.0:1786562568.443763:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.443821:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.443897:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868864 00000100:00100000:0.0:1786562568.443921:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868864 00000100:00100000:2.0:1786562568.443976:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652868992 00000100:00100000:2.0:1786562568.443983:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652868992 00000100:00100000:0.0:1786562568.444079:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17137 00000100:00100000:0.0:1786562568.444091:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+7:0:x1873345652868864:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786562568.444148:0:33113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2260205568 avail 2258108416 00000100:00100000:0.0:1786562568.444238:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+7:0:x1873345652868864:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 149us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.444246:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17137 00000100:00100000:0.0:1786562568.444268:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17138 00000100:00100000:0.0:1786562568.444274:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+6:64813:x1873345652868992:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786562568.444288:0:33113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2260205568 avail 2258108416 00000100:00100000:0.0:1786562568.444312:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+6:64813:x1873345652868992:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 38us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.444318:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17138 00000100:00080000:3.0:1786562568.444416:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562568.449224:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.455793:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869504 00000100:00100000:2.0:1786562568.455814:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869504 00000100:00100000:2.0:1786562568.456023:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17139 00000100:00100000:2.0:1786562568.456038:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+6:64813:x1873345652869504:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1786562568.456829:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+6:64813:x1873345652869504:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 792us (7616us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.456912:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17139 00000100:00100000:3.0:1786562568.471323:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.471386:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.472216:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869632 00000100:00100000:2.0:1786562568.472233:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869632 00000100:00100000:2.0:1786562568.472299:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17836 00000100:00100000:2.0:1786562568.472309:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2347:x1873345652869632:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786562568.472354:0:29965:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 16a695a0-b685-4180-8888-8ba29614d6e8@192.168.204.29@tcp t0 exp 0000000000000000 cur 1000 last 0 00000020:00000080:2.0:1786562568.472396:0:29965:0:(genops.c:1406:class_connect()) connect: client 16a695a0-b685-4180-8888-8ba29614d6e8, cookie 0x5c655bf66689f707 00002000:00100000:2.0:1786562568.472409:0:29965:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 16a695a0-b685-4180-8888-8ba29614d6e8/ffff90e9b452f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786562568.472439:0:29965:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786562568.472558:0:29965:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786562568.472602:0:29965:0:(import.c:65:import_set_state_nolock()) ffff90e9b452a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786562568.474649:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+6:2347:x1873345652869632:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 2313us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.474678:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17836 00000100:00100000:0.0:1786562568.477199:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869888 00000100:00100000:0.0:1786562568.477223:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869888 00000100:00100000:0.0:1786562568.477315:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6292 00000100:00100000:0.0:1786562568.477328:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a695a0-b685-4180-8888-8ba29614d6e8+6:64813:x1873345652869888:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1786562568.480136:0:33116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000100:00100000:1.0:1786562568.482397:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.487708:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652869760 00000100:00100000:0.0:1786562568.487722:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a695a0-b685-4180-8888-8ba29614d6e8+6:64813:x1873345652869888:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 10386us (16324us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562568.487727:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652869760 00000100:00100000:0.0:1786562568.487737:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6292 00000100:00100000:3.0:1786562568.487778:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17837 00000100:00100000:3.0:1786562568.487786:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2347:x1873345652869760:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786562568.487826:0:29966:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 16a695a0-b685-4180-8888-8ba29614d6e8@192.168.204.29@tcp t0 exp 0000000000000000 cur 1000 last 0 00000020:00000080:3.0:1786562568.487883:0:29966:0:(genops.c:1406:class_connect()) connect: client 16a695a0-b685-4180-8888-8ba29614d6e8, cookie 0x5c655bf66689f70e 00002000:00100000:3.0:1786562568.487898:0:29966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 16a695a0-b685-4180-8888-8ba29614d6e8/ffff90e88bfb4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786562568.487929:0:29966:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786562568.488093:0:29966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786562568.488137:0:29966:0:(import.c:65:import_set_state_nolock()) ffff90e88bfb0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786562568.488454:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16a695a0-b685-4180-8888-8ba29614d6e8+6:2347:x1873345652869760:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 666us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562568.488463:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17837 00000100:00100000:2.0:1786562568.847062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.847704:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870016 00000100:00100000:0.0:1786562568.847720:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870016 00000100:00100000:0.0:1786562568.847815:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17140 00000100:00100000:0.0:1786562568.847828:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+501:64841:x1873345652870016:12345-192.168.204.29@tcp:41:lfs.0 00000004:00000024:0.0:1786562568.847890:0:34450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2260205568 avail 2258108416 00000100:00100000:0.0:1786562568.848133:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+501:64841:x1873345652870016:12345-192.168.204.29@tcp:41:lfs.0 Request processed in 306us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.848143:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17140 00000100:00100000:3.0:1786562568.851208:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.851376:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870144 00000100:00100000:0.0:1786562568.851389:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870144 00000100:00100000:0.0:1786562568.851525:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 343 00000100:00100000:0.0:1786562568.851539:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cae43410-29f4-4da8-9608-d4626744ead5+19:64841:x1873345652870144:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:0.0:1786562568.851576:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 512950272 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1786562568.851702:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cae43410-29f4-4da8-9608-d4626744ead5+19:64841:x1873345652870144:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 167us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.851711:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 343 00000100:00100000:1.0:1786562568.854304:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.854422:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870272 00000100:00100000:2.0:1786562568.854436:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870272 00000100:00100000:2.0:1786562568.854519:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 344 00000100:00100000:2.0:1786562568.854533:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cae43410-29f4-4da8-9608-d4626744ead5+30:64841:x1873345652870272:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:2.0:1786562568.854574:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 352911360 pending 0 free 3829399552 avail 3827302400 00000100:00100000:2.0:1786562568.854683:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cae43410-29f4-4da8-9608-d4626744ead5+30:64841:x1873345652870272:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.854691:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 344 00000100:00100000:1.0:1786562568.859461:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.859566:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870400 00000100:00100000:3.0:1786562568.859579:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870400 00000100:00100000:3.0:1786562568.859676:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17141 00000100:00100000:3.0:1786562568.859690:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:16a695a0-b685-4180-8888-8ba29614d6e8+6:64841:x1873345652870400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562568.859720:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562568.859750:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfbf expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.859854:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.859873:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.859891:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562568.860268:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1786562568.860274:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 36 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562568.860354:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.860385:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.860403:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 7 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.860413:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:3.0:1786562568.860416:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562568.860421:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca800, rc 0) 00000100:00100000:3.0:1786562568.860611:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:16a695a0-b685-4180-8888-8ba29614d6e8+7:64841:x1873345652870400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 924us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562568.860620:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17141 00000100:00100000:0.0:1786562568.865970:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.866153:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870528 00000100:00100000:3.0:1786562568.866166:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870528 00000100:00100000:3.0:1786562568.866294:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 345 00000100:00100000:3.0:1786562568.866306:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a695a0-b685-4180-8888-8ba29614d6e8+6:64841:x1873345652870528:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:3.0:1786562568.866342:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 512950272 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1786562568.866437:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a695a0-b685-4180-8888-8ba29614d6e8+6:64841:x1873345652870528:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 133us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562568.866446:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 345 00000100:00080000:0.0:1786562568.869154:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562568.869444:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.869540:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870656 00000100:00100000:0.0:1786562568.869552:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870656 00000100:00100000:0.0:1786562568.869716:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 346 00000100:00100000:0.0:1786562568.869728:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a695a0-b685-4180-8888-8ba29614d6e8+6:64841:x1873345652870656:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:0.0:1786562568.869765:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 352911360 pending 0 free 3829399552 avail 3827302400 00000100:00100000:0.0:1786562568.869869:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a695a0-b685-4180-8888-8ba29614d6e8+6:64841:x1873345652870656:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 143us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.869879:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 346 00000100:00080000:3.0:1786562568.870645:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562568.892233:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.892387:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652870912 00000100:00100000:2.0:1786562568.892400:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652870912 00000100:00100000:2.0:1786562568.892525:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17142 00000100:00100000:2.0:1786562568.892538:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+501:64842:x1873345652870912:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562568.892568:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562568.892572:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562568.892611:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f6ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf4f expref: 501 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.892649:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562568.892656:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562568.892690:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f723 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfc6 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.893201:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.893219:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 6 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.893230:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.893273:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 6 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.893290:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 6 pid: 36756 timeout: 1101 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562568.893306:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654895744:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562568.893425:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562568.896330:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654895744:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562568.896371:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562568.898694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562568.898791:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652871040 00000100:00100000:2.0:1786562568.898803:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652871040 00010000:00010000:2.0:1786562568.898865:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 7 pid: 36756 timeout: 1101 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562568.898929:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8736 00000100:00100000:2.0:1786562568.898940:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652871040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562568.898961:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562568.898969:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 7 pid: 36756 timeout: 1101 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.898983:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 7 pid: 36756 timeout: 1101 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.899031:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfbf expref: 7 pid: 36756 timeout: 1101 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.899052:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562568.899058:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.899068:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.899077:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.899107:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562568.899165:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652871040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 226us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562568.899172:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8736 00010000:00010000:3.0:1786562568.899383:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.899393:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.899422:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.899434:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.899442:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786562568.900498:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x735:0x0], index 0: 0 00010000:00010000:3.0:1786562568.902323:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f738 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902349:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f738 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902362:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f738 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902436:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902443:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902455:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902462:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562568.902468:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902476:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902493:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:3.0:1786562568.902496:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562568.902501:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562568.902507:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689f72a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562568.902525:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edb8f51e reply state 000000004a2dd3bf transno 8589950685 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562568.902535:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786562568.902740:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415600/0x5c655bf66689f723 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfc6 expref: 503 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.902777:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f738 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfc6 expref: 502 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.902797:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e99172e600) 00010000:00010000:2.0:1786562568.902801:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562568.902804:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca600, rc 0) 00000100:00100000:2.0:1786562568.902918:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+503:64842:x1873345652870912:12345-192.168.204.29@tcp:101:dd.0 Request processed in 10381us (10700us total) trans 8589950685 rc 0/0 00000100:00100000:2.0:1786562568.902928:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17142 00010000:00010000:2.0:1786562568.905539:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.905564:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.905573:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.905581:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562568.905587:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.905596:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.905618:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e99172e100) 00010000:00010000:2.0:1786562568.905622:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562568.905638:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562568.905646:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689f731 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562568.933241:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562568.933582:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652871168 00000100:00100000:0.0:1786562568.933595:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652871168 00000100:00100000:0.0:1786562568.933682:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17838 00000100:00100000:0.0:1786562568.933696:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:64842:x1873345652871168:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562568.933724:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562568.933752:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f746 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfcd expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562568.933788:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562568.933832:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=1001s v=(0 0) 00010000:00010000:0.0:1786562568.933838:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562568.933849:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfcd expref: 20 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562568.933871:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfcd expref: 20 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562568.933887:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268000, rc 0) 00000100:00100000:0.0:1786562568.934127:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+20:64842:x1873345652871168:12345-192.168.204.29@tcp:101:dd.0 Request processed in 433us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562568.934136:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17838 00000100:00100000:1.0:1786562568.956449:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562568.956550:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652871296 00000100:00100000:3.0:1786562568.956564:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652871296 00002000:00100000:3.0:1786562568.956643:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x735:0x0] (0->1048575) req@ffff90e886c1dc00 x1873345652871296/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:39/0 lens 488/0 e 0 to 0 dl 1786562579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562568.956655:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e886c1dc00 with x1873345652871296 ext(0->1048575) 00002000:00010000:3.0:1786562568.956662:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e886c1dc00 00000100:00100000:3.0:1786562568.956702:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11623 00000100:00100000:3.0:1786562568.956714:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652871296:12345-192.168.204.29@tcp:4:dd.0 00000100:00100000:0.0:1786562568.995660:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345652871296:12345-192.168.204.29@tcp:4:dd.0 Request processed in 38930us (39212us total) trans 21474843604 rc 0/0 00000100:00100000:0.0:1786562568.995680:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11623 00002000:00100000:0.0:1786562568.995700:0:13965:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x735:0x0] (0->1048575) req@ffff90e886c1dc00 x1873345652871296/t21474843604(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:39/0 lens 488/448 e 0 to 0 dl 1786562579 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562568.995713:0:13965:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e886c1dc00 with x1873345652871296 ext(0->1048575) 00002000:00010000:0.0:1786562568.995720:0:13965:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e886c1dc00 00010000:00010000:1.0:1786562569.001547:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562569.032773:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562569.034069:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652871424 00000100:00100000:2.0:1786562569.034088:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652871424 00002000:00100000:2.0:1786562569.034163:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x735:0x0] (1048576->2097151) req@ffff90e9bf8dd880 x1873345652871424/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:40/0 lens 488/0 e 0 to 0 dl 1786562580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786562569.034177:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dd880 with x1873345652871424 ext(1048576->2097151) 00002000:00010000:2.0:1786562569.034183:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bf8dd880 00000100:00100000:2.0:1786562569.034225:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11624 00000100:00100000:2.0:1786562569.034235:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652871424:12345-192.168.204.29@tcp:4:dd.0 00000100:00100000:1.0:1786562569.034621:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562569.037112:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652871680 00000100:00100000:3.0:1786562569.037134:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652871680 00000100:00100000:3.0:1786562569.037215:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6293 00000100:00100000:3.0:1786562569.037227:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+502:64842:x1873345652871680:12345-192.168.204.29@tcp:35:dd.0 00000100:00100000:3.0:1786562569.037722:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+503:64842:x1873345652871680:12345-192.168.204.29@tcp:35:dd.0 Request processed in 495us (3100us total) trans 8589950686 rc 0/0 00000100:00100000:3.0:1786562569.037731:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6293 00000100:00100000:3.0:1786562569.047250:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cae43410-29f4-4da8-9608-d4626744ead5+24:2351:x1873345652871424:12345-192.168.204.29@tcp:4:dd.0 Request processed in 12999us (15582us total) trans 21474843605 rc 0/0 00000100:00100000:3.0:1786562569.047267:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11624 00002000:00100000:3.0:1786562569.047283:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x735:0x0] (1048576->2097151) req@ffff90e9bf8dd880 x1873345652871424/t21474843605(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:40/0 lens 488/448 e 0 to 0 dl 1786562580 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786562569.047294:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bf8dd880 with x1873345652871424 ext(1048576->2097151) 00002000:00010000:3.0:1786562569.047302:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9bf8dd880 00000100:00100000:2.0:1786562569.102354:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562569.102478:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652871808 00000100:00100000:0.0:1786562569.102490:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652871808 00000100:00100000:0.0:1786562569.102559:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17143 00000100:00100000:0.0:1786562569.102571:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+503:64843:x1873345652871808:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562569.102605:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562569.102648:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689f74d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfd4 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.102742:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f754 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.102758:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.102772:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562569.102859:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562569.102865:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 37 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562569.102895:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.102925:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689f74d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfd4 expref: 505 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.102953:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f754 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfd4 expref: 504 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.102963:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:0.0:1786562569.102967:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562569.102971:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268a00, rc 0) 00000100:00100000:0.0:1786562569.103094:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+504:64843:x1873345652871808:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 525us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562569.103103:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17143 00000100:00100000:1.0:1786562569.114131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562569.115221:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652872064 00000100:00100000:0.0:1786562569.115239:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652872064 00000100:00100000:0.0:1786562569.115390:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17144 00000100:00100000:0.0:1786562569.115404:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+504:64843:x1873345652872064:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562569.115432:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562569.115458:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689f75b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfdb expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.115593:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f762 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.115611:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f762 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.115637:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f762 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562569.115653:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00010000:00010000:0.0:1786562569.115813:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689f75b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfdb expref: 507 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.115841:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f762 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfdb expref: 506 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562569.115852:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e99172e600) 00010000:00010000:0.0:1786562569.115855:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786562569.115859:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269a00, rc 0) 00000100:00100000:0.0:1786562569.115952:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+506:64843:x1873345652872064:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 551us (1836us total) trans 8589950687 rc 0/0 00000100:00100000:0.0:1786562569.115960:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17144 00000001:00080000:3.0:1786562569.146377:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843604 is committed 00000001:00100000:3.0:1786562569.146404:0:25627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16a695a0-b685-4180-8888-8ba29614d6e8 00000001:00080000:3.0:1786562569.146411:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843603 is committed 00000100:00100000:0.0:1786562569.148313:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562569.148390:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652872320 00000100:00100000:2.0:1786562569.148402:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652872320 00000100:00100000:2.0:1786562569.148469:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6294 00000100:00100000:2.0:1786562569.148480:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+506:56884:x1873345652872320:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786562569.149114:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+507:56884:x1873345652872320:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 632us (808us total) trans 8589950688 rc 0/0 00000100:00100000:2.0:1786562569.149125:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6294 00000100:00100000:1.0:1786562569.170688:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562569.180888:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652872576 00000100:00100000:0.0:1786562569.180914:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652872576 00000100:00100000:1.0:1786562569.181617:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6295 00000100:00100000:1.0:1786562569.181641:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+507:56884:x1873345652872576:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1786562569.182060:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+508:56884:x1873345652872576:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 420us (11389us total) trans 8589950689 rc 0/0 00000100:00100000:1.0:1786562569.182070:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6295 00000100:00100000:1.0:1786562569.204744:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562569.204861:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652872704 00000100:00100000:2.0:1786562569.204875:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652872704 00000100:00100000:2.0:1786562569.204959:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 982 00000100:00100000:2.0:1786562569.204970:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+508:56884:x1873345652872704:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562569.204997:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 409 locks, starting at 0 00010000:00010000:2.0:1786562569.205240:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556000/0x5c655bf66683df0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc003 expref: 508 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.205274:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x60:0x0].0x0 (ffff90e994289a00) 00010000:00010000:2.0:1786562569.205297:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f762 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfdb expref: 507 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.205309:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e99172e600) 00010000:00010000:2.0:1786562569.205330:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f754 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfd4 expref: 506 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.205340:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:2.0:1786562569.205360:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689f738 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfc6 expref: 505 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.205371:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e99172e600) 00010000:00010000:2.0:1786562569.205383:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1200/0x5c655bf6668969f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf8765 expref: 504 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.205393:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d0:0x0].0x0 (ffff90e99fd8f400) 00010000:00010000:2.0:1786562569.206907:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365600/0x5c655bf66688c274 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x493:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4b67 expref: 503 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.206935:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x493:0x0].0x0 (ffff90e991ebbb00) 00010000:00010000:2.0:1786562569.206979:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22a00/0x5c655bf66688c251 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x492:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4b60 expref: 502 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.206991:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x492:0x0].0x0 (ffff90e9910fb100) 00010000:00010000:2.0:1786562569.207031:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0200/0x5c655bf66688c171 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x48f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4b13 expref: 501 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207043:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x48f:0x0].0x0 (ffff90e994289700) 00010000:00010000:2.0:1786562569.207063:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f22800/0x5c655bf66688bf4f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x488:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4a80 expref: 500 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207076:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988f23000/0x5c655bf66688be30 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x488:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4a2c expref: 499 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207087:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x488:0x0].0x0 (ffff90e994850900) 00010000:00010000:2.0:1786562569.207104:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66688ba7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x487:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf48f1 expref: 498 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207115:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x487:0x0].0x0 (ffff90e9910fbf00) 00010000:00010000:2.0:1786562569.207128:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf66688b8e9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x482:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf487a expref: 497 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207150:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64000/0x5c655bf66688b7a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x482:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4818 expref: 496 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207162:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x482:0x0].0x0 (ffff90e994850800) 00010000:00010000:2.0:1786562569.207174:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8ca400/0x5c655bf66688b3d3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x481:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf46d6 expref: 495 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207188:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x481:0x0].0x0 (ffff90e9bfcdad00) 00010000:00010000:2.0:1786562569.207217:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ca00/0x5c655bf66688b08b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x47f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf45d3 expref: 494 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207226:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x47f:0x0].0x0 (ffff90e99fd8ff00) 00010000:00010000:2.0:1786562569.207236:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf66688ace8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x478:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf44b4 expref: 493 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207247:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364600/0x5c655bf66688abc9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x478:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4460 expref: 492 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207258:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x478:0x0].0x0 (ffff90e9b63c3200) 00010000:00010000:2.0:1786562569.207267:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf66688a811 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x477:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4325 expref: 491 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207275:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x477:0x0].0x0 (ffff90e9b63c3900) 00010000:00010000:2.0:1786562569.207283:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1200/0x5c655bf66688a64a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x476:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf428b expref: 490 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207291:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x476:0x0].0x0 (ffff90e9bfcda500) 00010000:00010000:2.0:1786562569.207301:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0800/0x5c655bf66688a475 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x475:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf41ff expref: 489 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207310:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x475:0x0].0x0 (ffff90e99fd8f900) 00010000:00010000:2.0:1786562569.207320:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80e00/0x5c655bf66688a2ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x470:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf417a expref: 488 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207333:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1000/0x5c655bf66688a1b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x470:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf4126 expref: 487 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207341:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x470:0x0].0x0 (ffff90e9bfcda100) 00010000:00010000:2.0:1786562569.207352:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365e00/0x5c655bf666889e01 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x46f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3ff2 expref: 486 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207360:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x46f:0x0].0x0 (ffff90e999aabe00) 00010000:00010000:2.0:1786562569.207371:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f6c00/0x5c655bf666889c41 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x46a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3f66 expref: 485 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207384:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81a00/0x5c655bf666889b45 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x46a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3f19 expref: 484 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207391:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x46a:0x0].0x0 (ffff90e9a07c8f00) 00010000:00010000:2.0:1786562569.207401:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81e00/0x5c655bf66688975c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x465:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3dd7 expref: 483 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207411:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364000/0x5c655bf666889652 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x465:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3d8a expref: 482 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207419:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x465:0x0].0x0 (ffff90e9a07c8800) 00010000:00010000:2.0:1786562569.207430:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb364800/0x5c655bf66688932d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3c80 expref: 481 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207443:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x464:0x0].0x0 (ffff90e999972300) 00010000:00010000:2.0:1786562569.207453:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1a00/0x5c655bf666889143 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x463:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3be6 expref: 480 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207461:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x463:0x0].0x0 (ffff90e999aaba00) 00010000:00010000:2.0:1786562569.207471:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb365400/0x5c655bf666888fa6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x462:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3b5a expref: 479 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207479:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x462:0x0].0x0 (ffff90e9a07c8100) 00010000:00010000:2.0:1786562569.207488:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa600/0x5c655bf666888c26 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x45f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3a3b expref: 478 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207497:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45f:0x0].0x0 (ffff90e99fd8f100) 00010000:00010000:2.0:1786562569.207507:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0600/0x5c655bf666888a6d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x45a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf39bd expref: 477 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207518:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1e00/0x5c655bf666888963 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x45a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3969 expref: 476 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207526:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x45a:0x0].0x0 (ffff90e9a07c8500) 00010000:00010000:2.0:1786562569.207536:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1800/0x5c655bf66688857a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x459:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3827 expref: 475 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207543:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x459:0x0].0x0 (ffff90e9855f9c00) 00010000:00010000:2.0:1786562569.207552:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1400/0x5c655bf6668883b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x458:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf378d expref: 474 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207560:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x458:0x0].0x0 (ffff90e9bfcdaa00) 00010000:00010000:2.0:1786562569.207570:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf6668881c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x456:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf36fa expref: 473 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207577:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x456:0x0].0x0 (ffff90e9bfcda900) 00010000:00010000:2.0:1786562569.207587:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc1600/0x5c655bf666888064 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x451:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3691 expref: 472 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207600:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf666887f0d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x451:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3628 expref: 471 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207609:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x451:0x0].0x0 (ffff90e9a07c8a00) 00010000:00010000:2.0:1786562569.207631:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9aefc0a00/0x5c655bf666887b2b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x44c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf34df expref: 470 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207645:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1a00/0x5c655bf666887a21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x44c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3492 expref: 469 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207653:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x44c:0x0].0x0 (ffff90e994ab8200) 00010000:00010000:2.0:1786562569.207665:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068d800/0x5c655bf666887703 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x44b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3381 expref: 468 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.207672:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x44b:0x0].0x0 (ffff90e994ab8d00) 00010000:00010000:2.0:1786562569.207699:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf666887398 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x445:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf3277 expref: 467 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216580:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0de00/0x5c655bf666887279 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x445:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf322a expref: 466 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216636:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x445:0x0].0x0 (ffff90e9bfcda800) 00010000:00010000:2.0:1786562569.216682:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6de00/0x5c655bf666886ec1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x444:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf30f6 expref: 465 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216705:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x444:0x0].0x0 (ffff90e9af537d00) 00010000:00010000:2.0:1786562569.216720:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf666886aed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x441:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2fc2 expref: 464 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216729:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x441:0x0].0x0 (ffff90e99fd8f000) 00010000:00010000:2.0:1786562569.216742:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0d400/0x5c655bf66688693b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x440:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2f28 expref: 463 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216751:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x440:0x0].0x0 (ffff90e9bc2e5700) 00010000:00010000:2.0:1786562569.216762:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf666886774 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x43f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2e8e expref: 462 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216772:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43f:0x0].0x0 (ffff90e983adf600) 00010000:00010000:2.0:1786562569.216784:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556e00/0x5c655bf66688657c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x43e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2df4 expref: 461 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216793:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43e:0x0].0x0 (ffff90e99fd8fd00) 00010000:00010000:2.0:1786562569.216805:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf6668861af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x43b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2cce expref: 460 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216818:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x43b:0x0].0x0 (ffff90e9af537100) 00010000:00010000:2.0:1786562569.216830:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c0e00/0x5c655bf666886027 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x436:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2c50 expref: 459 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216847:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d200/0x5c655bf666885ed0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x436:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2be7 expref: 458 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216856:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x436:0x0].0x0 (ffff90e9b63c3a00) 00010000:00010000:2.0:1786562569.216874:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81c00/0x5c655bf666885b1f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x435:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2aac expref: 457 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216890:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x435:0x0].0x0 (ffff90e9bc2e5200) 00010000:00010000:2.0:1786562569.216907:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf666885943 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x434:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2a0b expref: 456 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216916:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x434:0x0].0x0 (ffff90e9a07c8d00) 00010000:00010000:2.0:1786562569.216942:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf66688537e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x431:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2852 expref: 455 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216951:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x431:0x0].0x0 (ffff90e9a07c8300) 00010000:00010000:2.0:1786562569.216960:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668851b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x430:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf27b8 expref: 454 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.216968:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x430:0x0].0x0 (ffff90e9bc2e5900) 00010000:00010000:2.0:1786562569.217050:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80000/0x5c655bf666884dff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x42e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf26a0 expref: 453 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217061:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x42e:0x0].0x0 (ffff90e99fd8fe00) 00010000:00010000:2.0:1786562569.217071:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c600/0x5c655bf666884c46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x42d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2606 expref: 452 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217079:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x42d:0x0].0x0 (ffff90e9a07c8900) 00010000:00010000:2.0:1786562569.217089:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e800/0x5c655bf6668846f8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf245b expref: 451 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217109:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x429:0x0].0x0 (ffff90e9a07c8600) 00010000:00010000:2.0:1786562569.217133:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81200/0x5c655bf66688469d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x426:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2446 expref: 450 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217146:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c216fe00/0x5c655bf6668845ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x426:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2407 expref: 449 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217157:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x426:0x0].0x0 (ffff90e9a07c8400) 00010000:00010000:2.0:1786562569.217167:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf66688423d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x421:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf22e1 expref: 448 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217180:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98800/0x5c655bf666884110 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x421:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf228d expref: 447 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217188:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x421:0x0].0x0 (ffff90e9bc2e5500) 00010000:00010000:2.0:1786562569.217213:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80600/0x5c655bf666883bf3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x41f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf20db expref: 446 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217232:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41f:0x0].0x0 (ffff90e9b63c3e00) 00010000:00010000:2.0:1786562569.217243:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068ce00/0x5c655bf666883a48 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x41e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf2048 expref: 445 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217252:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41e:0x0].0x0 (ffff90e9bc2e5300) 00010000:00010000:2.0:1786562569.217261:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668838b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x41d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1fc3 expref: 444 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217269:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x41d:0x0].0x0 (ffff90e9a07c8b00) 00010000:00010000:2.0:1786562569.217280:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80a00/0x5c655bf666883697 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x418:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1f30 expref: 443 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217292:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6d000/0x5c655bf666883586 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x418:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1ed5 expref: 442 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217301:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x418:0x0].0x0 (ffff90e981374c00) 00010000:00010000:2.0:1786562569.217311:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9600/0x5c655bf666883069 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x415:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1d38 expref: 441 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217321:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x415:0x0].0x0 (ffff90e99fd8f700) 00010000:00010000:2.0:1786562569.217331:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80400/0x5c655bf666882eb0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x414:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1ca5 expref: 440 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217339:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x414:0x0].0x0 (ffff90e9bc2e5d00) 00010000:00010000:2.0:1786562569.217351:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf666882d05 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1c27 expref: 439 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217364:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf666882c17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1be1 expref: 438 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217375:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40f:0x0].0x0 (ffff90e9bc2e5000) 00010000:00010000:2.0:1786562569.217386:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92cc00/0x5c655bf6668826ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1a21 expref: 437 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217394:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40d:0x0].0x0 (ffff90e99fd8f600) 00010000:00010000:2.0:1786562569.217406:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668824bc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x408:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf198e expref: 436 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217418:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7400/0x5c655bf6668823a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x408:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf193a expref: 435 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217426:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x408:0x0].0x0 (ffff90e9bc2e5a00) 00010000:00010000:2.0:1786562569.217436:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261da00/0x5c655bf666881fc9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x403:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf17ff expref: 434 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217448:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e6000/0x5c655bf666881ea3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x403:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf17a4 expref: 433 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217456:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x403:0x0].0x0 (ffff90e9910fb700) 00010000:00010000:2.0:1786562569.217465:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fb400/0x5c655bf666881af9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1677 expref: 432 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217481:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81000/0x5c655bf666881a20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3fe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1638 expref: 431 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217491:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3fe:0x0].0x0 (ffff90e9910fb900) 00010000:00010000:2.0:1786562569.217501:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e000/0x5c655bf6668816ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf1519 expref: 430 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217510:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3fd:0x0].0x0 (ffff90e981374100) 00010000:00010000:2.0:1786562569.217520:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414a00/0x5c655bf6668814fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf147f expref: 429 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217530:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3fc:0x0].0x0 (ffff90e99fd8f800) 00010000:00010000:2.0:1786562569.217544:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668812f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf13e5 expref: 428 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217557:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5aa00/0x5c655bf66688119f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3f7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf137c expref: 427 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217565:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f7:0x0].0x0 (ffff90e9910fbb00) 00010000:00010000:2.0:1786562569.217575:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c0400/0x5c655bf666880c58 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf11ca expref: 426 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217584:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f5:0x0].0x0 (ffff90e9b63c3f00) 00010000:00010000:2.0:1786562569.217596:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81600/0x5c655bf666880ac2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf113e expref: 425 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217610:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3f4:0x0].0x0 (ffff90e9910fba00) 00010000:00010000:2.0:1786562569.217630:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81d600/0x5c655bf66688071f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf102d expref: 424 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217645:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261dc00/0x5c655bf666880631 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3ee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0fe7 expref: 423 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217653:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3ee:0x0].0x0 (ffff90e9910fb500) 00010000:00010000:2.0:1786562569.217665:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7e00/0x5c655bf666880217 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0ea5 expref: 422 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217676:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c0000/0x5c655bf6668800dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3e9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0e3c expref: 421 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217684:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e9:0x0].0x0 (ffff90e9b63c3300) 00010000:00010000:2.0:1786562569.217694:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92dc00/0x5c655bf66687fd8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0d24 expref: 420 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217703:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e7:0x0].0x0 (ffff90e9910fbc00) 00010000:00010000:2.0:1786562569.217712:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548800/0x5c655bf66687fbf0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3e2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0c9f expref: 419 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217725:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf66687fad1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3e2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0c44 expref: 418 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217738:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3e2:0x0].0x0 (ffff90e9b63c3600) 00010000:00010000:2.0:1786562569.217747:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1e00/0x5c655bf66687f513 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0a7d expref: 417 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217758:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1400/0x5c655bf66687f3d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0a14 expref: 416 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217766:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3dc:0x0].0x0 (ffff90e9b63c3b00) 00010000:00010000:2.0:1786562569.217775:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6200/0x5c655bf66687f0b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf090a expref: 415 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217782:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3db:0x0].0x0 (ffff90e9889f4900) 00010000:00010000:2.0:1786562569.217791:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c000/0x5c655bf66687eee5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf087e expref: 414 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217799:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d9:0x0].0x0 (ffff90e9910fb400) 00010000:00010000:2.0:1786562569.217808:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c200/0x5c655bf66687ed5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf080e expref: 413 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217820:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7200/0x5c655bf66687ec4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3d4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf07ba expref: 412 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217828:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3d4:0x0].0x0 (ffff90e9b63c3c00) 00010000:00010000:2.0:1786562569.217837:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf66687e50d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf056e expref: 411 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217853:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf66687e37e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3cd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf04fe expref: 410 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217862:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3cd:0x0].0x0 (ffff90e9910fbe00) 00010000:00010000:2.0:1786562569.217871:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c0c00/0x5c655bf66687dfb1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf03bc expref: 409 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217878:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3cc:0x0].0x0 (ffff90e99fd8fa00) 00010000:00010000:2.0:1786562569.217887:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176e000/0x5c655bf66687dde3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0337 expref: 408 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217898:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66687dce7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3c7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf02ea expref: 407 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217907:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3c7:0x0].0x0 (ffff90e9b63c3700) 00010000:00010000:2.0:1786562569.217915:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92ce00/0x5c655bf66687d8f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf01a1 expref: 406 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217926:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d400/0x5c655bf66687d7ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3c2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf0154 expref: 405 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217934:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3c2:0x0].0x0 (ffff90e9bc2e5800) 00010000:00010000:2.0:1786562569.217944:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd80c00/0x5c655bf66687d236 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceff86 expref: 404 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217962:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99cd81800/0x5c655bf66687d148 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3bc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceff39 expref: 403 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217970:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3bc:0x0].0x0 (ffff90e98559a600) 00010000:00010000:2.0:1786562569.217979:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94200/0x5c655bf66687cbd7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cefd79 expref: 402 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.217987:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b9:0x0].0x0 (ffff90e9bc2e5400) 00010000:00010000:2.0:1786562569.217996:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c400/0x5c655bf66687ca25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cefced expref: 401 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218040:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf66687c8ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3b4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cefc99 expref: 400 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218050:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b4:0x0].0x0 (ffff90e9bc2e5c00) 00010000:00010000:2.0:1786562569.218060:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c0800/0x5c655bf66687c4fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cefb42 expref: 399 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218069:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b3:0x0].0x0 (ffff90e9910fb000) 00010000:00010000:2.0:1786562569.218095:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66687bfa5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef9a5 expref: 398 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218104:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3b0:0x0].0x0 (ffff90e9b63c3100) 00010000:00010000:2.0:1786562569.218114:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415800/0x5c655bf66687be0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef920 expref: 397 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218128:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3af:0x0].0x0 (ffff90e9910fb200) 00010000:00010000:2.0:1786562569.218138:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf66687bc02 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef87f expref: 396 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218147:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3ae:0x0].0x0 (ffff90e9855f9700) 00010000:00010000:2.0:1786562569.218156:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1e00/0x5c655bf66687b644 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef6c6 expref: 395 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218165:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3aa:0x0].0x0 (ffff90e9b63c3500) 00010000:00010000:2.0:1786562569.218175:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d800/0x5c655bf66687b4f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef64f expref: 394 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218185:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a9:0x0].0x0 (ffff90e992640a00) 00010000:00010000:2.0:1786562569.218194:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7600/0x5c655bf66687b2fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef5b5 expref: 393 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218203:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a7:0x0].0x0 (ffff90e9855f9b00) 00010000:00010000:2.0:1786562569.218212:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6e00/0x5c655bf66687b0cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef514 expref: 392 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218224:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7000/0x5c655bf66687afde lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3a2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef4c0 expref: 391 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218233:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3a2:0x0].0x0 (ffff90e992640900) 00010000:00010000:2.0:1786562569.218242:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6a00/0x5c655bf66687aa90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x39c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef315 expref: 390 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218254:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6600/0x5c655bf66687a98d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x39c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef2c8 expref: 389 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218263:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x39c:0x0].0x0 (ffff90e981374400) 00010000:00010000:2.0:1786562569.218272:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5be00/0x5c655bf66687a37b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x396:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef0d7 expref: 388 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218283:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c0600/0x5c655bf66687a255 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x396:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cef07c expref: 387 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218290:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x396:0x0].0x0 (ffff90e9b63c3800) 00010000:00010000:2.0:1786562569.218299:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1000/0x5c655bf666879ef1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x395:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceef56 expref: 386 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218307:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x395:0x0].0x0 (ffff90e9a248ba00) 00010000:00010000:2.0:1786562569.218316:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9864c1400/0x5c655bf666879d5b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x394:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceeeca expref: 385 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218324:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x394:0x0].0x0 (ffff90e983a70b00) 00010000:00010000:2.0:1786562569.218333:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6800/0x5c655bf66687994f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x38e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceed96 expref: 384 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218345:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f6c00/0x5c655bf666879814 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x38e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceed2d expref: 383 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218358:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38e:0x0].0x0 (ffff90e991ebb000) 00010000:00010000:2.0:1786562569.218376:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668794be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x389:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceec23 expref: 382 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218388:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668793d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x389:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceebe4 expref: 381 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218396:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x389:0x0].0x0 (ffff90e9b63c3d00) 00010000:00010000:2.0:1786562569.218409:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf666878fee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x387:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceea8d expref: 380 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218419:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x387:0x0].0x0 (ffff90e99fd8fb00) 00010000:00010000:2.0:1786562569.218428:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa200/0x5c655bf666878e43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceea08 expref: 379 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218437:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385:0x0].0x0 (ffff90e99fd8fc00) 00010000:00010000:2.0:1786562569.218447:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3f7800/0x5c655bf666878cb4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x380:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee98a expref: 378 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218459:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92d000/0x5c655bf666878b64 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x380:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee928 expref: 377 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218467:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380:0x0].0x0 (ffff90e999af3a00) 00010000:00010000:2.0:1786562569.218478:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92ca00/0x5c655bf666878598 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee74c expref: 376 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218490:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37e:0x0].0x0 (ffff90e98559a300) 00010000:00010000:2.0:1786562569.218501:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bf92c800/0x5c655bf6668783c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x379:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee6b9 expref: 375 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218513:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf6668782ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x379:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee665 expref: 374 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218522:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x379:0x0].0x0 (ffff90e981374e00) 00010000:00010000:2.0:1786562569.218533:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e6a00/0x5c655bf666877d02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x377:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee49e expref: 373 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218541:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x377:0x0].0x0 (ffff90e9907f2b00) 00010000:00010000:2.0:1786562569.218549:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557600/0x5c655bf666877b7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x376:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee412 expref: 372 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218558:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x376:0x0].0x0 (ffff90e991ebb400) 00010000:00010000:2.0:1786562569.218571:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266e00/0x5c655bf666877990 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x371:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee378 expref: 371 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218584:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0e00/0x5c655bf666877871 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x371:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee32b expref: 370 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218593:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x371:0x0].0x0 (ffff90e9af537900) 00010000:00010000:2.0:1786562569.218603:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267800/0x5c655bf6668774b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x370:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee1e9 expref: 369 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218617:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x370:0x0].0x0 (ffff90e981374a00) 00010000:00010000:2.0:1786562569.218639:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176ec00/0x5c655bf6668772ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee156 expref: 368 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218652:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860ae200/0x5c655bf66687718d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x36b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cee0fb expref: 367 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218660:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x36b:0x0].0x0 (ffff90e994850500) 00010000:00010000:2.0:1786562569.218670:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38f800/0x5c655bf666876c0e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x369:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cedf42 expref: 366 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218679:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x369:0x0].0x0 (ffff90e994850f00) 00010000:00010000:2.0:1786562569.218687:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556c00/0x5c655bf666876a32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cedea1 expref: 365 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218696:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x368:0x0].0x0 (ffff90e981374f00) 00010000:00010000:2.0:1786562569.218705:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa400/0x5c655bf6668766b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x361:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cedd89 expref: 364 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218718:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9e00/0x5c655bf66687659a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x361:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cedd35 expref: 363 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218727:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x361:0x0].0x0 (ffff90e9855f9400) 00010000:00010000:2.0:1786562569.218736:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf66687605a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cedb75 expref: 362 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218750:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35e:0x0].0x0 (ffff90e994850a00) 00010000:00010000:2.0:1786562569.218759:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf666875e69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x35d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cedae2 expref: 361 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218768:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35d:0x0].0x0 (ffff90e982cfcb00) 00010000:00010000:2.0:1786562569.218777:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0a00/0x5c655bf666875a95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced9bc expref: 360 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218785:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x35b:0x0].0x0 (ffff90e9907f2100) 00010000:00010000:2.0:1786562569.218794:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f400/0x5c655bf666875731 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x355:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced8a4 expref: 359 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218804:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8ca000/0x5c655bf666875612 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x355:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced850 expref: 358 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218812:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x355:0x0].0x0 (ffff90e9af72a500) 00010000:00010000:2.0:1786562569.218822:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65400/0x5c655bf6668752d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced746 expref: 357 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218833:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0d800/0x5c655bf6668751b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x350:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced6f2 expref: 356 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218843:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x350:0x0].0x0 (ffff90e9c21d1c00) 00010000:00010000:2.0:1786562569.218852:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38fa00/0x5c655bf666874e01 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced5be expref: 355 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218868:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf666874d21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced57f expref: 354 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218876:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34b:0x0].0x0 (ffff90e9924c5300) 00010000:00010000:2.0:1786562569.218884:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860af200/0x5c655bf666874406 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x346:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced2a0 expref: 353 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218893:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x346:0x0].0x0 (ffff90e9af72a200) 00010000:00010000:2.0:1786562569.218901:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1200/0x5c655bf666873fd7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x342:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced157 expref: 352 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218910:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x342:0x0].0x0 (ffff90e9855f9800) 00010000:00010000:2.0:1786562569.218919:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fac00/0x5c655bf666873e79 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced0f5 expref: 351 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218931:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176e400/0x5c655bf666873cf1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x33d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ced085 expref: 350 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218938:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33d:0x0].0x0 (ffff90e99254fa00) 00010000:00010000:2.0:1786562569.218947:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e600/0x5c655bf666873573 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cece32 expref: 349 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218956:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x33a:0x0].0x0 (ffff90e981374500) 00010000:00010000:2.0:1786562569.218964:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e6e00/0x5c655bf666873382 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cecd9f expref: 348 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218981:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515c00/0x5c655bf666873294 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x334:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cecd59 expref: 347 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.218989:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x334:0x0].0x0 (ffff90e9855f9500) 00010000:00010000:2.0:1786562569.218999:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c216e800/0x5c655bf666872eab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cecc17 expref: 346 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219037:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x332:0x0].0x0 (ffff90e9889f4b00) 00010000:00010000:2.0:1786562569.219049:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176fa00/0x5c655bf666872d31 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cecba7 expref: 345 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219061:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267a00/0x5c655bf666872c51 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cecb5a expref: 344 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219072:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x32d:0x0].0x0 (ffff90e999aab400) 00010000:00010000:2.0:1786562569.219084:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822d800/0x5c655bf66687281b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x327:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceca18 expref: 343 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219098:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c600/0x5c655bf6668726fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x327:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec9c4 expref: 342 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219105:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x327:0x0].0x0 (ffff90e9855f9600) 00010000:00010000:2.0:1786562569.219113:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0cc00/0x5c655bf6668723fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x322:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec8c8 expref: 341 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219131:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176e200/0x5c655bf6668722b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x322:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec85f expref: 340 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219140:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x322:0x0].0x0 (ffff90e9889c8a00) 00010000:00010000:2.0:1786562569.219148:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf666871d78 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec6a6 expref: 339 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219156:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31f:0x0].0x0 (ffff90e9855f9100) 00010000:00010000:2.0:1786562569.219168:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668719e3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec579 expref: 338 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219177:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31d:0x0].0x0 (ffff90e9855f9d00) 00010000:00010000:2.0:1786562569.219185:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415c00/0x5c655bf66687180e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec4e6 expref: 337 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219192:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31c:0x0].0x0 (ffff90e9907f2f00) 00010000:00010000:2.0:1786562569.219202:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf666871624 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec44c expref: 336 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219210:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31b:0x0].0x0 (ffff90e9855f9900) 00010000:00010000:2.0:1786562569.219221:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64a00/0x5c655bf66687141e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x319:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec3b9 expref: 335 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219230:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x319:0x0].0x0 (ffff90e9889c8100) 00010000:00010000:2.0:1786562569.219241:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf6668713c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x316:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec3a4 expref: 334 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219254:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6dc00/0x5c655bf6668712ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x316:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec350 expref: 333 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219262:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x316:0x0].0x0 (ffff90e981374900) 00010000:00010000:2.0:1786562569.219275:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5b800/0x5c655bf666870fc5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x315:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec24d expref: 332 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219284:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x315:0x0].0x0 (ffff90e9af72a600) 00010000:00010000:2.0:1786562569.219294:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a200/0x5c655bf666870dc6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x310:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec1ba expref: 331 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219307:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf666870ced lrc: 0/0,0 mode: --/PR res: [0x200000404:0x310:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec17b expref: 330 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219331:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x310:0x0].0x0 (ffff90e9907f2000) 00010000:00010000:2.0:1786562569.219342:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cae00/0x5c655bf66687097b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cec04e expref: 329 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219350:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30f:0x0].0x0 (ffff90e9af72a000) 00010000:00010000:2.0:1786562569.219359:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557a00/0x5c655bf6668707d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebfc9 expref: 328 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.219367:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30e:0x0].0x0 (ffff90e9af72a100) 00010000:00010000:2.0:1786562569.229359:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e6200/0x5c655bf6668705d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebf2f expref: 327 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229423:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6c000/0x5c655bf6668704d5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x309:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebedb expref: 326 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229437:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x309:0x0].0x0 (ffff90e994289400) 00010000:00010000:2.0:1786562569.229459:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668700c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x304:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebd99 expref: 325 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229475:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf66686ffaa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x304:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebd30 expref: 324 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229489:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x304:0x0].0x0 (ffff90e9889f4e00) 00010000:00010000:2.0:1786562569.229504:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf66686fc31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x303:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebc18 expref: 323 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229514:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x303:0x0].0x0 (ffff90e9855f9300) 00010000:00010000:2.0:1786562569.229528:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf66686fa39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebb7e expref: 322 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229537:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x302:0x0].0x0 (ffff90e9855f9e00) 00010000:00010000:2.0:1786562569.229547:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f600/0x5c655bf66686f864 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x301:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cebaeb expref: 321 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229557:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x301:0x0].0x0 (ffff90e981374b00) 00010000:00010000:2.0:1786562569.229569:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cbc00/0x5c655bf66686f6c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x300:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceba5f expref: 320 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229580:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x300:0x0].0x0 (ffff90e994850b00) 00010000:00010000:2.0:1786562569.229615:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0200/0x5c655bf66686f4dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2fb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb9c5 expref: 319 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229641:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415200/0x5c655bf66686f3ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2fb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb97f expref: 318 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229650:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2fb:0x0].0x0 (ffff90e994850100) 00010000:00010000:2.0:1786562569.229662:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515400/0x5c655bf66686f029 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb84b expref: 317 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229674:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068ca00/0x5c655bf66686ef1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2f6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb7fe expref: 316 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229682:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f6:0x0].0x0 (ffff90e994850200) 00010000:00010000:2.0:1786562569.229705:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860afa00/0x5c655bf66686eb91 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb6d1 expref: 315 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229716:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f5:0x0].0x0 (ffff90e9855f9f00) 00010000:00010000:2.0:1786562569.229728:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e7200/0x5c655bf66686e9df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb64c expref: 314 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229740:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7a00/0x5c655bf66686e888 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2f0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb5e3 expref: 313 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229754:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2f0:0x0].0x0 (ffff90e99254f900) 00010000:00010000:2.0:1786562569.229767:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6200/0x5c655bf66686e4d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb4a8 expref: 312 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229776:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2ef:0x0].0x0 (ffff90e994850300) 00010000:00010000:2.0:1786562569.229787:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fb200/0x5c655bf66686e2ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb40e expref: 311 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229802:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ea00/0x5c655bf66686e196 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2ea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb3ba expref: 310 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229811:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2ea:0x0].0x0 (ffff90e999972500) 00010000:00010000:2.0:1786562569.229821:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fa000/0x5c655bf66686ddde lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb27f expref: 309 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229831:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e9:0x0].0x0 (ffff90e994ab8600) 00010000:00010000:2.0:1786562569.229842:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38f200/0x5c655bf66686dbf4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb1e5 expref: 308 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229855:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf66686dad5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceb191 expref: 307 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229864:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e4:0x0].0x0 (ffff90e9855f9a00) 00010000:00010000:2.0:1786562569.229876:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38f600/0x5c655bf66686d556 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceafca expref: 306 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229889:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e2:0x0].0x0 (ffff90e9907b8e00) 00010000:00010000:2.0:1786562569.229899:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266800/0x5c655bf66686d22a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceaec7 expref: 305 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229913:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf66686d0ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2db:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceae6c expref: 304 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229922:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2db:0x0].0x0 (ffff90e9af537b00) 00010000:00010000:2.0:1786562569.229936:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414400/0x5c655bf66686cd06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cead23 expref: 303 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229944:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2da:0x0].0x0 (ffff90e9af537a00) 00010000:00010000:2.0:1786562569.229953:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f000/0x5c655bf66686c994 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceac0b expref: 302 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229964:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38fe00/0x5c655bf66686c852 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2d4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceaba9 expref: 301 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.229972:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d4:0x0].0x0 (ffff90e991ebba00) 00010000:00010000:2.0:1786562569.229993:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557a00/0x5c655bf66686c43f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceaa75 expref: 300 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230026:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38fc00/0x5c655bf66686c32e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2cf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ceaa1a expref: 299 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230043:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2cf:0x0].0x0 (ffff90e982f2ba00) 00010000:00010000:2.0:1786562569.230056:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95600/0x5c655bf66686bf99 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2cd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea8fb expref: 298 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230065:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2cd:0x0].0x0 (ffff90e9af537000) 00010000:00010000:2.0:1786562569.230077:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf66686bf3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea8e6 expref: 297 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230107:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415e00/0x5c655bf66686be5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2c9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea899 expref: 296 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230117:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c9:0x0].0x0 (ffff90e9af537400) 00010000:00010000:2.0:1786562569.230128:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0da00/0x5c655bf66686ba60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2c8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea749 expref: 295 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230138:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c8:0x0].0x0 (ffff90e982f2bc00) 00010000:00010000:2.0:1786562569.230148:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176e600/0x5c655bf66686b868 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2c3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea6bd expref: 294 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230162:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176f800/0x5c655bf66686b749 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea669 expref: 293 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230171:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c3:0x0].0x0 (ffff90e9af537c00) 00010000:00010000:2.0:1786562569.230184:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176e800/0x5c655bf66686b3b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea53c expref: 292 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230197:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c1:0x0].0x0 (ffff90e9af537700) 00010000:00010000:2.0:1786562569.230209:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414e00/0x5c655bf66686ae5f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea3a6 expref: 291 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230222:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fba00/0x5c655bf66686ad40 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2b9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea359 expref: 290 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230230:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b9:0x0].0x0 (ffff90e994850600) 00010000:00010000:2.0:1786562569.230240:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5ba00/0x5c655bf66686a9b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea225 expref: 289 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230249:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b8:0x0].0x0 (ffff90e9924c5b00) 00010000:00010000:2.0:1786562569.230259:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fb600/0x5c655bf66686a80e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea1a7 expref: 288 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230273:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7e00/0x5c655bf66686a6ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2b3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea14c expref: 287 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230282:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b3:0x0].0x0 (ffff90e9af537500) 00010000:00010000:2.0:1786562569.230293:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7400/0x5c655bf66686a35a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2b2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cea018 expref: 286 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230300:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2b2:0x0].0x0 (ffff90e999aab700) 00010000:00010000:2.0:1786562569.230311:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176ea00/0x5c655bf66686a18c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9f85 expref: 285 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230327:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176ee00/0x5c655bf66686a06d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2ad:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9f31 expref: 284 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230335:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2ad:0x0].0x0 (ffff90e9af537e00) 00010000:00010000:2.0:1786562569.230346:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514800/0x5c655bf6668698a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9cbb expref: 283 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230355:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2aa:0x0].0x0 (ffff90e999af3d00) 00010000:00010000:2.0:1786562569.230365:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515800/0x5c655bf66686935b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9b10 expref: 282 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230373:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a6:0x0].0x0 (ffff90e9af537300) 00010000:00010000:2.0:1786562569.230383:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8c00/0x5c655bf666869194 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9a8b expref: 281 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230394:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38f000/0x5c655bf66686907c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9a37 expref: 280 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230403:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a1:0x0].0x0 (ffff90e983a70500) 00010000:00010000:2.0:1786562569.230414:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515a00/0x5c655bf666868ce0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9903 expref: 279 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230422:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2a0:0x0].0x0 (ffff90e9907f2600) 00010000:00010000:2.0:1786562569.230431:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fae00/0x5c655bf666868b0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x29f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9877 expref: 278 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230445:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29f:0x0].0x0 (ffff90e994850700) 00010000:00010000:2.0:1786562569.230456:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514c00/0x5c655bf666868913 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x29d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce97eb expref: 277 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230464:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x29d:0x0].0x0 (ffff90e9af72a900) 00010000:00010000:2.0:1786562569.230477:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3faa00/0x5c655bf6668688b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x299:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce97d6 expref: 276 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230489:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514e00/0x5c655bf6668687ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x299:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce977b expref: 275 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230496:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x299:0x0].0x0 (ffff90e98559a400) 00010000:00010000:2.0:1786562569.230506:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261d400/0x5c655bf666868205 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x293:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce95b4 expref: 274 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230517:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fb000/0x5c655bf666868110 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x293:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce956e expref: 273 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230524:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x293:0x0].0x0 (ffff90e9907f2500) 00010000:00010000:2.0:1786562569.230532:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38f400/0x5c655bf66686796f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x290:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce92ff expref: 272 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230540:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x290:0x0].0x0 (ffff90e9889c8d00) 00010000:00010000:2.0:1786562569.230549:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414000/0x5c655bf6668677e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x28f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce9273 expref: 271 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230560:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x28f:0x0].0x0 (ffff90e9af72a400) 00010000:00010000:2.0:1786562569.230569:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668675fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x28a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce91ee expref: 270 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230581:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38ee00/0x5c655bf6668674de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x28a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce919a expref: 269 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230590:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x28a:0x0].0x0 (ffff90e994850400) 00010000:00010000:2.0:1786562569.230600:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fbe00/0x5c655bf666866d52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x287:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8f32 expref: 268 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230609:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x287:0x0].0x0 (ffff90e9889c8f00) 00010000:00010000:2.0:1786562569.230619:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0000/0x5c655bf666866a2d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x285:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8e28 expref: 267 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230639:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x285:0x0].0x0 (ffff90e9907f2e00) 00010000:00010000:2.0:1786562569.230653:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fbc00/0x5c655bf666866874 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x284:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8d9c expref: 266 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230661:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x284:0x0].0x0 (ffff90e994289600) 00010000:00010000:2.0:1786562569.230671:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068d200/0x5c655bf66686651e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x282:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8c8b expref: 265 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230679:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x282:0x0].0x0 (ffff90e994850e00) 00010000:00010000:2.0:1786562569.230688:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0600/0x5c655bf666866318 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x281:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8bf1 expref: 264 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230696:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x281:0x0].0x0 (ffff90e9924c5800) 00010000:00010000:2.0:1786562569.230707:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb3fb800/0x5c655bf6668661cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x280:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8b81 expref: 263 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230715:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x280:0x0].0x0 (ffff90e983a9a800) 00010000:00010000:2.0:1786562569.230724:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81c200/0x5c655bf666865e56 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x27e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8a69 expref: 262 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230732:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27e:0x0].0x0 (ffff90e9924c5a00) 00010000:00010000:2.0:1786562569.230741:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0a00/0x5c655bf666865c8f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x27d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce89cf expref: 261 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230749:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x27d:0x0].0x0 (ffff90e9889fa100) 00010000:00010000:2.0:1786562569.230758:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556000/0x5c655bf666865a9e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x278:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce893c expref: 260 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230769:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95000/0x5c655bf66686597f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x278:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce88e8 expref: 259 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230776:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x278:0x0].0x0 (ffff90e9889c8700) 00010000:00010000:2.0:1786562569.230789:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668655dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x276:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce87b4 expref: 258 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230796:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x276:0x0].0x0 (ffff90e999af3900) 00010000:00010000:2.0:1786562569.230804:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514200/0x5c655bf666865400 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x275:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce871a expref: 257 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230812:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x275:0x0].0x0 (ffff90e9889c8000) 00010000:00010000:2.0:1786562569.230821:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068d600/0x5c655bf666865025 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x272:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce85f4 expref: 256 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230829:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x272:0x0].0x0 (ffff90e999af3e00) 00010000:00010000:2.0:1786562569.230838:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb38e400/0x5c655bf666864ece lrc: 0/0,0 mode: --/CR res: [0x200000404:0x26d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce858b expref: 255 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230849:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515e00/0x5c655bf666864da1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x26d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce8530 expref: 254 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230856:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x26d:0x0].0x0 (ffff90e999af3f00) 00010000:00010000:2.0:1786562569.230865:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514400/0x5c655bf666864478 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x262:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce825f expref: 253 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230877:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c800/0x5c655bf666864344 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x262:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce81fd expref: 252 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230885:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x262:0x0].0x0 (ffff90e999af3300) 00010000:00010000:2.0:1786562569.230894:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99176fc00/0x5c655bf666863fc4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x261:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce80d7 expref: 251 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230902:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x261:0x0].0x0 (ffff90e9af72aa00) 00010000:00010000:2.0:1786562569.230912:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf666863de1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x25c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce803d expref: 250 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230929:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c200/0x5c655bf666863cc2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x25c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7fe9 expref: 249 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230938:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25c:0x0].0x0 (ffff90e9af72a800) 00010000:00010000:2.0:1786562569.230948:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64c00/0x5c655bf6668637c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x25a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7e3e expref: 248 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230956:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x25a:0x0].0x0 (ffff90e9a248b900) 00010000:00010000:2.0:1786562569.230966:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068d000/0x5c655bf6668635f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x255:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7dab expref: 247 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230978:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515600/0x5c655bf66686349c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x255:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7d42 expref: 246 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.230986:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x255:0x0].0x0 (ffff90e9a248b600) 00010000:00010000:2.0:1786562569.230995:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf666863123 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x254:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7c1c expref: 245 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231003:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x254:0x0].0x0 (ffff90e999af3b00) 00010000:00010000:2.0:1786562569.231043:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514000/0x5c655bf666862f40 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x253:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7b74 expref: 244 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231054:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x253:0x0].0x0 (ffff90e999972d00) 00010000:00010000:2.0:1786562569.231065:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf666862d1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x24e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7ad3 expref: 243 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231087:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf666862c06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x24e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7a7f expref: 242 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231095:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24e:0x0].0x0 (ffff90e9907f2400) 00010000:00010000:2.0:1786562569.231106:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf666862847 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x24d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7944 expref: 241 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231114:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24d:0x0].0x0 (ffff90e9907f2900) 00010000:00010000:2.0:1786562569.231124:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf666862648 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x24c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce78aa expref: 240 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231133:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x24c:0x0].0x0 (ffff90e999af3000) 00010000:00010000:2.0:1786562569.231144:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0515000/0x5c655bf6668620d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x245:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce770d expref: 239 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231156:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415000/0x5c655bf666861fb1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x245:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce76b2 expref: 238 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231165:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x245:0x0].0x0 (ffff90e999aab600) 00010000:00010000:2.0:1786562569.231178:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068c000/0x5c655bf666861a78 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x243:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce74f9 expref: 237 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231186:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x243:0x0].0x0 (ffff90e9a248b000) 00010000:00010000:2.0:1786562569.231197:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0000/0x5c655bf66686185d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x23e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce745f expref: 236 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231214:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c216f400/0x5c655bf66686173e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x23e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce740b expref: 235 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231223:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x23e:0x0].0x0 (ffff90e9833da800) 00010000:00010000:2.0:1786562569.231234:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415400/0x5c655bf666861355 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x239:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce72c9 expref: 234 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231246:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1400/0x5c655bf66686123d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x239:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7275 expref: 233 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231255:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x239:0x0].0x0 (ffff90e9af72ad00) 00010000:00010000:2.0:1786562569.231265:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af415a00/0x5c655bf666860acd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x235:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce7014 expref: 232 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231273:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x235:0x0].0x0 (ffff90e999aabb00) 00010000:00010000:2.0:1786562569.231283:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0514a00/0x5c655bf666860914 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x234:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6f81 expref: 231 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231291:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x234:0x0].0x0 (ffff90e9af72ac00) 00010000:00010000:2.0:1786562569.231303:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5b200/0x5c655bf66686077e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x233:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6ef5 expref: 230 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231312:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x233:0x0].0x0 (ffff90e9a248bf00) 00010000:00010000:2.0:1786562569.231323:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414200/0x5c655bf666860292 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6d66 expref: 229 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231336:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x230:0x0].0x0 (ffff90e9af72ab00) 00010000:00010000:2.0:1786562569.231345:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af414c00/0x5c655bf6668600f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x22f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6ce1 expref: 228 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231353:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22f:0x0].0x0 (ffff90e9af72af00) 00010000:00010000:2.0:1786562569.231361:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068d400/0x5c655bf66685fd6e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x22d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6bd0 expref: 227 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231369:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22d:0x0].0x0 (ffff90e9889c8600) 00010000:00010000:2.0:1786562569.231378:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95800/0x5c655bf66685f9d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6ab8 expref: 226 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231386:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x22a:0x0].0x0 (ffff90e999aab200) 00010000:00010000:2.0:1786562569.231396:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8600/0x5c655bf66685f60c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6976 expref: 225 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231405:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x228:0x0].0x0 (ffff90e999aabd00) 00010000:00010000:2.0:1786562569.231415:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94600/0x5c655bf66685f422 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce68ce expref: 224 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231423:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x227:0x0].0x0 (ffff90e9833da700) 00010000:00010000:2.0:1786562569.231433:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c800/0x5c655bf66685f071 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x225:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce67b6 expref: 223 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231441:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x225:0x0].0x0 (ffff90e9af72ae00) 00010000:00010000:2.0:1786562569.231452:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5bc00/0x5c655bf66685eeb8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6723 expref: 222 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231460:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x224:0x0].0x0 (ffff90e9a248b800) 00010000:00010000:2.0:1786562569.231471:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0400/0x5c655bf66685ed37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x223:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce66a5 expref: 221 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231479:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x223:0x0].0x0 (ffff90e9924c5600) 00010000:00010000:2.0:1786562569.231488:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1800/0x5c655bf66685eb3f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce660b expref: 220 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231498:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x222:0x0].0x0 (ffff90e994ad3000) 00010000:00010000:2.0:1786562569.231508:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5b000/0x5c655bf66685e940 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6571 expref: 219 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231517:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x220:0x0].0x0 (ffff90e999aab800) 00010000:00010000:2.0:1786562569.231528:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66685e7d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6508 expref: 218 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231539:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267200/0x5c655bf66685e6ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce64ad expref: 217 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231546:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x21b:0x0].0x0 (ffff90e999aab300) 00010000:00010000:2.0:1786562569.231554:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f1a00/0x5c655bf66685e2d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce636b expref: 216 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231561:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x219:0x0].0x0 (ffff90e999aab900) 00010000:00010000:2.0:1786562569.231570:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cb000/0x5c655bf66685e11a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce62e6 expref: 215 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231577:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x218:0x0].0x0 (ffff90e999aabc00) 00010000:00010000:2.0:1786562569.231586:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5ae00/0x5c655bf66685dc0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce6150 expref: 214 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231595:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x215:0x0].0x0 (ffff90e999aab500) 00010000:00010000:2.0:1786562569.231603:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0200/0x5c655bf66685d4a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x20d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5f12 expref: 213 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231616:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a99f0800/0x5c655bf66685d37c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x20d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5eb7 expref: 212 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231638:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x20d:0x0].0x0 (ffff90e999aab000) 00010000:00010000:2.0:1786562569.231653:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf66685cfcb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5d83 expref: 211 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231669:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5ac00/0x5c655bf66685ceba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5d36 expref: 210 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231678:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x208:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:2.0:1786562569.231690:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6da00/0x5c655bf66685c95e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5b76 expref: 209 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231702:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64e00/0x5c655bf66685c81c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x202:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5b14 expref: 208 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231714:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x202:0x0].0x0 (ffff90e9a248bc00) 00010000:00010000:2.0:1786562569.231725:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822da00/0x5c655bf66685c296 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce595b expref: 207 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231736:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5b400/0x5c655bf66685c1af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5915 expref: 206 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231743:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1fb:0x0].0x0 (ffff90e98559a700) 00010000:00010000:2.0:1786562569.231753:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266600/0x5c655bf66685bd5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce57be expref: 205 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231764:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a000/0x5c655bf66685bc4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce575c expref: 204 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231774:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f6:0x0].0x0 (ffff90e9a248b100) 00010000:00010000:2.0:1786562569.231783:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267600/0x5c655bf66685b8be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce563d expref: 203 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231797:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6c800/0x5c655bf66685b7e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce55fe expref: 202 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231804:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f1:0x0].0x0 (ffff90e982f2b400) 00010000:00010000:2.0:1786562569.231812:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266a00/0x5c655bf66685b3fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce54b5 expref: 201 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231824:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1f0:0x0].0x0 (ffff90e982f2bd00) 00010000:00010000:2.0:1786562569.231832:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf66685b212 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5422 expref: 200 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231850:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ef:0x0].0x0 (ffff90e98559a100) 00010000:00010000:2.0:1786562569.231859:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0800/0x5c655bf66685b028 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5388 expref: 199 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231868:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ed:0x0].0x0 (ffff90e9a248b200) 00010000:00010000:2.0:1786562569.231876:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1a00/0x5c655bf66685ae4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce52ee expref: 198 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231885:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ec:0x0].0x0 (ffff90e9a248bb00) 00010000:00010000:2.0:1786562569.231894:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff99400/0x5c655bf66685ac77 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5262 expref: 197 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231902:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1eb:0x0].0x0 (ffff90e9833da000) 00010000:00010000:2.0:1786562569.231911:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf66685aac5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce51dd expref: 196 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231930:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860af400/0x5c655bf66685a9c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce5190 expref: 195 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231939:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e6:0x0].0x0 (ffff90e982f2bb00) 00010000:00010000:2.0:1786562569.231948:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7200/0x5c655bf66685a466 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4fc9 expref: 194 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231957:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1e4:0x0].0x0 (ffff90e9924c5100) 00010000:00010000:2.0:1786562569.231966:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549e00/0x5c655bf66685a05a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4e95 expref: 193 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231977:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98200/0x5c655bf666859f57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1de:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4e48 expref: 192 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.231984:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1de:0x0].0x0 (ffff90e9889f4400) 00010000:00010000:2.0:1786562569.231995:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5b600/0x5c655bf666859b9f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4d14 expref: 191 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244669:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf666859a95 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4cc7 expref: 190 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244718:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d9:0x0].0x0 (ffff90e9833da600) 00010000:00010000:2.0:1786562569.244746:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668596c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4b85 expref: 189 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244763:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668595c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4b3f expref: 188 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244773:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1d4:0x0].0x0 (ffff90e999bb1700) 00010000:00010000:2.0:1786562569.244784:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf666859299 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4a27 expref: 187 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244801:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6d600/0x5c655bf666859126 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce49be expref: 186 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244810:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1cf:0x0].0x0 (ffff90e9889f4500) 00010000:00010000:2.0:1786562569.244821:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a400/0x5c655bf666858d44 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce487c expref: 185 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244830:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ce:0x0].0x0 (ffff90e982f2bf00) 00010000:00010000:2.0:1786562569.244875:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfd5a600/0x5c655bf6668589d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce475d expref: 184 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244888:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1cc:0x0].0x0 (ffff90e982f2b100) 00010000:00010000:2.0:1786562569.244900:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0e00/0x5c655bf6668585d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4630 expref: 183 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244913:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8caa00/0x5c655bf6668584d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce45dc expref: 182 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244924:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1c5:0x0].0x0 (ffff90e994ad3f00) 00010000:00010000:2.0:1786562569.244935:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068dc00/0x5c655bf666858135 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce44af expref: 181 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244945:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1c4:0x0].0x0 (ffff90e9889f4f00) 00010000:00010000:2.0:1786562569.244956:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0c00/0x5c655bf666857955 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4255 expref: 180 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244973:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a068cc00/0x5c655bf666857836 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce41f3 expref: 179 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.244982:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1bc:0x0].0x0 (ffff90e994ad3500) 00010000:00010000:2.0:1786562569.244996:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e7e00/0x5c655bf666857518 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce40f0 expref: 178 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245025:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ba:0x0].0x0 (ffff90e982f2b500) 00010000:00010000:2.0:1786562569.245044:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf666857389 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce4080 expref: 177 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245058:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557800/0x5c655bf666857247 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce401e expref: 176 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245070:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff90e9889f4800) 00010000:00010000:2.0:1786562569.245089:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf666856aec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3dcb expref: 175 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245108:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668569aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3d69 expref: 174 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245117:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ad:0x0].0x0 (ffff90e983a9ad00) 00010000:00010000:2.0:1786562569.245128:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668562bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3b24 expref: 173 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245143:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff90e9889f4c00) 00010000:00010000:2.0:1786562569.245154:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf666855eac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce39d4 expref: 172 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245167:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1600/0x5c655bf666855d86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3972 expref: 171 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245176:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a4:0x0].0x0 (ffff90e9a248bd00) 00010000:00010000:2.0:1786562569.245191:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf666855996 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3837 expref: 170 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245205:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf666855893 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce37e3 expref: 169 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245214:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff90e9889f4100) 00010000:00010000:2.0:1786562569.245226:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266000/0x5c655bf66685549c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce36a8 expref: 168 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245767:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860aea00/0x5c655bf666855399 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3654 expref: 167 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245781:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff90e9889f4300) 00010000:00010000:2.0:1786562569.245795:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64200/0x5c655bf666854951 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3321 expref: 166 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245809:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff90e9889c8b00) 00010000:00010000:2.0:1786562569.245826:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf666854592 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce31ed expref: 165 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245835:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff90e9907b8d00) 00010000:00010000:2.0:1786562569.245845:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549a00/0x5c655bf666854449 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce318b expref: 164 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245860:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549800/0x5c655bf6668542dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce3122 expref: 163 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245869:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff90e999bb1300) 00010000:00010000:2.0:1786562569.245880:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf666853d8f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2f69 expref: 162 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245890:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff90e9889c8400) 00010000:00010000:2.0:1786562569.245904:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf666853beb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2edd expref: 161 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245914:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff90e9889f4000) 00010000:00010000:2.0:1786562569.245924:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65a00/0x5c655bf666853696 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2d39 expref: 160 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245932:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x187:0x0].0x0 (ffff90e9907b8a00) 00010000:00010000:2.0:1786562569.245943:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822dc00/0x5c655bf666853332 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2c28 expref: 159 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245953:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x185:0x0].0x0 (ffff90e9889c8900) 00010000:00010000:2.0:1786562569.245962:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822d600/0x5c655bf66685316b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2b8e expref: 158 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245970:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff90e9889c8300) 00010000:00010000:2.0:1786562569.245979:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549000/0x5c655bf666852fea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2b10 expref: 157 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.245988:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562569.245998:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548200/0x5c655bf666852e62 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2a8b expref: 156 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246036:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x182:0x0].0x0 (ffff90e9889c8200) 00010000:00010000:2.0:1786562569.246052:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65000/0x5c655bf666852c8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce29ff expref: 155 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246061:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff90e9833daa00) 00010000:00010000:2.0:1786562569.246073:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1000/0x5c655bf666852b1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2981 expref: 154 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246083:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff90e9a248b400) 00010000:00010000:2.0:1786562569.246096:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64600/0x5c655bf666852945 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce28fc expref: 153 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246108:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf64400/0x5c655bf66685283b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce28af expref: 152 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246118:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17a:0x0].0x0 (ffff90e983a70c00) 00010000:00010000:2.0:1786562569.246130:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267c00/0x5c655bf666852498 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2782 expref: 151 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246143:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266c00/0x5c655bf666852379 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce272e expref: 150 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246152:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff90e982cfce00) 00010000:00010000:2.0:1786562569.246164:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf666852023 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce260f expref: 149 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.246191:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8ca600/0x5c655bf666851ef6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x170:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce25b4 expref: 148 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.248660:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x170:0x0].0x0 (ffff90e9889f4700) 00010000:00010000:2.0:1786562569.248975:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988266400/0x5c655bf666851b3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x16b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce248e expref: 147 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.248998:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95c00/0x5c655bf666851a18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce242c expref: 146 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249031:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16b:0x0].0x0 (ffff90e9907b8500) 00010000:00010000:2.0:1786562569.249056:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6800/0x5c655bf666851659 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x165:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce22f8 expref: 145 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249077:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988267400/0x5c655bf66685152c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x165:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce229d expref: 144 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249094:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x165:0x0].0x0 (ffff90e9907b8800) 00010000:00010000:2.0:1786562569.249114:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98e00/0x5c655bf666851174 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x164:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce2169 expref: 143 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249125:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x164:0x0].0x0 (ffff90e98559a900) 00010000:00010000:2.0:1786562569.249143:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65c00/0x5c655bf666850fbb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce20d6 expref: 142 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249153:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff90e98559aa00) 00010000:00010000:2.0:1786562569.249168:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1800/0x5c655bf666850dca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce203c expref: 141 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249177:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x162:0x0].0x0 (ffff90e994ad3c00) 00010000:00010000:2.0:1786562569.249189:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94800/0x5c655bf666850be0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1fa9 expref: 140 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249198:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x161:0x0].0x0 (ffff90e991ebbd00) 00010000:00010000:2.0:1786562569.249220:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556a00/0x5c655bf666850a04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x160:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1f1d expref: 139 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.249228:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x160:0x0].0x0 (ffff90e991ebb700) 00010000:00010000:2.0:1786562569.250716:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65800/0x5c655bf6668504a1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x15d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1d72 expref: 138 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250743:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x15d:0x0].0x0 (ffff90e9924c5d00) 00010000:00010000:2.0:1786562569.250764:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95200/0x5c655bf666850335 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x158:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1cfb expref: 137 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250781:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bbf65200/0x5c655bf666850224 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x158:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1ca7 expref: 136 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250790:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x158:0x0].0x0 (ffff90e9889f4d00) 00010000:00010000:2.0:1786562569.250816:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1e00/0x5c655bf66684fec7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x157:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1b88 expref: 135 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250828:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x157:0x0].0x0 (ffff90e9924c5200) 00010000:00010000:2.0:1786562569.250841:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d1200/0x5c655bf66684fcf2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x156:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1af5 expref: 134 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250853:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x156:0x0].0x0 (ffff90e994ab8000) 00010000:00010000:2.0:1786562569.250868:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9862d0400/0x5c655bf66684fb40 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1a69 expref: 133 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250879:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x155:0x0].0x0 (ffff90e98559a200) 00010000:00010000:2.0:1786562569.250892:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cb800/0x5c655bf66684f9c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x154:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce19e4 expref: 132 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250902:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x154:0x0].0x0 (ffff90e994ab8700) 00010000:00010000:2.0:1786562569.250915:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261ce00/0x5c655bf66684f0e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x14a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce171a expref: 131 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250930:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94000/0x5c655bf66684eff5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x14a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce16d4 expref: 130 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250940:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x14a:0x0].0x0 (ffff90e992640600) 00010000:00010000:2.0:1786562569.250953:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860afe00/0x5c655bf66684ec21 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1599 expref: 129 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250964:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x149:0x0].0x0 (ffff90e992640700) 00010000:00010000:2.0:1786562569.250975:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c216ea00/0x5c655bf66684ea68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1506 expref: 128 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.250986:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x148:0x0].0x0 (ffff90e98559a500) 00010000:00010000:2.0:1786562569.250999:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6d800/0x5c655bf66684e831 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x143:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce146c expref: 127 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251034:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860aec00/0x5c655bf66684e70b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x143:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce140a expref: 126 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251048:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x143:0x0].0x0 (ffff90e9833daf00) 00010000:00010000:2.0:1786562569.251063:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c216ee00/0x5c655bf66684e337 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x13d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce12dd expref: 125 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251079:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6d400/0x5c655bf66684e23b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x13d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1289 expref: 124 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251098:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x13d:0x0].0x0 (ffff90e98559ae00) 00010000:00010000:2.0:1786562569.251112:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66684de9f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x13b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce115c expref: 123 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251124:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x13b:0x0].0x0 (ffff90e98559a000) 00010000:00010000:2.0:1786562569.251136:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66684dd95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x136:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce10fa expref: 122 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251151:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94e00/0x5c655bf66684dc3e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x136:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce1098 expref: 121 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251161:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x136:0x0].0x0 (ffff90e9924c5f00) 00010000:00010000:2.0:1786562569.251174:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549600/0x5c655bf66684d8e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x135:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0f80 expref: 120 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251184:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x135:0x0].0x0 (ffff90e994ab8a00) 00010000:00010000:2.0:1786562569.251194:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff99800/0x5c655bf66684d728 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x134:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0eed expref: 119 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251203:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x134:0x0].0x0 (ffff90e9924c5000) 00010000:00010000:2.0:1786562569.251215:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822cc00/0x5c655bf66684d3c4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0dd5 expref: 118 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251225:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x132:0x0].0x0 (ffff90e982cfcd00) 00010000:00010000:2.0:1786562569.251492:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c800/0x5c655bf66684d1e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0d3b expref: 117 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251508:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x131:0x0].0x0 (ffff90e994ab8300) 00010000:00010000:2.0:1786562569.251523:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c600/0x5c655bf66684d02f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0caf expref: 116 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251532:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x130:0x0].0x0 (ffff90e994ab8100) 00010000:00010000:2.0:1786562569.251542:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81dc00/0x5c655bf66684ce92 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0c1c expref: 115 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251552:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x12f:0x0].0x0 (ffff90e983a70800) 00010000:00010000:2.0:1786562569.251564:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6ca00/0x5c655bf66684ccaf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x12d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0b89 expref: 114 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251573:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x12d:0x0].0x0 (ffff90e98559af00) 00010000:00010000:2.0:1786562569.251584:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822d400/0x5c655bf66684cb27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x128:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0b19 expref: 113 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251597:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a7600/0x5c655bf66684c9e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x128:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0ab7 expref: 112 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251607:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x128:0x0].0x0 (ffff90e994ab8c00) 00010000:00010000:2.0:1786562569.251617:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549200/0x5c655bf66684c67a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0998 expref: 111 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251640:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x127:0x0].0x0 (ffff90e991ebb300) 00010000:00010000:2.0:1786562569.251662:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548400/0x5c655bf66684c2d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce085d expref: 110 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251674:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x125:0x0].0x0 (ffff90e991ebb600) 00010000:00010000:2.0:1786562569.251686:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f6a00/0x5c655bf66684c110 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x120:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce07d8 expref: 109 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251699:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822ca00/0x5c655bf66684bff8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x120:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce078b expref: 108 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251709:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x120:0x0].0x0 (ffff90e9833da100) 00010000:00010000:2.0:1786562569.251742:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860ae000/0x5c655bf66684bae2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x11c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce05ee expref: 107 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251758:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548600/0x5c655bf66684bbd7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x11c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce063b expref: 106 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251768:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x11c:0x0].0x0 (ffff90e994ab8e00) 00010000:00010000:2.0:1786562569.251780:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822de00/0x5c655bf66684b937 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x117:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce0562 expref: 105 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251793:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822d000/0x5c655bf66684b7fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x117:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce04f9 expref: 104 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251803:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x117:0x0].0x0 (ffff90e991ebb500) 00010000:00010000:2.0:1786562569.251817:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860aee00/0x5c655bf66684b405 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce03a9 expref: 103 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251832:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x116:0x0].0x0 (ffff90e9833dac00) 00010000:00010000:2.0:1786562569.251844:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549400/0x5c655bf66684b229 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce030f expref: 102 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251854:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x115:0x0].0x0 (ffff90e991ebbc00) 00010000:00010000:2.0:1786562569.251867:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548a00/0x5c655bf66684ae9b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce01f0 expref: 101 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251877:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x113:0x0].0x0 (ffff90e991ebbf00) 00010000:00010000:2.0:1786562569.251906:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98400/0x5c655bf66684ace9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce015d expref: 100 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562569.251916:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x111:0x0].0x0 (ffff90e994ab8900) 00010000:00010000:2.0:1786562569.251922:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562569.252483:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+99:56884:x1873345652872704:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 47510us (47752us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562569.252495:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 982 00000100:00100000:0.0:1786562569.304166:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562569.304285:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652872832 00000100:00100000:1.0:1786562569.304299:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652872832 00000100:00100000:1.0:1786562569.304396:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 983 00000100:00100000:1.0:1786562569.304408:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+99:56884:x1873345652872832:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562569.304428:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 88 locks, starting at 0 00010000:00010000:1.0:1786562569.304473:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822ce00/0x5c655bf66684ab37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x110:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584ce00df expref: 99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304498:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x110:0x0].0x0 (ffff90e9833da900) 00010000:00010000:1.0:1786562569.304520:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0548000/0x5c655bf66684a7be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdffc7 expref: 98 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304532:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x10e:0x0].0x0 (ffff90e9833dae00) 00010000:00010000:1.0:1786562569.304545:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822d200/0x5c655bf66684a5e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x10d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdff3b expref: 97 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304554:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x10d:0x0].0x0 (ffff90e9833dab00) 00010000:00010000:1.0:1786562569.304565:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c200/0x5c655bf66684a41b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x10b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdfeaf expref: 96 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304573:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x10b:0x0].0x0 (ffff90e9833dad00) 00010000:00010000:1.0:1786562569.304584:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a0549c00/0x5c655bf666849ee9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x104:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdfd27 expref: 95 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304595:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99822c400/0x5c655bf666849dd1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x104:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdfccc expref: 94 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304604:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x104:0x0].0x0 (ffff90e9833da500) 00010000:00010000:1.0:1786562569.304616:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95e00/0x5c655bf666849821 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x102:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdfb05 expref: 93 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304637:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x102:0x0].0x0 (ffff90e992640800) 00010000:00010000:1.0:1786562569.304650:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e95a00/0x5c655bf666849415 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xfc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf9c3 expref: 92 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304663:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94c00/0x5c655bf6668492fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0xfc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf961 expref: 91 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304690:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xfc:0x0].0x0 (ffff90e994ad3b00) 00010000:00010000:1.0:1786562569.304707:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8ca200/0x5c655bf666848fca lrc: 0/0,0 mode: --/CR res: [0x200000404:0xf7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf857 expref: 90 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304721:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cbe00/0x5c655bf666848ee3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xf7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf811 expref: 89 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304730:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf7:0x0].0x0 (ffff90e9907b8f00) 00010000:00010000:1.0:1786562569.304751:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261c000/0x5c655bf666848b7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0xf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf6f9 expref: 88 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304762:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf6:0x0].0x0 (ffff90e9907b8900) 00010000:00010000:1.0:1786562569.304785:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860af800/0x5c655bf66684896b lrc: 0/0,0 mode: --/CR res: [0x200000404:0xf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf651 expref: 87 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304797:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xf5:0x0].0x0 (ffff90e98559ac00) 00010000:00010000:1.0:1786562569.304810:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9c1e94a00/0x5c655bf6668485f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xef:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf532 expref: 86 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304831:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cac00/0x5c655bf6668484c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf4d7 expref: 85 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304839:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xef:0x0].0x0 (ffff90e994ad3900) 00010000:00010000:1.0:1786562569.304850:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cb600/0x5c655bf666847f46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf309 expref: 84 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304865:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xed:0x0].0x0 (ffff90e9907b8300) 00010000:00010000:1.0:1786562569.304877:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cb200/0x5c655bf666847d9b lrc: 0/0,0 mode: --/CR res: [0x200000404:0xeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf276 expref: 83 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304896:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xeb:0x0].0x0 (ffff90e983a9a600) 00010000:00010000:1.0:1786562569.304910:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8e00/0x5c655bf666847a45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf157 expref: 82 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304920:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe8:0x0].0x0 (ffff90e994ab8400) 00010000:00010000:1.0:1786562569.304930:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf666847678 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdf01c expref: 81 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304939:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe6:0x0].0x0 (ffff90e994ad3100) 00010000:00010000:1.0:1786562569.304951:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8cba00/0x5c655bf6668474bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0xe0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdef90 expref: 80 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304963:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860ae600/0x5c655bf6668473b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xe0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdef43 expref: 79 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304972:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xe0:0x0].0x0 (ffff90e992640000) 00010000:00010000:1.0:1786562569.304982:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8800/0x5c655bf666846fe1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdedfa expref: 78 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.304990:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xde:0x0].0x0 (ffff90e992640500) 00010000:00010000:1.0:1786562569.305000:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860ae400/0x5c655bf666846e05 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cded52 expref: 77 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305067:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xdd:0x0].0x0 (ffff90e992640c00) 00010000:00010000:1.0:1786562569.305080:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261d000/0x5c655bf666846a38 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdec1e expref: 76 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305089:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xdb:0x0].0x0 (ffff90e994ab8b00) 00010000:00010000:1.0:1786562569.305098:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9800/0x5c655bf666846855 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdeb7d expref: 75 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305108:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xda:0x0].0x0 (ffff90e992640200) 00010000:00010000:1.0:1786562569.305118:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860af600/0x5c655bf666846641 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdeae3 expref: 74 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305130:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af8ca800/0x5c655bf6668464ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdea81 expref: 73 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305137:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xd4:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:1.0:1786562569.305147:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf666846178 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xd3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde954 expref: 72 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305156:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xd3:0x0].0x0 (ffff90e98559ab00) 00010000:00010000:1.0:1786562569.305169:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557200/0x5c655bf666845f3a lrc: 0/0,0 mode: --/CR res: [0x200000404:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde8b3 expref: 71 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305182:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860af000/0x5c655bf666845e3e lrc: 0/0,0 mode: --/PR res: [0x200000404:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde85f expref: 70 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305197:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xce:0x0].0x0 (ffff90e983a70300) 00010000:00010000:1.0:1786562569.305209:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff99a00/0x5c655bf66684585d lrc: 0/0,0 mode: --/CR res: [0x200000404:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde68a expref: 69 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305222:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9860ae800/0x5c655bf66684573e lrc: 0/0,0 mode: --/PR res: [0x200000404:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde628 expref: 68 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305231:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc8:0x0].0x0 (ffff90e983a70700) 00010000:00010000:1.0:1786562569.305242:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98000/0x5c655bf6668453b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xc7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde4fb expref: 67 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305252:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc7:0x0].0x0 (ffff90e98559ad00) 00010000:00010000:1.0:1786562569.305263:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668451c6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde468 expref: 66 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305272:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xc5:0x0].0x0 (ffff90e983a70100) 00010000:00010000:1.0:1786562569.305313:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556800/0x5c655bf666844db3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xbf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde33b expref: 65 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305329:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9a98a6a00/0x5c655bf666844cb0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde2e7 expref: 64 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305340:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xbf:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562569.305352:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf666844976 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde1dd expref: 63 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305371:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98c00/0x5c655bf666844849 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xba:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cde182 expref: 62 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305380:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xba:0x0].0x0 (ffff90e994ad3d00) 00010000:00010000:1.0:1786562569.305392:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff98600/0x5c655bf6668442f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cddfd0 expref: 61 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305400:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb8:0x0].0x0 (ffff90e983a70900) 00010000:00010000:1.0:1786562569.305412:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf66684410a lrc: 0/0,0 mode: --/CR res: [0x200000404:0xb3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cddf2f expref: 60 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305425:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff99c00/0x5c655bf666843fd6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xb3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cddecd expref: 59 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305434:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xb3:0x0].0x0 (ffff90e983a70f00) 00010000:00010000:1.0:1786562569.305448:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99261ca00/0x5c655bf666843c95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xae:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdddc3 expref: 58 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305463:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8400/0x5c655bf666843bbc lrc: 0/0,0 mode: --/PR res: [0x200000404:0xae:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cddd84 expref: 57 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305473:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xae:0x0].0x0 (ffff90e994ad3a00) 00010000:00010000:1.0:1786562569.305491:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf666843659 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cddbc4 expref: 56 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305507:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xac:0x0].0x0 (ffff90e98559a800) 00010000:00010000:1.0:1786562569.305518:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8a00/0x5c655bf666843492 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cddb2a expref: 55 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305528:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xab:0x0].0x0 (ffff90e983a70000) 00010000:00010000:1.0:1786562569.305539:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf666843277 lrc: 0/0,0 mode: --/CR res: [0x200000404:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdda90 expref: 54 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305573:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f6800/0x5c655bf666843135 lrc: 0/0,0 mode: --/PR res: [0x200000404:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdda2e expref: 53 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305583:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa6:0x0].0x0 (ffff90e999bb1c00) 00010000:00010000:1.0:1786562569.305593:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031c00/0x5c655bf66684297f lrc: 0/0,0 mode: --/CR res: [0x200000404:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd7a3 expref: 52 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305603:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0xa3:0x0].0x0 (ffff90e9c21d1d00) 00010000:00010000:1.0:1786562569.305614:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031600/0x5c655bf66684279c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x9e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd709 expref: 51 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305643:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668426bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd6c3 expref: 50 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305654:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9e:0x0].0x0 (ffff90e999bb1500) 00010000:00010000:1.0:1786562569.305666:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf66684236d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd5ab expref: 49 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305681:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x9c:0x0].0x0 (ffff90e999bb1f00) 00010000:00010000:1.0:1786562569.305693:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf666841f4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x95:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd470 expref: 48 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305710:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7c00/0x5c655bf666841e65 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd423 expref: 47 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305721:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x95:0x0].0x0 (ffff90e9907b8200) 00010000:00010000:1.0:1786562569.305732:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bff99600/0x5c655bf666841ac2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x94:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd2f6 expref: 46 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305741:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x94:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562569.305753:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7800/0x5c655bf6668418d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x92:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd263 expref: 45 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305762:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x92:0x0].0x0 (ffff90e9907b8600) 00010000:00010000:1.0:1786562569.305771:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6de00/0x5c655bf66684176c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x8d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd1ec expref: 44 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305783:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7000/0x5c655bf666841638 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x8d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdd191 expref: 43 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305792:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8d:0x0].0x0 (ffff90e999bb1b00) 00010000:00010000:1.0:1786562569.305803:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf666841073 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcfbc expref: 42 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305834:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x8b:0x0].0x0 (ffff90e9907b8100) 00010000:00010000:1.0:1786562569.305846:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf666840e7b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x86:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcf29 expref: 41 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305860:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81cc00/0x5c655bf666840d47 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x86:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcece expref: 40 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305870:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x86:0x0].0x0 (ffff90e9907b8400) 00010000:00010000:1.0:1786562569.305892:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6ce00/0x5c655bf66684096c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x81:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcd8c expref: 39 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305907:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9af81ce00/0x5c655bf66684084d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x81:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcd38 expref: 38 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305916:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x81:0x0].0x0 (ffff90e983a9ab00) 00010000:00010000:1.0:1786562569.305927:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f7a00/0x5c655bf6668404e9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcc12 expref: 37 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305936:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7f:0x0].0x0 (ffff90e99254f600) 00010000:00010000:1.0:1786562569.305949:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0c600/0x5c655bf666840392 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x7a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcba9 expref: 36 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305961:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f6e00/0x5c655bf66684022d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x7a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdcb40 expref: 35 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305975:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x7a:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:1.0:1786562569.305986:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1800/0x5c655bf66683fabd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc8e6 expref: 34 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.305997:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x76:0x0].0x0 (ffff90e994ad3e00) 00010000:00010000:1.0:1786562569.306070:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6c400/0x5c655bf66683f8cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc845 expref: 33 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306080:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x75:0x0].0x0 (ffff90e983a9a000) 00010000:00010000:1.0:1786562569.306091:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6c200/0x5c655bf66683f6d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x70:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc7ab expref: 32 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306102:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf66683f5b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x70:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc757 expref: 31 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306113:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x70:0x0].0x0 (ffff90e994289500) 00010000:00010000:1.0:1786562569.306126:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f6200/0x5c655bf66683f1fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x6b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc61c expref: 30 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306140:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf66683f0c2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x6b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc5c1 expref: 29 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306152:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x6b:0x0].0x0 (ffff90e9907b8c00) 00010000:00010000:1.0:1786562569.306162:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6cc00/0x5c655bf66683ed1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc486 expref: 28 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306174:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x6a:0x0].0x0 (ffff90e994289200) 00010000:00010000:1.0:1786562569.306184:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6c600/0x5c655bf66683e98a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x68:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc36e expref: 27 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306193:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x68:0x0].0x0 (ffff90e9907b8000) 00010000:00010000:1.0:1786562569.306203:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9883f6000/0x5c655bf66683e77d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x63:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc2c6 expref: 26 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306216:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bfc6d200/0x5c655bf66683e65e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x63:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc272 expref: 25 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306224:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63:0x0].0x0 (ffff90e983a9ae00) 00010000:00010000:1.0:1786562569.306232:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556600/0x5c655bf66683e125 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdc0b2 expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306240:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x61:0x0].0x0 (ffff90e994289c00) 00010000:00010000:1.0:1786562569.306248:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557c00/0x5c655bf66683decb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbff5 expref: 23 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306258:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0ce00/0x5c655bf66683dea1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbfe7 expref: 22 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306269:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988556400/0x5c655bf66683de77 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbfd9 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306283:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5e:0x0].0x0 (ffff90e994289f00) 00010000:00010000:1.0:1786562569.306294:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e6600/0x5c655bf66683dc1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbf23 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306302:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5b:0x0].0x0 (ffff90e982cfc900) 00010000:00010000:1.0:1786562569.306312:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e7000/0x5c655bf66683dbe5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbf15 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306325:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e6800/0x5c655bf66683dbc9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbf0e expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306333:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x58:0x0].0x0 (ffff90e982cfcc00) 00010000:00010000:1.0:1786562569.306342:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e881f0d600/0x5c655bf66683d8b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x57:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbdf6 expref: 17 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306351:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x57:0x0].0x0 (ffff90e994ad3200) 00010000:00010000:1.0:1786562569.306362:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9200/0x5c655bf66683d826 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbdcc expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306374:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d8000/0x5c655bf66683d803 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x53:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbdc5 expref: 15 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306382:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x53:0x0].0x0 (ffff90e983adfe00) 00010000:00010000:1.0:1786562569.306391:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e8820e7800/0x5c655bf66683d4b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x52:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbc98 expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306402:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x52:0x0].0x0 (ffff90e999972700) 00010000:00010000:1.0:1786562569.306417:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e988557000/0x5c655bf66683d421 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbc6e expref: 13 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306425:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4c:0x0].0x0 (ffff90e994289000) 00010000:00010000:1.0:1786562569.306438:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9ba9d9000/0x5c655bf66683d085 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbb33 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.306446:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4b:0x0].0x0 (ffff90e983adf500) 00010000:00010000:1.0:1786562569.306453:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562569.306554:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:56884:x1873345652872832:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2148us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562569.306566:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 983 00000100:00100000:2.0:1786562569.474462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562569.474514:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562569.474594:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652873088 00000100:00100000:1.0:1786562569.474612:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652873088 00000100:00100000:0.0:1786562569.474645:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652872960 00000100:00100000:0.0:1786562569.474656:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652872960 00000100:00100000:1.0:1786562569.474786:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 984 00000100:00100000:1.0:1786562569.474801:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:64169:x1873345652873088:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562569.474834:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 15 locks, starting at 0 00002000:00010000:1.0:1786562569.474863:0:35896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x136:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:1.0:1786562569.474867:0:35896:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x136:0x0] updating lvb atime from disk: 0 -> 1786562271 00002000:00010000:1.0:1786562569.474870:0:35896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x136:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1786562569.474915:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539c1b72/0x5c655bf66683de93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x136:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbfe0 expref: 22 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562569.474959:0:35896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1786562569.474963:0:35896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb mtime from disk: 0 -> 1786562568 00002000:00010000:1.0:1786562569.474966:0:35896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb ctime from disk: 0 -> 1786562568 00002000:00010000:1.0:1786562569.474968:0:35896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1786562569.474977:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030de82c4/0x5c655bf66689f746 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfcd expref: 21 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475064:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1420dd7/0x5c655bf66689f674 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf48 expref: 20 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475093:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187d4fc0/0x5c655bf66689f620 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf25 expref: 19 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475116:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b11c20f/0x5c655bf66689f604 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf17 expref: 18 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475140:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f5fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf09 expref: 17 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475163:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068f8c621/0x5c655bf66689f5f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf02 expref: 16 pid: 12119 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475186:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001caf612b/0x5c655bf66689f49f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcefb expref: 15 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.475210:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d1dbc4/0x5c655bf66689f491 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcee6 expref: 14 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476133:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5516c4f/0x5c655bf6668969e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf875e expref: 13 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476172:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f50abb4/0x5c655bf6668969c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf8742 expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476198:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9f37ea/0x5c655bf66683a3c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x124:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdab11 expref: 11 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476221:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eead6ae6/0x5c655bf66683a081 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x122:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda9f9 expref: 10 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476255:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000129b7624/0x5c655bf66683a09d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x123:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdaa00 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476280:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5b569/0x5c655bf666838808 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda450 expref: 8 pid: 29965 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476294:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562569.476395:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:64169:x1873345652873088:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1597us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562569.476406:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 984 00000100:00100000:1.0:1786562569.476457:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 985 00000100:00100000:1.0:1786562569.476471:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:49279:x1873345652872960:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562569.476490:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 25 locks, starting at 0 00002000:00010000:1.0:1786562569.476506:0:35896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb mtime from disk: 1786562194 -> 1786562195 00002000:00010000:1.0:1786562569.476509:0:35896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb ctime from disk: 1786562194 -> 1786562195 00010000:00010000:1.0:1786562569.476521:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099172ea/0x5c655bf66683a11b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdaa2a expref: 30 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476550:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001df72081/0x5c655bf66683a391 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdaafc expref: 29 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562569.476569:0:35896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe0:0x0] updating lvb size from disk: 0 -> 3393 00002000:00010000:1.0:1786562569.476572:0:35896:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xe0:0x0] updating lvb atime from disk: 1786562123 -> 1786562131 00002000:00010000:1.0:1786562569.476574:0:35896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe0:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1786562569.476582:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002edefb65/0x5c655bf6668385a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda3af expref: 28 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476606:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f096aa1e/0x5c655bf66689f66d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf41 expref: 27 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476645:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf66689f666 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf3a expref: 26 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476670:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc13064/0x5c655bf66689f65f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf33 expref: 25 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476694:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6f5471/0x5c655bf66689f619 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf2c expref: 24 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476716:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f3a38fe/0x5c655bf66689f612 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf1e expref: 23 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476739:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e55f0a/0x5c655bf66689f60b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf10 expref: 22 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476761:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b926ce/0x5c655bf66689f4a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcef4 expref: 21 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476782:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef5f58f/0x5c655bf66689f498 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfceed expref: 20 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562569.476800:0:35896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6e6:0x0] updating lvb size from disk: 0 -> 44212 00002000:00010000:1.0:1786562569.476803:0:35896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6e6:0x0] updating lvb mtime from disk: 0 -> 1786562378 00002000:00010000:1.0:1786562569.476805:0:35896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6e6:0x0] updating lvb ctime from disk: 0 -> 1786562378 00002000:00010000:1.0:1786562569.476807:0:35896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6e6:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:1.0:1786562569.476828:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aafa1d99/0x5c655bf66688e34b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf5761 expref: 19 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476854:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bebd893/0x5c655bf6668969e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf8757 expref: 18 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.476876:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d531e5f/0x5c655bf6668969da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf8750 expref: 17 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479685:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082f5c51d/0x5c655bf6668969cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cf8749 expref: 16 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479717:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fad3b0c/0x5c655bf66683dbbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x117:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbf07 expref: 15 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479741:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6338efc/0x5c655bf66683dbad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x118:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbf00 expref: 14 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479765:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8704c7b/0x5c655bf66683d7ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x115:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbdbe expref: 13 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479790:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040f21c95/0x5c655bf66683d7d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x116:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbdb7 expref: 12 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479825:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d20809/0x5c655bf66683d356 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x114:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdbc36 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.479854:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeee7bcc/0x5c655bf66683cba7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdb9ce expref: 10 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562569.479876:0:35896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb blocks from disk: 1 -> 3 00010000:00010000:1.0:1786562569.480758:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000377976ab/0x5c655bf66683a0a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cdaa07 expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562569.480802:0:35896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xf1:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1786562569.480806:0:35896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xf1:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1786562569.481544:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942c27df/0x5c655bf666839e51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda943 expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.481598:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263061d7/0x5c655bf666838d5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda5a7 expref: 7 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.481638:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050039df9/0x5c655bf666838801 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda457 expref: 6 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562569.481652:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562569.481809:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+5:49279:x1873345652872960:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5340us (7291us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562569.481834:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 985 00000004:00080000:1.0:1786562569.509847:0:33136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1001951831318ns, next at 1002951827965ns, rc = 0 00000100:00100000:1.0:1786562569.509874:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562569.509913:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654895872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562569.510037:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562569.510130:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654895872 00000100:00100000:1.0:1786562569.510139:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654895872 00000100:00100000:1.0:1786562569.510210:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1786562569.510223:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654895872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562569.510254:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 518062080 pending 1703936 free 3828350976 avail 3825205248 00000100:00100000:1.0:1786562569.510309:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654895872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562569.510317:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:1.0:1786562569.510342:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562569.510375:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843603 gen 2 00000004:00080000:1.0:1786562569.510381:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c52e680, transno 21474843603 00000100:00100000:1.0:1786562569.510402:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654895872:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1786562569.510922:0:33139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1001952915750ns, next at 1002952913655ns, rc = 0 00000100:00100000:3.0:1786562569.511289:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654896000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562569.511342:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562569.511402:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896000 00000100:00100000:3.0:1786562569.511408:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896000 00000100:00100000:0.0:1786562569.512079:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654896128:0@lo:400:kworker.0 00000100:00100000:0.0:1786562569.512131:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562569.512164:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786562569.512170:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654896512:0@lo:400:kworker.0 00000100:00100000:0.0:1786562569.512199:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562569.512231:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896128 00000100:00100000:0.0:1786562569.512235:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896128 00000100:00100000:0.0:1786562569.512272:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1786562569.512281:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654896128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562569.512333:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654896128:12345-0@lo:400:kworker.0 Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562569.512341:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1786562569.512403:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654896128:0@lo:400:kworker.0 00000100:00100000:0.0:1786562569.512426:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654896256:0@lo:400:kworker.0 00000100:00100000:2.0:1786562569.513060:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654896384:0@lo:400:kworker.0 00000100:00100000:2.0:1786562569.513098:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562569.513151:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896512 00000100:00100000:2.0:1786562569.513156:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896512 00000100:00100000:2.0:1786562569.513190:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896384 00000100:00100000:2.0:1786562569.513193:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896384 00000100:00100000:2.0:1786562569.513217:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1786562569.513224:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654896512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562569.513268:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654896512:12345-0@lo:400:kworker.0 Request processed in 44us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562569.513275:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1786562569.513290:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1786562569.513296:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654896384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562569.513326:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654896384:12345-0@lo:400:kworker.0 Request processed in 29us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562569.513332:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1786562569.513369:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654896384:0@lo:400:kworker.0 00000100:00100000:2.0:1786562569.513394:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654896512:0@lo:400:kworker.0 00000100:00080000:2.0:1786562569.513440:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562569.514547:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1786562569.514565:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654896000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562569.514595:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 352911360 pending 0 free 3829399552 avail 3827302400 00000100:00100000:3.0:1786562569.514690:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654896000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (3346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562569.514697:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:2.0:1786562569.516021:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562569.516220:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654896000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562569.516912:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562569.517821:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896256 00000100:00100000:2.0:1786562569.517835:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896256 00000100:00080000:1.0:1786562569.518213:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562569.518325:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1786562569.518338:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654896256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562569.518603:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654896256:0@lo:400:kworker.0 00000100:00100000:2.0:1786562569.519127:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654896256:12345-0@lo:400:kworker.0 Request processed in 791us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562569.519138:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000001:00100000:1.0:1786562569.610327:0:27136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16a695a0-b685-4180-8888-8ba29614d6e8 00000001:00080000:1.0:1786562569.610349:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876090 is committed 00010000:00010000:1.0:1786562570.021931:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562570.125340:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950687 is committed 00000004:00080000:1.0:1786562570.125364:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2889 committed 00000001:00080000:1.0:1786562570.125376:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950689 is committed 00000001:00100000:1.0:1786562570.125386:0:33119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16a695a0-b685-4180-8888-8ba29614d6e8 00000004:00080000:1.0:1786562570.125394:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2917 committed 00000100:00100000:2.0:1786562570.125835:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654896640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.125935:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126000:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.126053:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126074:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.126100:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126118:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654898176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.126141:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126166:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786562570.126172:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.126194:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126210:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.126231:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126246:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654898048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.126265:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126296:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654896896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.126322:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126339:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.126360:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126375:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.126394:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.126411:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654898432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.126431:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.127752:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1786562570.127768:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654896768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.127850:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.127872:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786562570.127894:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.127915:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.127936:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.127954:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654898304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562570.127977:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562570.128039:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896640 00000100:00100000:2.0:1786562570.128050:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896640 00000100:00100000:2.0:1786562570.128100:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897152 00000100:00100000:2.0:1786562570.128104:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897152 00000100:00100000:2.0:1786562570.128114:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897664 00000100:00100000:2.0:1786562570.128117:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897664 00000100:00100000:2.0:1786562570.128129:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654898176 00000100:00100000:2.0:1786562570.128132:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654898176 00000100:00100000:2.0:1786562570.128141:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897024 00000100:00100000:2.0:1786562570.128144:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897024 00000100:00100000:2.0:1786562570.128154:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897536 00000100:00100000:2.0:1786562570.128157:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897536 00000100:00100000:2.0:1786562570.128167:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654898048 00000100:00100000:2.0:1786562570.128169:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654898048 00000100:00100000:2.0:1786562570.128179:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896896 00000100:00100000:2.0:1786562570.128181:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896896 00000100:00100000:2.0:1786562570.128192:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897408 00000100:00100000:2.0:1786562570.128195:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897408 00000100:00100000:2.0:1786562570.128206:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897920 00000100:00100000:2.0:1786562570.128209:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897920 00000100:00100000:2.0:1786562570.128218:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654898432 00000100:00100000:2.0:1786562570.128220:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654898432 00000100:00100000:2.0:1786562570.128230:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654896768 00000100:00100000:2.0:1786562570.128232:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654896768 00000100:00100000:2.0:1786562570.128241:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897280 00000100:00100000:2.0:1786562570.128243:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897280 00000100:00100000:2.0:1786562570.128250:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654897792 00000100:00100000:2.0:1786562570.128252:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654897792 00000100:00100000:2.0:1786562570.128261:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654898304 00000100:00100000:2.0:1786562570.128264:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654898304 00000100:00100000:2.0:1786562570.128279:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17839 00000100:00100000:2.0:1786562570.128289:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3290:x1873345654896640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786562570.128333:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1839 count 1 00002000:00010000:2.0:1786562570.128379:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72f:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x807 00010000:00010000:2.0:1786562570.128390:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.128412:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:2.0:1786562570.128417:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562570.128425:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.128861:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.128874:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.128884:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.128913:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786562570.131960:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562570.131982:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.132000:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562570.132021:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.132035:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.132063:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.132073:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e761dd/0x5c655bf66689f770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.132105:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562570.132107:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562570.132109:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562570.133200:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17840 00000100:00100000:1.0:1786562570.133220:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654897152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562570.133263:0:29965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1842 count 1 00002000:00010000:1.0:1786562570.133303:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x732:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:1.0:1786562570.133311:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.133328:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.133333:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.133341:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.133355:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.133365:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.133372:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.133392:0:29965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786562570.134066:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654897152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 851us (8009us total) trans 21474843607 rc 0/0 00000100:00100000:1.0:1786562570.134077:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17840 00000100:00100000:1.0:1786562570.134114:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17841 00000100:00100000:1.0:1786562570.134123:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654897664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786562570.134146:0:29965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1812 count 1 00002000:00010000:1.0:1786562570.134173:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x714:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x1807 00010000:00010000:1.0:1786562570.134179:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134191:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.134195:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.134200:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134214:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134222:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134230:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134266:0:29965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786562570.134817:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654897664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 695us (8714us total) trans 17179876091 rc 0/0 00000100:00100000:1.0:1786562570.134826:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17841 00000100:00100000:1.0:1786562570.134847:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17842 00000100:00100000:1.0:1786562570.134855:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654898176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786562570.134870:0:29965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1810 count 1 00002000:00010000:1.0:1786562570.134892:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x712:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:1.0:1786562570.134898:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134908:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.134911:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.134916:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134925:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134933:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134940:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.134967:0:29965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1786562570.135343:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654898176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 489us (9200us total) trans 17179876092 rc 0/0 00000100:00100000:1.0:1786562570.135350:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17842 00000100:00100000:1.0:1786562570.135364:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17843 00000100:00100000:1.0:1786562570.135372:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654897024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562570.135387:0:29965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1841 count 1 00002000:00010000:1.0:1786562570.135407:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x731:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:1.0:1786562570.135413:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.135422:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.135426:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.135430:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.135440:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.135448:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.135455:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.135477:0:29965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1786562570.137079:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786562570.137094:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137109:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.137115:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137126:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137151:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137160:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265b2f75/0x5c655bf66689f777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137182:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786562570.137187:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137195:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.137199:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137207:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137217:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137225:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f96ef253/0x5c655bf66689f77e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137236:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786562570.137240:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137245:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.137248:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137255:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137264:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137272:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5c8a0/0x5c655bf66689f785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137285:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562570.137288:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137295:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.137298:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137305:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137314:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137321:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bf96a5/0x5c655bf66689f78c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.137332:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562570.137335:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562570.137336:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786562570.138058:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98553c380/2, rc 0, transno 21474843608 00000100:00100000:0.0:1786562570.138073:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897024:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1786562570.138088:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1e680/2, rc 0, transno 21474843606 00000100:00100000:0.0:1786562570.138092:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654896640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1786562570.138101:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98553ce00/2, rc 0, transno 21474843607 00000100:00100000:0.0:1786562570.138105:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786562570.138117:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876090 gen 2 00000004:00080000:0.0:1786562570.138121:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b46e5c00, transno 17179876090 00000100:00100000:0.0:1786562570.138140:0:3290:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e88aebbb80 x1873345654897664/t17179876091(17179876091) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786562586 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562570.138149:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebbb80/2, rc 0, transno 17179876091 00000100:00100000:0.0:1786562570.138153:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897664:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786562570.138163:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fca80/2, rc 0, transno 17179876092 00000100:00100000:0.0:1786562570.138166:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654898176:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786562570.138187:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562570.139667:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17844 00000100:00100000:0.0:1786562570.139693:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654897536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786562570.139735:0:29967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1811 count 1 00002000:00010000:0.0:1786562570.139782:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x713:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x809 00010000:00010000:0.0:1786562570.139803:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.139824:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:0.0:1786562570.139829:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562570.139837:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.139854:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.139865:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.139873:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.139899:0:29967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562570.141534:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654897536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1845us (15292us total) trans 17179876093 rc 0/0 00000100:00100000:0.0:1786562570.141549:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17844 00000100:00100000:0.0:1786562570.141592:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17845 00000100:00100000:0.0:1786562570.141617:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654898048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786562570.141652:0:29967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1815 count 1 00002000:00010000:0.0:1786562570.141685:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x717:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x3 00010000:00010000:0.0:1786562570.141694:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.141712:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x717:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:0.0:1786562570.141716:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562570.141723:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.141737:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.141747:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.141755:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.141781:0:29967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786562570.142911:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3290:x1873345654896640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4708us (7062us total) trans 21474843606 rc 0/0 00000100:00100000:2.0:1786562570.142935:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17839 00000100:00100000:2.0:1786562570.142980:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17846 00000100:00100000:2.0:1786562570.142995:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654896896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786562570.143038:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1837 count 1 00002000:00010000:2.0:1786562570.143073:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:2.0:1786562570.143081:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.143097:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:2.0:1786562570.143102:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562570.143107:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.143121:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.143131:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.143138:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.143165:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786562570.143973:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654896896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 981us (17646us total) trans 21474843609 rc 0/0 00000100:00100000:2.0:1786562570.143984:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17846 00000100:00100000:2.0:1786562570.144036:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17847 00000100:00100000:2.0:1786562570.144047:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654897408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786562570.144069:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1844 count 1 00002000:00010000:2.0:1786562570.144095:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x734:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x3 00010000:00010000:2.0:1786562570.144102:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144115:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x734:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:2.0:1786562570.144119:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562570.144124:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144134:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144143:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144150:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144160:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1786562570.144540:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654897408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 495us (18178us total) trans 21474843610 rc 0/0 00000100:00100000:2.0:1786562570.144547:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17847 00000100:00100000:2.0:1786562570.144565:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17848 00000100:00100000:2.0:1786562570.144574:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654897920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786562570.144592:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1814 count 1 00002000:00010000:2.0:1786562570.144630:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x716:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x807 00010000:00010000:2.0:1786562570.144636:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144648:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:2.0:1786562570.144651:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562570.144655:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144665:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144673:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144681:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.144690:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1786562570.145195:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654897920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 622us (18798us total) trans 17179876094 rc 0/0 00000100:00100000:2.0:1786562570.145202:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17848 00000100:00100000:2.0:1786562570.145219:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17849 00000100:00100000:2.0:1786562570.145228:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654898432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786562570.145249:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1817 count 1 00002000:00010000:2.0:1786562570.145269:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x719:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:2.0:1786562570.145274:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.145291:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:2.0:1786562570.145295:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562570.145299:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.145309:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.145317:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.145325:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562570.145334:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1786562570.146290:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654898048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4683us (20018us total) trans 17179876095 rc 0/0 00000100:00100000:0.0:1786562570.146300:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17845 00000100:00100000:0.0:1786562570.146328:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17850 00000100:00100000:0.0:1786562570.146338:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654896768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786562570.146364:0:29967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1840 count 1 00002000:00010000:0.0:1786562570.146389:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x730:0x0] initial LVB size: 4194304, mtime: 0x6a7cc7ec, atime: 0x6a7cc7ec, ctime: 0x6a7cc7ef, blocks: 0x1007 00010000:00010000:0.0:1786562570.146397:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.146410:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:0.0:1786562570.146413:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562570.146417:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.146428:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.148324:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.148338:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.148360:0:29967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1786562570.152980:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3290:x1873345654897024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 560us (9735us total) trans 21474843608 rc 0/0 00000100:00100000:1.0:1786562570.153023:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17843 00000100:00100000:1.0:1786562570.153258:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17851 00000100:00100000:1.0:1786562570.153280:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1873345654897280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562570.153322:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1843 count 1 00002000:00010000:1.0:1786562570.153367:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x733:0x0] initial LVB size: 5182624, mtime: 0x6a7cc7ef, atime: 0x0, ctime: 0x6a7cc7ef, blocks: 0x7af 00010000:00010000:1.0:1786562570.153379:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.153403:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.153409:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.153416:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.153446:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.153458:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.153466:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.153487:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1786562570.154219:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654897280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 948us (26321us total) trans 21474843611 rc 0/0 00000100:00100000:1.0:1786562570.154229:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17851 00000100:00100000:1.0:1786562570.154254:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17852 00000100:00100000:1.0:1786562570.154263:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654897792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786562570.154284:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1813 count 1 00002000:00010000:1.0:1786562570.154312:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x715:0x0] initial LVB size: 3145728, mtime: 0x6a7cc7ed, atime: 0x0, ctime: 0x6a7cc7ed, blocks: 0x1007 00010000:00010000:1.0:1786562570.154318:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154329:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.154332:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.154336:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154347:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154354:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154361:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154375:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:1.0:1786562570.154873:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654897792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 611us (26933us total) trans 17179876096 rc 0/0 00000100:00100000:1.0:1786562570.154881:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17852 00000100:00100000:1.0:1786562570.154900:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17853 00000100:00100000:1.0:1786562570.154909:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654898304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786562570.154927:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1816 count 1 00002000:00010000:1.0:1786562570.154948:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x718:0x0] initial LVB size: 8388608, mtime: 0x6a7cc7ee, atime: 0x0, ctime: 0x6a7cc7ee, blocks: 0x2007 00010000:00010000:1.0:1786562570.154954:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154963:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=1002s v=(0 0) 00010000:00010000:1.0:1786562570.154967:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562570.154971:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154981:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154990:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.154997:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155032:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:1.0:1786562570.155443:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654898304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 534us (27464us total) trans 17179876097 rc 0/0 00000100:00100000:1.0:1786562570.155451:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17853 00010000:00010000:1.0:1786562570.155483:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1786562570.155491:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155500:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562570.155506:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155516:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155537:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155545:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf66689f793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155570:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1786562570.155574:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155585:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562570.155588:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155594:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155616:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155623:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb46e21/0x5c655bf66689f79a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155635:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1786562570.155639:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155645:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562570.155648:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155655:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155665:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155672:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f7a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155686:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1786562570.155690:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155696:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562570.155699:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.155706:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157163:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786562570.157179:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157194:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.157200:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157210:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157241:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157250:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095759b7d/0x5c655bf66689f7af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157280:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786562570.157284:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157290:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.157294:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157302:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157323:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157330:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfd83696/0x5c655bf66689f7b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157343:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786562570.157348:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157355:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.157358:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157365:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157376:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157383:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca2a7e50/0x5c655bf66689f7bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157399:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786562570.157403:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157410:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.157413:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157426:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157436:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157444:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d8f4/0x5c655bf66689f7c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157461:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786562570.157465:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157471:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.157474:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157482:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157491:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157500:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d488462b/0x5c655bf66689f7cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157519:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562570.157522:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157528:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562570.157531:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157537:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157546:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157552:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008af68ea/0x5c655bf66689f7d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.157562:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562570.157564:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562570.157565:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562570.158773:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3292:x1873345654896768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12426us (30910us total) trans 21474843612 rc 0/0 00000100:00100000:0.0:1786562570.158791:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17850 00000004:00080000:0.0:1786562570.159058:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88aebad80/2, rc 0, transno 17179876093 00000100:00100000:0.0:1786562570.159067:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654897536:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786562570.159081:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fc380/2, rc 0, transno 17179876095 00000100:00100000:0.0:1786562570.159086:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654898048:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786562570.159109:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562570.159134:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786562570.159392:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf07b80/2, rc 0, transno 21474843612 00000100:00100000:3.0:1786562570.159400:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654896768:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786562570.159412:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98553d880/2, rc 0, transno 21474843611 00000100:00100000:3.0:1786562570.159415:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897280:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786562570.159425:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fc000/2, rc 0, transno 17179876096 00000100:00100000:3.0:1786562570.159430:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897792:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786562570.159441:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fdf80/2, rc 0, transno 17179876097 00000100:00100000:3.0:1786562570.159444:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654898304:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786562570.159455:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf04e00/2, rc 0, transno 21474843609 00000100:00100000:3.0:1786562570.159458:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654896896:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786562570.159468:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a994bb80/2, rc 0, transno 21474843610 00000100:00100000:3.0:1786562570.159471:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897408:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786562570.159481:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fd180/2, rc 0, transno 17179876094 00000100:00100000:3.0:1786562570.159485:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654897920:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786562570.164118:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562570.166068:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1873345654898432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20829us (39622us total) trans 17179876098 rc 0/0 00000100:00100000:2.0:1786562570.166088:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17849 00000004:00080000:3.0:1786562570.166534:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa16680/2, rc 0, transno 17179876098 00000100:00100000:3.0:1786562570.166543:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654898432:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786562570.171706:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562570.171720:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf66689f7a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.171820:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562570.171824:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562570.171827:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562570.788920:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562570.788985:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652873216 00000100:00100000:0.0:1786562570.788995:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652873216 00000100:00100000:0.0:1786562570.789088:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17145 00000100:00100000:0.0:1786562570.789099:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+6:64865:x1873345652873216:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562570.789125:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562570.789150:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689f7d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfe2 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.789220:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689f7e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.789235:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.789248:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562570.789450:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562570.789455:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 37 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562570.789530:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.789555:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689f7d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfe2 expref: 8 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.789577:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689f7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfe2 expref: 7 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562570.789586:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:0.0:1786562570.789599:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562570.789604:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562570.789662:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:64865:x1873345652873216:12345-192.168.204.29@tcp:101:dd.0 Request processed in 565us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562570.789669:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17145 00000100:00080000:2.0:1786562570.789877:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562570.794169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562570.796931:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652873472 00000100:00100000:3.0:1786562570.796944:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652873472 00000100:00100000:3.0:1786562570.797015:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17146 00000100:00100000:3.0:1786562570.797027:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:64865:x1873345652873472:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:3.0:1786562570.797047:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562570.797050:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562570.797076:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689f7e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfe2 expref: 7 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797093:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:3.0:1786562570.797209:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562570.797226:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf66689f7e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcfe9 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797634:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797647:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797657:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797681:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797690:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562570.797697:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00020000:3.0:1786562570.798173:0:33140:0:(mdt_open.c:1761:mdt_reint_open()) cfs_fail_timeout id 175 sleeping for 10000ms 00010000:00010000:3.0:1786562571.045179:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562572.070463:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562573.093376:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786562573.144899:0:37360:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mirror extend 00000100:00100000:1.0:1786562573.248483:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562573.248565:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652873600 00000100:00100000:0.0:1786562573.248581:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652873600 00000100:00100000:0.0:1786562573.248656:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17147 00000100:00100000:0.0:1786562573.248667:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:16a695a0-b685-4180-8888-8ba29614d6e8+5:65002:x1873345652873600:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562573.248687:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562573.248707:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f7fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcff0 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.248785:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f803 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.248799:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.248809:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562573.249023:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562573.249028:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 37 stripe count 1 MDT count 1 00000100:00080000:2.0:1786562573.249050:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1786562573.249109:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.249134:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689f7fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcff0 expref: 7 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.249149:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcff0 expref: 6 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.249157:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:0.0:1786562573.249160:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562573.249163:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269a00, rc 0) 00000100:00100000:0.0:1786562573.249225:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:16a695a0-b685-4180-8888-8ba29614d6e8+6:65002:x1873345652873600:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 560us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562573.249232:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17147 00000100:00100000:1.0:1786562573.270373:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562573.270441:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652873856 00000100:00100000:2.0:1786562573.270456:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652873856 00000100:00100000:2.0:1786562573.270575:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17148 00000100:00100000:2.0:1786562573.270586:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+6:65002:x1873345652873856:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562573.270608:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562573.270629:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf66689f80a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcff7 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.270718:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.270731:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.270742:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.270753:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.270760:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.270766:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271225:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f81f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271236:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f81f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271244:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f81f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562573.271254:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00010000:00010000:2.0:1786562573.271375:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271387:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271393:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271399:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562573.271402:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271409:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271421:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:2.0:1786562573.271423:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562573.271427:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271432:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271441:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271446:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271451:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271455:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562573.271458:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271464:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271470:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e999bb1400) 00010000:00010000:2.0:1786562573.271473:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562573.271475:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271480:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271513:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf66689f80a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcff7 expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271528:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f81f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcff7 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.271535:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562573.271537:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562573.271539:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfcc00, rc 0) 00000100:00100000:2.0:1786562573.271623:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652873856:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1038us (1264us total) trans 8589950690 rc 0/0 00000100:00100000:2.0:1786562573.271632:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17148 00000100:00100000:3.0:1786562573.280898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562573.285033:0:33124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652873984 00000100:00100000:1.0:1786562573.285054:0:33124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652873984 00000100:00100000:1.0:1786562573.285151:0:33124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1786562573.285164:0:33124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652873984:12345-192.168.204.29@tcp:700:lfs.0 00000100:00100000:1.0:1786562573.285316:0:33124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652873984:12345-192.168.204.29@tcp:700:lfs.0 Request processed in 155us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562573.285326:0:33124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1786562573.302147:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.302478:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652874240 00000100:00100000:3.0:1786562573.302491:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652874240 00000100:00100000:3.0:1786562573.302587:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17149 00000100:00100000:3.0:1786562573.302600:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652874240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562573.302630:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562573.310048:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562573.310123:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f803 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcff0 expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.310161:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562573.310729:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562573.315094:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f82d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfcffe expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.336987:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.337039:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.337055:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562573.337071:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 0 00010000:00010000:1.0:1786562573.337149:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689f82d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.337483:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.337496:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562573.337500:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562573.337504:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4881a00, rc 0) 00000100:00100000:1.0:1786562573.337623:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652874240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 35024us (35489us total) trans 8589950691 rc 0/0 00000100:00100000:1.0:1786562573.337633:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17149 00000100:00100000:1.0:1786562573.350069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.350455:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652874496 00000100:00100000:3.0:1786562573.350469:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652874496 00000100:00100000:3.0:1786562573.350564:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17150 00000100:00100000:3.0:1786562573.350579:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652874496:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562573.350617:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562573.350647:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf66689f842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd005 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.350797:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.350814:0:33113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.350825:0:33113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.350869:0:33113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.350885:0:33113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 10 pid: 35929 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562573.350901:0:33113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654898560:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562573.351047:0:33113:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881821d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562573.361229:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562573.362631:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652874624 00000100:00100000:0.0:1786562573.362648:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652874624 00010000:00010000:0.0:1786562573.362728:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 11 pid: 35929 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562573.362783:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8737 00000100:00100000:0.0:1786562573.362797:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a695a0-b685-4180-8888-8ba29614d6e8+11:2348:x1873345652874624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562573.362821:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562573.362829:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 11 pid: 35929 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.362846:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 11 pid: 35929 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.362877:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:0.0:1786562573.362883:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.362896:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.362905:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.362933:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562573.363029:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a695a0-b685-4180-8888-8ba29614d6e8+11:2348:x1873345652874624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 235us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562573.363038:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8737 00010000:00010000:3.0:1786562573.363503:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881a00/0x5c655bf66689f834 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcffe expref: 10 pid: 35929 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562573.363527:0:33113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654898560:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562573.363565:0:33113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.363576:0:33113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.363583:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562573.363610:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 0 00000004:00080000:3.0:1786562573.364083:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x736:0x0], index 0: 0 00000004:00080000:3.0:1786562573.364097:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71a:0x0], index 1: 0 00010000:00010000:3.0:1786562573.364294:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364304:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364311:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364317:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562573.364321:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364330:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364352:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562573.364355:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562573.364359:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364365:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f849 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364433:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf66689f842 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd005 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364445:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562573.364448:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562573.364452:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf66689f842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd005 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.364462:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca400, rc 0) 00000100:00100000:3.0:1786562573.364513:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652874496:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 13938us (14458us total) trans 8589950692 rc 301/301 00000100:00100000:3.0:1786562573.364524:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17150 00000100:00100000:1.0:1786562573.385557:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562573.385830:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652874880 00000100:00100000:2.0:1786562573.385843:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652874880 00000100:00100000:2.0:1786562573.385923:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6296 00000100:00100000:2.0:1786562573.385936:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652874880:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562573.386521:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652874880:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 584us (987us total) trans 8589950693 rc 0/0 00000100:00100000:2.0:1786562573.386530:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6296 00000100:00100000:1.0:1786562573.392258:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.392374:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875008 00000100:00100000:3.0:1786562573.392388:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875008 00000100:00080000:2.0:1786562573.392466:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562573.392476:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17854 00000100:00100000:3.0:1786562573.392491:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16a695a0-b685-4180-8888-8ba29614d6e8+5:2349:x1873345652875008:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562573.392516:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562573.392546:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd00c expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562573.392581:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x735:0x0] initial LVB size: 2097152, mtime: 0x6a7cc808, atime: 0x0, ctime: 0x6a7cc808, blocks: 0x803 00010000:00010000:3.0:1786562573.392603:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=1005s v=(0 0) 00010000:00010000:3.0:1786562573.392608:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562573.392619:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 6 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.392642:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 6 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.392658:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cba00, rc 0) 00000100:00100000:3.0:1786562573.393102:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652875008:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 240us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562573.393112:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17854 00000100:00100000:1.0:1786562573.403738:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562573.404047:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875136 00000100:00100000:0.0:1786562573.404062:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875136 00000100:00100000:0.0:1786562573.404145:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17151 00000100:00100000:0.0:1786562573.404414:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652875136:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562573.404459:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562573.404490:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f85e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd013 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.404597:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f865 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.404620:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.404633:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562573.404690:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 0 00000004:00200000:0.0:1786562573.404695:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562573.404717:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.404747:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f85e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd013 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.404764:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f865 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd013 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.404773:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b46aba00) 00010000:00010000:0.0:1786562573.404777:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786562573.404780:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:0.0:1786562573.404868:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16a695a0-b685-4180-8888-8ba29614d6e8+11:65002:x1873345652875136:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 711us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562573.405431:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17151 00000100:00100000:2.0:1786562573.409995:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562573.410148:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.410204:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875264 00000100:00100000:3.0:1786562573.410219:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875264 00000100:00100000:3.0:1786562573.410294:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875392 00000100:00100000:3.0:1786562573.410298:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875392 00000100:00100000:3.0:1786562573.410339:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17855 00000100:00100000:3.0:1786562573.410354:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652875264:12345-192.168.204.29@tcp:101:lfs.0 00000100:00100000:2.0:1786562573.410368:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17856 00010000:00010000:3.0:1786562573.410375:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1786562573.410387:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16a695a0-b685-4180-8888-8ba29614d6e8+5:2348:x1873345652875392:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562573.410399:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd01a expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.410408:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1786562573.410437:0:37002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562573.410456:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=1005s v=(0 0) 00010000:00010000:3.0:1786562573.410461:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562573.410471:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 7 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.410491:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 7 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.410506:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca400, rc 0) 00000100:00100000:3.0:1786562573.410579:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:16a695a0-b685-4180-8888-8ba29614d6e8+7:2348:x1873345652875264:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 229us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562573.410586:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17855 00010000:00010000:2.0:1786562573.410965:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd021 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562573.411002:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786562573.411071:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=1005s v=(0 0) 00010000:00010000:2.0:1786562573.411075:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562573.411087:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 6 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.411108:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 6 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.411121:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd800, rc 0) 00000100:00100000:2.0:1786562573.411179:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652875392:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 800us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562573.411188:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17856 00000100:00080000:2.0:1786562573.411224:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562573.421210:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.421305:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875648 00000100:00100000:3.0:1786562573.421323:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875648 00000100:00100000:3.0:1786562573.421397:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17152 00000100:00100000:3.0:1786562573.421409:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a695a0-b685-4180-8888-8ba29614d6e8+11:65002:x1873345652875648:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562573.421430:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562573.421451:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f87a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd028 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.421574:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f881 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.421589:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f881 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.421601:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f881 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562573.421618:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00010000:00010000:3.0:1786562573.421807:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f87a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd028 expref: 14 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.421827:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f881 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd028 expref: 13 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.421836:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:3.0:1786562573.421839:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562573.421842:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb800, rc 0) 00000100:00100000:3.0:1786562573.421951:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a695a0-b685-4180-8888-8ba29614d6e8+13:65002:x1873345652875648:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 544us (757us total) trans 8589950694 rc 0/0 00000100:00100000:3.0:1786562573.421960:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17152 00000100:00100000:3.0:1786562573.437381:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.437418:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875776 00000100:00100000:3.0:1786562573.437428:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875776 00000100:00100000:3.0:1786562573.437481:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17857 00000100:00100000:3.0:1786562573.437491:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652875776:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562573.437550:0:29963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437568:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562573.437573:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562573.437578:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437597:0:29963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437629:0:29963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437638:0:29963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437646:0:29963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437654:0:29963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562573.437659:0:29963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437667:0:29963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437681:0:29963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.437690:0:29963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f88f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562573.437772:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652875776:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 283us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562573.437781:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17857 00000100:00100000:0.0:1786562573.551910:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562573.552054:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652875904 00000100:00100000:2.0:1786562573.552065:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652875904 00000100:00100000:2.0:1786562573.552118:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17858 00000100:00100000:2.0:1786562573.552129:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a695a0-b685-4180-8888-8ba29614d6e8+7:2351:x1873345652875904:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:3.0:1786562573.619582:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843612 is committed 00000001:00080000:3.0:1786562573.619642:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843605 is committed 00000100:00100000:3.0:1786562573.624661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.624705:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562573.625274:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876032 00000100:00100000:2.0:1786562573.625284:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876032 00000100:00100000:2.0:1786562573.625348:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:2.0:1786562573.625358:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+13:2349:x1873345652876032:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562573.625438:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876160 00000100:00100000:1.0:1786562573.625443:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876160 00000100:00100000:1.0:1786562573.625496:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 297 00000100:00100000:1.0:1786562573.625504:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652876160:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562573.626213:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+13:2349:x1873345652876032:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 855us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562573.626224:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00080000:2.0:1786562573.626269:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562573.631466:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a695a0-b685-4180-8888-8ba29614d6e8+7:2351:x1873345652875904:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 79326us (79554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562573.631481:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17858 00000100:00100000:1.0:1786562573.633235:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652876160:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 7721us (8575us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562573.633251:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 297 00000100:00100000:3.0:1786562573.639169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.639300:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.644295:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.644323:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.644372:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876544 00000100:00100000:3.0:1786562573.644382:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876544 00000100:00100000:3.0:1786562573.644443:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876672 00000100:00100000:3.0:1786562573.644446:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876672 00000100:00100000:3.0:1786562573.644469:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11625 00000100:00100000:3.0:1786562573.644479:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16a695a0-b685-4180-8888-8ba29614d6e8+8:2349:x1873345652876544:12345-192.168.204.29@tcp:3:lfs.0 00000100:00100000:2.0:1786562573.644912:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11626 00000100:00100000:2.0:1786562573.644923:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:16a695a0-b685-4180-8888-8ba29614d6e8+8:2349:x1873345652876672:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562573.644962:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.644981:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562573.644986:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562573.644994:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.645030:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.645742:0:16005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.645757:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562573.645760:0:16005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562573.645765:0:16005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.645776:0:16005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562573.650312:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876416 00000100:00100000:0.0:1786562573.650328:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876416 00000100:00100000:0.0:1786562573.650400:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876288 00000100:00100000:0.0:1786562573.650402:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876288 00000100:00100000:0.0:1786562573.651020:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 457 00000100:00100000:0.0:1786562573.651034:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+5:2348:x1873345652876416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562573.651126:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+5:2348:x1873345652876416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (11968us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562573.651133:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 457 00000100:00100000:0.0:1786562573.651149:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 458 00000100:00100000:0.0:1786562573.651155:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+5:2349:x1873345652876288:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562573.651175:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+5:2349:x1873345652876288:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 21us (11876us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562573.651180:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 458 00000100:00080000:3.0:1786562573.651404:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562573.651411:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786562573.681685:0:16005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.681706:0:16005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.681717:0:16005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.681724:0:16005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562573.681728:0:16005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.681737:0:16005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.681757:0:16005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.681766:0:16005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf66689f89d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562573.681894:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16a695a0-b685-4180-8888-8ba29614d6e8+9:2349:x1873345652876544:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 37410us (37604us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562573.681905:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11625 00010000:00010000:0.0:1786562573.689291:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.689315:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.689324:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.689333:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfca00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562573.689338:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.689347:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.689371:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.689385:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000147b9997/0x5c655bf66689f896 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562573.689520:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652876672:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 44593us (45189us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562573.689543:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11626 00000100:00100000:3.0:1786562573.701456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562573.701514:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562573.701653:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876800 00000100:00100000:1.0:1786562573.701667:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876800 00000100:00100000:1.0:1786562573.701765:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652876928 00000100:00100000:1.0:1786562573.701769:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652876928 00000100:00100000:1.0:1786562573.701816:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11627 00000100:00100000:1.0:1786562573.701830:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:16a695a0-b685-4180-8888-8ba29614d6e8+8:2348:x1873345652876800:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:1.0:1786562573.701889:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.701918:0:13913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 8 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.701930:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786562573.701935:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562573.701941:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.702051:0:13913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 8 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.702069:0:13913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 8 pid: 37002 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562573.702089:0:13913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:13913:1873345654898688:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562573.702216:0:13913:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e883396e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562573.702453:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11628 00000100:00100000:2.0:1786562573.702470:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16a695a0-b685-4180-8888-8ba29614d6e8+8:2348:x1873345652876928:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562573.702496:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.702509:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562573.702514:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562573.702518:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.702527:0:16006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562573.705927:0:13913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:13913:1873345654898688:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562573.705970:0:13913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562573.712282:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562573.719942:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877056 00000100:00100000:0.0:1786562573.719963:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877056 00010000:00010000:0.0:1786562573.720053:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 9 pid: 37002 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562573.720118:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8738 00000100:00100000:0.0:1786562573.720130:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a695a0-b685-4180-8888-8ba29614d6e8+9:2348:x1873345652877056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562573.720151:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562573.720183:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 9 pid: 37002 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720199:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 9 pid: 37002 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720228:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de12fc9d/0x5c655bf66689f86c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd01a expref: 9 pid: 37002 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720249:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562573.720255:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562573.720262:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720272:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720284:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562573.720286:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562573.720290:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720297:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562573.720597:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562573.720677:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a695a0-b685-4180-8888-8ba29614d6e8+8:2348:x1873345652877056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 547us (8408us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562573.720685:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8738 00010000:00010000:1.0:1786562573.721274:0:13913:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.721290:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.727441:0:16006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562573.727468:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562573.907052:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843613 is committed 00000001:00080000:0.0:1786562573.907083:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843614 is committed 00002000:00010000:2.0:1786562573.907225:0:16006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1786562573.907229:0:16006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb mtime from disk: 0 -> 1786562572 00002000:00010000:2.0:1786562573.907232:0:16006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb ctime from disk: 0 -> 1786562572 00002000:00010000:2.0:1786562573.907235:0:16006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1786562573.907253:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.907271:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.907284:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.907293:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562573.907298:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.907309:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.907334:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907342:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562573.907343:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf66689f8ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907381:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907390:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907399:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562573.907404:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907414:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907434:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562573.907444:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562573.907481:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16a695a0-b685-4180-8888-8ba29614d6e8+7:2348:x1873345652876928:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 205010us (205958us total) trans 21474843614 rc 0/0 00000100:00100000:2.0:1786562573.907494:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11628 00000100:00100000:1.0:1786562573.907544:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652876800:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 205700us (206086us total) trans 21474843613 rc 0/0 00000100:00100000:1.0:1786562573.907556:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11627 00000100:00100000:2.0:1786562573.913077:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562573.913238:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877184 00000100:00100000:1.0:1786562573.913254:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877184 00000100:00100000:1.0:1786562573.913334:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17153 00000100:00100000:1.0:1786562573.913347:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+13:65002:x1873345652877184:12345-192.168.204.29@tcp:44:lfs.0 00000100:00100000:0.0:1786562574.005679:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+13:65002:x1873345652877184:12345-192.168.204.29@tcp:44:lfs.0 Request processed in 92318us (92597us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.005697:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17153 00000001:00080000:1.0:1786562574.006305:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950691 is committed 00000001:00080000:1.0:1786562574.006323:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950693 is committed 00000001:00080000:1.0:1786562574.006332:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950694 is committed 00000100:00100000:0.0:1786562574.012600:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562574.012862:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877312 00000100:00100000:3.0:1786562574.012875:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877312 00000100:00100000:3.0:1786562574.012967:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17859 00000100:00100000:3.0:1786562574.012980:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652877312:12345-192.168.204.29@tcp:16:lfs.0 00000100:00100000:3.0:1786562574.013193:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652877312:12345-192.168.204.29@tcp:16:lfs.0 Request processed in 215us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562574.013202:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17859 00000100:00100000:3.0:1786562574.022514:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562574.022713:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877440 00000100:00100000:0.0:1786562574.022737:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877440 00000100:00100000:0.0:1786562574.022816:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17860 00000100:00100000:0.0:1786562574.022830:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652877440:12345-192.168.204.29@tcp:16:lfs.0 00000100:00100000:0.0:1786562574.023061:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652877440:12345-192.168.204.29@tcp:16:lfs.0 Request processed in 232us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.023070:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17860 00000100:00100000:2.0:1786562574.060107:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562574.060485:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877568 00000100:00100000:1.0:1786562574.060501:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877568 00000100:00100000:1.0:1786562574.060587:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17861 00000100:00100000:1.0:1786562574.060599:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652877568:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562574.060649:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060670:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562574.060674:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562574.060681:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060696:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060728:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060737:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060746:0:29662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060754:0:29662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562574.060758:0:29662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060768:0:29662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060785:0:29662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.060793:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51aad4d/0x5c655bf66689f8b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.060896:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16a695a0-b685-4180-8888-8ba29614d6e8+6:2348:x1873345652877568:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 298us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562574.060906:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17861 00000100:00100000:2.0:1786562574.063873:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562574.070998:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877824 00000100:00100000:3.0:1786562574.071033:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877824 00000100:00100000:3.0:1786562574.071145:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17154 00000100:00100000:3.0:1786562574.071159:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652877824:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562574.071234:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562574.071275:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f865 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd013 expref: 8 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.071302:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b46aba00) 00010000:00010000:3.0:1786562574.071317:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562574.071365:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.071381:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.071392:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562574.071669:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e44cf329 reply state 0000000058df1b8d transno 8589950695 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562574.071681:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562574.073128:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652877824:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1960us (9258us total) trans 8589950695 rc 0/0 00000100:00100000:3.0:1786562574.073142:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17154 00010000:00010000:0.0:1786562574.085755:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.085779:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.085788:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.085804:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cac00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562574.085810:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.085819:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.085842:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e999bb1f00) 00010000:00010000:0.0:1786562574.085846:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562574.085851:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.085857:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf66689f8b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.086042:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562574.088797:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652877952 00000100:00100000:2.0:1786562574.088818:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652877952 00000100:00100000:2.0:1786562574.089167:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17155 00000100:00100000:2.0:1786562574.089182:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652877952:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562574.089220:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562574.089378:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd02f expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.089475:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.089498:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.089536:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:2.0:1786562574.089541:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562574.089546:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfce00, rc 0) 00000100:00100000:2.0:1786562574.089647:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652877952:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 468us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.089655:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17155 00000100:00100000:2.0:1786562574.092444:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562574.092577:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652878080 00000100:00100000:3.0:1786562574.092589:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652878080 00000100:00100000:3.0:1786562574.092669:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17862 00000100:00100000:3.0:1786562574.092681:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16a695a0-b685-4180-8888-8ba29614d6e8+6:65002:x1873345652878080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562574.092704:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562574.092741:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd036 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562574.092778:0:29963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x736:0x0] initial LVB size: 2097152, mtime: 0x6a7cc80c, atime: 0x0, ctime: 0x6a7cc80c, blocks: 0x1007 00010000:00010000:3.0:1786562574.092817:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1786562574.092823:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562574.092832:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 7 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.092850:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 7 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.092866:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb400, rc 0) 00000100:00100000:3.0:1786562574.092941:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16a695a0-b685-4180-8888-8ba29614d6e8+7:65002:x1873345652878080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 262us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562574.092949:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17862 00000100:00100000:0.0:1786562574.103417:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562574.104410:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652878208 00000100:00100000:2.0:1786562574.104425:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652878208 00000100:00100000:2.0:1786562574.104512:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17863 00000100:00100000:2.0:1786562574.104534:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16a695a0-b685-4180-8888-8ba29614d6e8+6:65002:x1873345652878208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562574.104559:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562574.104587:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd03d expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.104634:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.104650:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562574.104655:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562574.104660:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd03d expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.104700:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.104715:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562574.104730:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654898816:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562574.104855:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988b130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562574.109778:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654898816:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562574.109831:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd03d expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.109862:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562574.109965:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16a695a0-b685-4180-8888-8ba29614d6e8+7:65002:x1873345652878208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5442us (6563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.109978:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17863 00000100:00100000:2.0:1786562574.111068:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562574.111157:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652878336 00000100:00100000:1.0:1786562574.111168:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652878336 00010000:00010000:1.0:1786562574.111213:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.111259:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8739 00000100:00100000:1.0:1786562574.111271:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652878336:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562574.111290:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562574.111321:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.111338:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.111378:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e41fccf/0x5c655bf66689f873 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x71a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd021 expref: 7 pid: 29662 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.111399:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562574.111405:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562574.111413:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd03d expref: 6 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.111425:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd03d expref: 6 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.111472:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd03d expref: 6 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.111489:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654898944:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562574.111595:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e883396b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562574.120420:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35896:1873345654898944:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562574.120460:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562574.120556:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652878336:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 9285us (9493us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562574.120570:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8739 00000100:00100000:3.0:1786562574.120788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562574.121139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562574.121211:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562574.121283:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652878592 00000100:00100000:1.0:1786562574.121292:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652878592 00000100:00100000:1.0:1786562574.121348:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652878464 00000100:00100000:1.0:1786562574.121352:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652878464 00000100:00100000:1.0:1786562574.121379:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17864 00000100:00100000:1.0:1786562574.121390:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652878592:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562574.121735:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562574.121740:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb mtime from disk: 0 -> 1786562568 00002000:00010000:1.0:1786562574.121742:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb atime from disk: 0 -> 1786562568 00002000:00010000:1.0:1786562574.121745:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb ctime from disk: 0 -> 1786562573 00002000:00010000:1.0:1786562574.121747:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562574.121801:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652878592:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 411us (1012us total) trans 17179876099 rc 0/0 00000100:00100000:1.0:1786562574.121810:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17864 00000100:00100000:1.0:1786562574.121830:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17865 00000100:00100000:1.0:1786562574.121837:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a695a0-b685-4180-8888-8ba29614d6e8+7:2349:x1873345652878464:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562574.122123:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562574.122127:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb mtime from disk: 1786562572 -> 1786562568 00002000:00010000:1.0:1786562574.122130:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb atime from disk: 0 -> 1786562568 00002000:00010000:1.0:1786562574.122131:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb ctime from disk: 1786562572 -> 1786562573 00002000:00010000:1.0:1786562574.122133:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562574.122158:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a695a0-b685-4180-8888-8ba29614d6e8+8:2349:x1873345652878464:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 321us (1019us total) trans 21474843615 rc 0/0 00000100:00100000:1.0:1786562574.122165:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17865 00000100:00100000:3.0:1786562574.124070:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562574.124115:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652878848 00000100:00100000:0.0:1786562574.124128:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652878848 00000100:00100000:0.0:1786562574.124201:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17156 00000100:00100000:0.0:1786562574.124213:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652878848:12345-192.168.204.29@tcp:55:lfs.0 00010000:00010000:0.0:1786562574.124317:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124338:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124352:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124386:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124393:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124400:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124407:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562574.124411:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124419:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124432:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:0.0:1786562574.124435:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786562574.124440:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.124449:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562574.124545:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652878848:12345-192.168.204.29@tcp:55:lfs.0 Request processed in 333us (487us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786562574.124554:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17156 00000100:00100000:2.0:1786562574.128156:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562574.129388:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652879104 00000100:00100000:1.0:1786562574.129406:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652879104 00000100:00100000:1.0:1786562574.129493:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17157 00000100:00100000:1.0:1786562574.129507:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652879104:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562574.129600:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562574.129638:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f81f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcff7 expref: 9 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.129666:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:1.0:1786562574.129673:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562574.129730:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.129746:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.129758:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562574.130193:0:35929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029e0611f reply state 000000003aa33ff4 transno 8589950696 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.130204:0:35929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562574.130406:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652879104:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 899us (2263us total) trans 8589950696 rc 0/0 00000100:00100000:1.0:1786562574.130416:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17157 00000100:00100000:2.0:1786562574.138226:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1786562574.139172:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.139189:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.139198:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.139209:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562574.139215:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.139225:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.139404:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:1.0:1786562574.139408:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562574.139414:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.139421:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881000/0x5c655bf66689f8dc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562574.139586:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652879232 00000100:00100000:3.0:1786562574.139601:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652879232 00000100:00100000:2.0:1786562574.148154:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17158 00000100:00100000:2.0:1786562574.148173:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652879232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562574.148208:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562574.148238:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd044 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.148336:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.148356:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.148380:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562574.148384:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562574.148389:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:2.0:1786562574.148817:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652879232:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 647us (10603us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.148826:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17158 00000100:00100000:2.0:1786562574.155647:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562574.155758:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652879360 00000100:00100000:3.0:1786562574.155771:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652879360 00000100:00100000:3.0:1786562574.155846:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17866 00000100:00100000:3.0:1786562574.155860:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16a695a0-b685-4180-8888-8ba29614d6e8+8:65002:x1873345652879360:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562574.155896:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562574.155929:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd04b expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.155968:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.155979:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562574.155985:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562574.155992:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.158839:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.158887:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 9 pid: 28861 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562574.158919:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654899072:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562574.159134:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988b130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562574.165766:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562574.166308:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652879488 00000100:00100000:1.0:1786562574.166321:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652879488 00010000:00010000:1.0:1786562574.166378:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 10 pid: 28861 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.166435:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8740 00000100:00100000:1.0:1786562574.166448:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a695a0-b685-4180-8888-8ba29614d6e8+10:2349:x1873345652879488:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562574.166469:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786562574.166496:0:5806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1786562574.166505:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 10 pid: 28861 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.166533:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 10 pid: 28861 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.166569:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562574.166574:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562574.166584:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.166597:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.166646:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.166664:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654899200:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562574.166778:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e883396b40 going to sleep for 11 seconds 00010000:00010000:0.0:1786562574.167159:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000747438c/0x5c655bf66689f857 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd00c expref: 10 pid: 28861 timeout: 1106 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562574.167180:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654899072:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562574.167213:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.167226:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb000, rc 0) 00000100:00100000:0.0:1786562574.167278:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16a695a0-b685-4180-8888-8ba29614d6e8+9:65002:x1873345652879360:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11421us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.167289:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17866 00000100:00100000:0.0:1786562574.173862:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654899200:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562574.173917:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562574.174036:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a695a0-b685-4180-8888-8ba29614d6e8+8:2349:x1873345652879488:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 7559us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.174051:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8740 00000100:00100000:2.0:1786562574.174319:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562574.174559:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652879616 00000100:00100000:0.0:1786562574.174569:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652879616 00000100:00100000:0.0:1786562574.174631:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17867 00000100:00100000:0.0:1786562574.174642:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:16a695a0-b685-4180-8888-8ba29614d6e8+8:2348:x1873345652879616:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:0.0:1786562574.174939:0:37002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562574.174944:0:37002:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb mtime from disk: 1786562568 -> 1786562568 00002000:00010000:0.0:1786562574.174946:0:37002:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb atime from disk: 0 -> 1786562568 00002000:00010000:0.0:1786562574.174948:0:37002:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb ctime from disk: 1786562568 -> 1786562573 00002000:00010000:0.0:1786562574.174951:0:37002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562574.174997:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:16a695a0-b685-4180-8888-8ba29614d6e8+9:2348:x1873345652879616:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 355us (679us total) trans 21474843616 rc 0/0 00000100:00100000:0.0:1786562574.175038:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17867 00000100:00100000:2.0:1786562574.185510:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562574.185737:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652879872 00000100:00100000:1.0:1786562574.185751:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652879872 00000100:00100000:1.0:1786562574.185832:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6297 00000100:00100000:1.0:1786562574.185846:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986376050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652879872:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:1.0:1786562574.186222:0:33117:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000404:0x4d9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f881 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd028 expref: 10 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.186274:0:33117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.186290:0:33117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.186305:0:33117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.186353:0:33117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562574.186368:0:33117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 10 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.186385:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345654899328:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562574.186497:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e883396b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562574.194747:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562574.194912:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345654899328:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562574.194960:0:33117:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562574.195156:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652880000 00000100:00100000:0.0:1786562574.195165:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652880000 00010000:00010000:0.0:1786562574.195214:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 11 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562574.195399:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8741 00000100:00100000:0.0:1786562574.195413:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a695a0-b685-4180-8888-8ba29614d6e8+11:2349:x1873345652880000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562574.195433:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562574.195443:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 11 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.195458:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 11 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.195488:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689f8e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd044 expref: 11 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.195515:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:0.0:1786562574.195533:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.195546:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.195554:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.195587:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562574.195662:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a695a0-b685-4180-8888-8ba29614d6e8+10:2349:x1873345652880000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 251us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.195670:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8741 00010000:00010000:3.0:1786562574.196185:0:33117:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.196194:0:33117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.196239:0:33117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.196266:0:33117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.196275:0:33117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.196317:0:33117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.196333:0:33117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 9 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562574.196352:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345654899456:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562574.196448:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474840 going to sleep for 11 seconds 00000100:00100000:3.0:1786562574.222710:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345654899456:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562574.222761:0:33117:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562574.234204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562574.236294:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652880128 00000100:00100000:2.0:1786562574.236314:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652880128 00010000:00010000:2.0:1786562574.236380:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 10 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562574.236445:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8742 00000100:00100000:2.0:1786562574.236460:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16a695a0-b685-4180-8888-8ba29614d6e8+10:2349:x1873345652880128:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562574.236484:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562574.236494:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 10 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.236513:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 10 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.236560:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689f8c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd02f expref: 10 pid: 33113 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.236583:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:2.0:1786562574.236590:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.236601:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.236614:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.236659:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562574.236751:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16a695a0-b685-4180-8888-8ba29614d6e8+9:2349:x1873345652880128:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 294us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.236760:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8742 00010000:00010000:3.0:1786562574.236779:0:33117:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.236799:0:33117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562574.237430:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.238054:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.238120:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562574.238122:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654899584 00000100:00100000:2.0:1786562574.238134:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654899584 00000100:00080000:3.0:1786562574.238185:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562574.238216:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:2.0:1786562574.238226:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33117:x1873345654899584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786562574.238366:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33117:x1873345654899584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 141us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.238374:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1786562574.238443:0:33117:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843612 gen 2 00000004:00080000:3.0:1786562574.238451:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1e680, transno 21474843606 00000004:00080000:3.0:1786562574.238533:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553ce00, transno 21474843607 00000004:00080000:3.0:1786562574.244139:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553c380, transno 21474843608 00000004:00080000:3.0:1786562574.244149:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf04e00, transno 21474843609 00000004:00080000:3.0:1786562574.244151:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a994bb80, transno 21474843610 00000004:00080000:3.0:1786562574.244154:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553d880, transno 21474843611 00000004:00080000:3.0:1786562574.244157:0:33117:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf07b80, transno 21474843612 00000100:00100000:3.0:1786562574.244169:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899584:0@lo:1000:mdt_rdpg00_001.0 00000004:00080000:2.0:1786562574.244818:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:3.0:1786562574.247362:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.247442:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.247570:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881821e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562574.249768:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654899712 00000100:00100000:0.0:1786562574.249783:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654899712 00000100:00100000:0.0:1786562574.249935:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1786562574.249947:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33117:x1873345654899712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786562574.250104:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33117:x1873345654899712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.250112:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1786562574.250197:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.250270:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.250300:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.250688:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881821e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562574.250807:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654899840 00000100:00100000:2.0:1786562574.250813:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654899840 00000100:00100000:2.0:1786562574.250857:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1786562574.250865:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:33117:x1873345654899840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786562574.250941:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:33117:x1873345654899840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.250948:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00080000:3.0:1786562574.251057:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562574.251082:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899840:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:3.0:1786562574.252066:0:33117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].71, 368 off70384 00000001:00080000:3.0:1786562574.252081:0:33117:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950697 00000100:00100000:3.0:1786562574.252411:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.252465:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.252493:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881821780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562574.252592:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654899968 00000100:00100000:2.0:1786562574.252611:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654899968 00000100:00100000:2.0:1786562574.252648:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:2.0:1786562574.252657:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:33117:x1873345654899968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786562574.252863:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:33117:x1873345654899968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 206us (396us total) trans 17179876100 rc 0/0 00000100:00100000:2.0:1786562574.252871:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1786562574.253089:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654899968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.253124:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654900096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786562574.253153:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.253184:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474300 going to sleep for 11 seconds 00000100:00100000:0.0:1786562574.253375:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900096 00000100:00100000:0.0:1786562574.253381:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900096 00000100:00100000:0.0:1786562574.253409:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1786562574.253417:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33117:x1873345654900096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786562574.253625:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33117:x1873345654900096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 208us (471us total) trans 21474843617 rc 0/0 00000100:00100000:0.0:1786562574.253635:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1786562574.253817:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345654900096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786562574.253901:0:33117:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950698 00010000:00010000:3.0:1786562574.254041:0:33117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254053:0:33117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254062:0:33117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254069:0:33117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562574.254073:0:33117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254080:0:33117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254098:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:3.0:1786562574.254102:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786562574.254107:0:33117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254113:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f8f8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254138:0:33117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254145:0:33117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254150:0:33117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254156:0:33117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562574.254296:0:33117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254306:0:33117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254319:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:3.0:1786562574.254322:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786562574.254326:0:33117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254331:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f8f1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562574.254345:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:3.0:1786562574.254348:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562574.254492:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f881 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd028 expref: 11 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562574.254771:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986376050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652879872:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 68927us (69274us total) trans 8589950699 rc 0/0 00000100:00100000:3.0:1786562574.254782:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6297 00000020:00080000:3.0:1786562574.254787:0:33117:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1786562574.259655:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562574.262480:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652880256 00000100:00100000:0.0:1786562574.262499:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652880256 00000100:00100000:0.0:1786562574.262597:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17159 00000100:00100000:0.0:1786562574.262609:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16a695a0-b685-4180-8888-8ba29614d6e8+10:65002:x1873345652880256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562574.262647:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562574.262682:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd052 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.262754:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.262769:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.262788:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:0.0:1786562574.262791:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562574.262795:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562574.262870:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16a695a0-b685-4180-8888-8ba29614d6e8+11:65002:x1873345652880256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 263us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.262877:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17159 00000100:00100000:2.0:1786562574.268859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562574.268990:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652880512 00000100:00100000:1.0:1786562574.269035:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652880512 00000100:00100000:1.0:1786562574.269122:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6298 00000100:00100000:1.0:1786562574.269134:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16a695a0-b685-4180-8888-8ba29614d6e8+11:65002:x1873345652880512:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562574.269766:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16a695a0-b685-4180-8888-8ba29614d6e8+12:65002:x1873345652880512:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 631us (922us total) trans 8589950700 rc 0/0 00000100:00100000:1.0:1786562574.269775:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6298 00000100:00100000:3.0:1786562574.277587:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562574.277907:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652880768 00000100:00100000:2.0:1786562574.277927:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652880768 00000100:00100000:2.0:1786562574.277989:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6299 00000100:00100000:2.0:1786562574.277999:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16a695a0-b685-4180-8888-8ba29614d6e8+12:65002:x1873345652880768:12345-192.168.204.29@tcp:35:lfs.0 00000004:00080000:2.0:1786562574.284160:0:35899:0:(mdd_object.c:4018:mdd_close()) Object [0x200000bd1:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1786562574.284431:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.284450:0:35899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.284461:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.284470:0:35899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.284476:0:35899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.284484:0:35899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562574.284513:0:35899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786562574.284623:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562574.284641:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.284654:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfca00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562574.284662:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562574.284663:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16a695a0-b685-4180-8888-8ba29614d6e8+13:65002:x1873345652880768:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 6657us (7080us total) trans 8589950701 rc 0/0 00010000:00010000:0.0:1786562574.284697:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.284719:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e9b6332600) 00010000:00010000:0.0:1786562574.284722:0:7599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786562574.284728:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.284734:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689f906 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562574.284761:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562574.284763:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562574.284765:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562574.288234:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6299 00000100:00100000:1.0:1786562574.629263:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654900224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562574.629530:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562574.629642:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900224 00000100:00100000:1.0:1786562574.629651:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900224 00000100:00100000:1.0:1786562574.629720:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1786562574.629732:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654900224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562574.629758:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 519766016 pending 0 free 3836739584 avail 3832545280 00000100:00100000:1.0:1786562574.629820:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654900224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562574.629839:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1786562574.630401:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654900224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562574.630895:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654900352:0@lo:400:kworker.0 00000100:00100000:3.0:1786562574.630954:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654900608:0@lo:400:kworker.0 00000100:00100000:3.0:1786562574.631053:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.631104:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562574.631114:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654900480:0@lo:400:kworker.0 00000100:00100000:2.0:1786562574.631130:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562574.631154:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562574.631178:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654900864:0@lo:400:kworker.0 00000100:00100000:3.0:1786562574.631199:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900608 00000100:00100000:3.0:1786562574.631207:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900608 00000100:00100000:3.0:1786562574.631255:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900480 00000100:00100000:3.0:1786562574.631259:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900480 00000100:00100000:2.0:1786562574.631283:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562574.631363:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900352 00000100:00100000:0.0:1786562574.631369:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900352 00000100:00100000:0.0:1786562574.631409:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1786562574.631421:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654900352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562574.631481:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654900352:12345-0@lo:400:kworker.0 Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562574.631485:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786562574.631491:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1786562574.631499:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654900736:0@lo:400:kworker.0 00000100:00100000:2.0:1786562574.631550:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562574.631555:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654900992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562574.631602:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562574.631605:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654900352:0@lo:400:kworker.0 00000100:00100000:0.0:1786562574.631663:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900992 00000100:00100000:0.0:1786562574.632175:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900992 00000100:00100000:0.0:1786562574.632211:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1786562574.632217:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654900992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562574.632251:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 352911360 pending 0 free 3831496704 avail 3829399552 00000100:00100000:0.0:1786562574.632294:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3291:x1873345654900992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.632301:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1786562574.632328:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900736 00000100:00100000:0.0:1786562574.632332:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900736 00000100:00100000:0.0:1786562574.632355:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1786562574.632361:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654900736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562574.632396:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3290:x1873345654900736:12345-0@lo:400:kworker.0 Request processed in 34us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562574.632402:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1786562574.632457:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654900992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562574.632485:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654900736:0@lo:400:kworker.0 00000100:00100000:3.0:1786562574.632790:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654900864 00000100:00100000:3.0:1786562574.632797:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654900864 00000100:00100000:1.0:1786562574.632824:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1786562574.632955:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654900608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786562574.633048:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562574.633079:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654900608:12345-0@lo:400:kworker.0 Request processed in 136us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562574.633091:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1786562574.633103:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786562574.633112:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654900480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562574.633138:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1786562574.633151:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654900864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562574.633171:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654900480:12345-0@lo:400:kworker.0 Request processed in 59us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562574.633178:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1786562574.633418:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654900864:12345-0@lo:400:kworker.0 Request processed in 267us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562574.633426:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1786562574.633489:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654900480:0@lo:400:kworker.0 00000100:00100000:1.0:1786562574.633503:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654900608:0@lo:400:kworker.0 00000100:00100000:1.0:1786562574.634298:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654900864:0@lo:400:kworker.0 00000001:00080000:1.0:1786562574.729877:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876095 is committed 00000001:00080000:1.0:1786562574.729898:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876099 is committed 00000001:00080000:1.0:1786562574.729904:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876097 is committed 00000001:00080000:1.0:1786562574.729917:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876100 is committed 00010000:00010000:3.0:1786562575.141162:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562576.165546:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786562576.360802:0:37411:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mirror extend done 00010000:00010000:1.0:1786562577.193583:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1786562577.455181:0:33140:0:(mdt_open.c:1761:mdt_reint_open()) cfs_fail_timeout interrupted 00010000:00010000:0.0:1786562577.471854:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689f90d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.471877:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689f90d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.471889:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689f90d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562577.471906:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00010000:00010000:0.0:1786562577.472064:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472073:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472080:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472087:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562577.472091:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472098:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472117:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:0.0:1786562577.472120:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562577.472124:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472130:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf66689f7ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472145:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472152:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472158:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472163:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562577.472165:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472171:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472183:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e999bb1400) 00010000:00010000:0.0:1786562577.472185:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562577.472188:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472195:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf66689f7f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472243:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf66689f7e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfe9 expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472259:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689f90d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfe9 expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.472267:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:0.0:1786562577.472269:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562577.472272:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269200, rc 0) 00000100:00100000:0.0:1786562577.472341:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:64865:x1873345652873472:12345-192.168.204.29@tcp:101:dd.0 Request processed in 6675316us (6678181us total) trans 8589950702 rc 0/0 00000100:00100000:0.0:1786562577.473118:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17146 00000100:00100000:1.0:1786562577.556349:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562577.556441:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881024 00000100:00100000:2.0:1786562577.556451:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881024 00000100:00100000:2.0:1786562577.556535:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17160 00000100:00100000:2.0:1786562577.556547:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:64865:x1873345652881024:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562577.556571:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562577.556575:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562577.556602:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689f90d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcfe9 expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.556621:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:2.0:1786562577.556626:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562577.556639:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf66689f91b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd059 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.556692:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.556706:0:36756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.556715:0:36756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.556747:0:36756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.556759:0:36756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 12 pid: 34450 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562577.556773:0:36756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654901120:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562577.556857:0:36756:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00080000:1.0:1786562577.557075:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562577.566281:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654901120:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562577.566313:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562577.573399:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562577.579028:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881152 00000100:00100000:2.0:1786562577.579043:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881152 00000100:00080000:1.0:1786562577.579582:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562577.579641:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 13 pid: 34450 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562577.579698:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8743 00000100:00100000:2.0:1786562577.579710:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a695a0-b685-4180-8888-8ba29614d6e8+13:2349:x1873345652881152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562577.579790:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562577.580051:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 13 pid: 34450 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.580078:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 13 pid: 34450 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.580102:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689f8ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd052 expref: 13 pid: 34450 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.580117:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:2.0:1786562577.580122:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.580267:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.580275:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.580370:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562577.580439:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a695a0-b685-4180-8888-8ba29614d6e8+12:2349:x1873345652881152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 731us (7047us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562577.580447:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8743 00010000:00010000:1.0:1786562577.580516:0:36756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562577.580526:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786562577.581285:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4388, 88 off356024 00000004:00080000:1.0:1786562577.581299:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1010023292369ns, next at 1002951827965ns, rc = 0 00000040:00080000:1.0:1786562577.581334:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4389, 88 off356112 00000004:00080000:1.0:1786562577.581339:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1010023333227ns, next at 1002951827965ns, rc = 0 00000040:00080000:1.0:1786562577.581408:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4415, 88 off358552 00000004:00080000:1.0:1786562577.581511:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1010023505251ns, next at 1002952913655ns, rc = 0 00000001:00080000:3.0:1786562577.699379:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950702 is committed 00000001:00080000:3.0:1786562577.699401:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950703 is committed 00000004:00080000:3.0:1786562577.699408:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2918 committed 00010000:00010000:2.0:1786562577.699412:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd059 expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786562577.699418:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2891 committed 00000004:00080000:3.0:1786562577.699427:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2890 committed 00010000:00010000:2.0:1786562577.699430:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00000001:00080000:3.0:1786562577.699433:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950700 is committed 00010000:00010000:2.0:1786562577.699434:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:3.0:1786562577.699443:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950701 is committed 00010000:00010000:2.0:1786562577.699469:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf66689f91b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd059 expref: 8 pid: 36756 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1786562577.699473:0:33119:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e882474840 refcount 2 committed 0 result 0 batchid 4294969304 00000020:00080000:3.0:1786562577.699478:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e988cba500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e881821d80 00000020:00080000:3.0:1786562577.699482:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e988cbad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e9bace9a80 00000020:00080000:3.0:1786562577.699486:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e988cba400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e9bb07a400 00000020:00080000:3.0:1786562577.699489:0:33119:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].71 00010000:00010000:2.0:1786562577.699497:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd059 expref: 7 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.699540:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:2.0:1786562577.699543:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562577.699546:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfda00, rc 0) 00000020:00080000:3.0:1786562577.699575:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969304 committed batchid 4294969303 00000100:00100000:2.0:1786562577.699633:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+7:64865:x1873345652881024:12345-192.168.204.29@tcp:101:dd.0 Request processed in 143087us (143292us total) trans 8589950703 rc 0/0 00000100:00100000:2.0:1786562577.699645:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17160 00000100:00100000:2.0:1786562577.699888:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654901376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562577.699948:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562577.699989:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562577.699995:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654901504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562577.700037:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562577.700074:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654901376 00000100:00100000:2.0:1786562577.700092:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654901376 00000100:00100000:2.0:1786562577.700149:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654901504 00000100:00100000:2.0:1786562577.700153:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654901504 00000100:00100000:2.0:1786562577.700174:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17868 00000100:00100000:2.0:1786562577.700183:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654901376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562577.700424:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562577.700428:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb mtime from disk: 1786562568 -> 1786562568 00002000:00010000:2.0:1786562577.700430:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb atime from disk: 1786562568 -> 1786562568 00002000:00010000:2.0:1786562577.700433:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb ctime from disk: 1786562573 -> 1786562573 00002000:00010000:2.0:1786562577.700435:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562577.700485:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654901376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 304us (538us total) trans 21474843618 rc 0/0 00000100:00100000:2.0:1786562577.700493:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17868 00000100:00100000:2.0:1786562577.700508:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17869 00000100:00100000:2.0:1786562577.700514:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654901504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562577.700596:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562577.700599:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb mtime from disk: 1786562568 -> 1786562568 00002000:00010000:2.0:1786562577.700601:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb atime from disk: 1786562568 -> 1786562568 00002000:00010000:2.0:1786562577.700603:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb ctime from disk: 1786562573 -> 1786562573 00002000:00010000:2.0:1786562577.700605:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x736:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562577.700633:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654901504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (596us total) trans 21474843619 rc 0/0 00000100:00100000:2.0:1786562577.700639:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17869 00000100:00080000:2.0:1786562577.700662:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1786562577.700705:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f54a80/2, rc 0, transno 21474843619 00000100:00100000:2.0:1786562577.700712:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654901504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1786562577.700723:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f56300/2, rc 0, transno 21474843618 00000100:00100000:2.0:1786562577.700727:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654901376:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1786562577.701280:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969303 00000100:00100000:3.0:1786562577.701302:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654901248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562577.701342:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562577.702480:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654901248 00000100:00100000:2.0:1786562577.702492:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654901248 00000100:00100000:2.0:1786562577.702782:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17870 00000100:00100000:2.0:1786562577.702796:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654901248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1786562577.703078:0:8368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786562577.703082:0:8368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb mtime from disk: 1786562568 -> 1786562568 00002000:00010000:2.0:1786562577.703096:0:8368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb atime from disk: 1786562568 -> 1786562568 00002000:00010000:2.0:1786562577.703098:0:8368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb ctime from disk: 1786562573 -> 1786562573 00002000:00010000:2.0:1786562577.703102:0:8368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786562577.703171:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654901248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 378us (1827us total) trans 17179876101 rc 0/0 00000100:00100000:2.0:1786562577.703553:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17870 00000100:00080000:3.0:1786562577.703734:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562577.704112:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876100 gen 2 00000004:00080000:0.0:1786562577.704121:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebbb80, transno 17179876091 00000004:00080000:0.0:1786562577.704130:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fca80, transno 17179876092 00000004:00080000:0.0:1786562577.704133:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88aebad80, transno 17179876093 00000004:00080000:0.0:1786562577.704136:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fd180, transno 17179876094 00000004:00080000:0.0:1786562577.704138:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fc380, transno 17179876095 00000004:00080000:0.0:1786562577.704140:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fc000, transno 17179876096 00000004:00080000:0.0:1786562577.704144:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fdf80, transno 17179876097 00000004:00080000:0.0:1786562577.704147:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa16680, transno 17179876098 00000004:00080000:0.0:1786562577.704151:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179876100 committed transno 17179876100 00000100:00100000:0.0:1786562577.704177:0:3292:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e98553c380 x1873345654901248/t17179876101(17179876101) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562593 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562577.704190:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98553c380/2, rc 0, transno 17179876101 00000100:00100000:0.0:1786562577.704196:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654901248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562577.707599:0:33137:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 8 done 00000100:00100000:1.0:1786562577.712571:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562577.712673:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881280 00000100:00100000:3.0:1786562577.712688:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881280 00000100:00100000:3.0:1786562577.712804:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11629 00000100:00100000:3.0:1786562577.712816:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+5:2350:x1873345652881280:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1786562577.712861:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.712886:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 8 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.712896:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x735:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1786562577.712901:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562577.712906:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.712952:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 8 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.712968:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 8 pid: 28861 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562577.712986:0:14369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:14369:1873345654901632:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562577.713127:0:14369:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9813779c0 going to sleep for 11 seconds 00000100:00080000:0.0:1786562577.713242:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562577.726905:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562577.726970:0:14369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:14369:1873345654901632:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562577.727042:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562577.727081:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881408 00000100:00100000:2.0:1786562577.727270:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881408 00010000:00010000:2.0:1786562577.727334:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 9 pid: 28861 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562577.727372:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8744 00000100:00100000:2.0:1786562577.727382:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16a695a0-b685-4180-8888-8ba29614d6e8+9:2348:x1873345652881408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562577.727402:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562577.727430:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 9 pid: 28861 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.727526:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 9 pid: 28861 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.727561:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf66689f8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd04b expref: 9 pid: 28861 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.727584:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562577.727589:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562577.727596:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.727607:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.727636:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562577.727801:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16a695a0-b685-4180-8888-8ba29614d6e8+8:2348:x1873345652881408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 419us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562577.727810:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8744 00000100:00080000:2.0:1786562577.727961:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562577.727975:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562577.727983:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562577.805884:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843617 is committed 00000001:00080000:0.0:1786562577.805905:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843616 is committed 00000001:00080000:0.0:1786562577.805917:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843620 is committed 00000001:00080000:0.0:1786562577.805928:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843619 is committed 00002000:00010000:3.0:1786562577.805995:0:14369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb mtime from disk: 1786562568 -> 1786562576 00002000:00010000:3.0:1786562577.806000:0:14369:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb ctime from disk: 1786562573 -> 1786562576 00010000:00010000:3.0:1786562577.806055:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.806079:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.806158:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.806167:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562577.806173:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.806182:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.806207:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562577.806215:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf66689f929 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562577.806601:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+5:2350:x1873345652881280:12345-192.168.204.29@tcp:4:dd.0 Request processed in 93779us (94034us total) trans 21474843620 rc 0/0 00000100:00100000:0.0:1786562577.806614:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11629 00000100:00100000:1.0:1786562577.859178:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562577.859342:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881536 00000100:00100000:0.0:1786562577.859357:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881536 00000100:00100000:0.0:1786562577.859474:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11630 00000100:00100000:0.0:1786562577.859487:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+5:2348:x1873345652881536:12345-192.168.204.29@tcp:4:dd.0 00002000:00010000:0.0:1786562577.859555:0:14017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x735:0x0] initial LVB size: 2097152, mtime: 0x6a7cc810, atime: 0x6a7cc808, ctime: 0x6a7cc810, blocks: 0x1007 00010000:00010000:0.0:1786562577.859566:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.859589:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=1010s v=(0 0) 00010000:00010000:0.0:1786562577.859595:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562577.859602:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.859624:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562577.956163:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843621 is committed 00002000:00010000:0.0:1786562577.956354:0:14017:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb mtime from disk: 1786562576 -> 1786562577 00002000:00010000:0.0:1786562577.956360:0:14017:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x735:0x0] updating lvb ctime from disk: 1786562576 -> 1786562577 00010000:00010000:0.0:1786562577.956378:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.956394:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.956404:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.956412:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562577.956417:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.956427:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.956460:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562577.956469:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689f930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562577.957145:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+5:2348:x1873345652881536:12345-192.168.204.29@tcp:4:dd.0 Request processed in 97654us (97977us total) trans 21474843621 rc 0/0 00000100:00100000:0.0:1786562577.957159:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11630 00000100:00100000:0.0:1786562577.970095:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562577.977162:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881792 00000100:00100000:3.0:1786562577.977256:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881792 00000100:00100000:2.0:1786562577.977802:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6300 00000100:00100000:2.0:1786562577.977817:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+7:64865:x1873345652881792:12345-192.168.204.29@tcp:35:dd.0 00000100:00100000:2.0:1786562577.978364:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:64865:x1873345652881792:12345-192.168.204.29@tcp:35:dd.0 Request processed in 549us (8284us total) trans 8589950704 rc 0/0 00000100:00100000:2.0:1786562577.978373:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6300 00010000:00010000:3.0:1786562578.213257:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562578.749603:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749662:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749701:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749732:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749779:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749803:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562578.749841:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882176 00000100:00100000:3.0:1786562578.749850:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882176 00000100:00100000:3.0:1786562578.749897:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 460 00000100:00100000:3.0:1786562578.749907:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652882176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562578.749979:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652882176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562578.749987:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 460 00000100:00100000:3.0:1786562578.750034:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882688 00000100:00100000:3.0:1786562578.750038:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882688 00000100:00100000:3.0:1786562578.750078:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882304 00000100:00100000:3.0:1786562578.750082:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882304 00000100:00100000:3.0:1786562578.750100:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882560 00000100:00100000:3.0:1786562578.750102:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882560 00000100:00100000:3.0:1786562578.750119:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 461 00000100:00100000:3.0:1786562578.750125:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+6:2351:x1873345652882688:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562578.750153:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+6:2351:x1873345652882688:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562578.750160:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 461 00000100:00100000:3.0:1786562578.750173:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 462 00000100:00100000:3.0:1786562578.750179:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652882304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562578.750202:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652882304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562578.750208:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 462 00000100:00100000:3.0:1786562578.750219:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 463 00000100:00100000:3.0:1786562578.750225:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+6:2351:x1873345652882560:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562578.750247:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+6:2351:x1873345652882560:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562578.750253:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 463 00000100:00100000:1.0:1786562578.750345:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882432 00000100:00100000:1.0:1786562578.750350:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882432 00000100:00100000:1.0:1786562578.750386:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882048 00000100:00100000:1.0:1786562578.750389:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882048 00000100:00100000:1.0:1786562578.750410:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 301 00000100:00100000:1.0:1786562578.750416:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+5:2351:x1873345652882432:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562578.750460:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+5:2351:x1873345652882432:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562578.750467:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 301 00000100:00100000:1.0:1786562578.750482:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 302 00000100:00100000:1.0:1786562578.750489:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652882048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562578.750522:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652882048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562578.750528:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 302 00000100:00100000:2.0:1786562578.751499:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652881920 00000100:00100000:2.0:1786562578.751508:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652881920 00000100:00100000:2.0:1786562578.751559:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:2.0:1786562578.751567:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+13:2351:x1873345652881920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1786562578.751876:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562578.752144:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+13:2351:x1873345652881920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 61us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562578.752155:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 270 00010000:00010000:1.0:1786562579.238363:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562579.751049:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654902016:0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.751164:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562579.751242:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562579.751250:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654902144:0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.751281:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562579.751323:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902144 00000100:00100000:2.0:1786562579.751333:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902144 00000100:00100000:2.0:1786562579.751398:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1786562579.751422:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654902144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.751485:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654902144:12345-0@lo:400:kworker.0 Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.751494:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1786562579.751541:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843619 gen 2 00000004:00080000:2.0:1786562579.751548:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474843617 committed transno 21474843619 00000004:00080000:2.0:1786562579.751574:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f56300, transno 21474843618 00000004:00080000:2.0:1786562579.751584:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f54a80, transno 21474843619 00000100:00100000:2.0:1786562579.751592:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654902144:0@lo:400:kworker.0 00000100:00100000:3.0:1786562579.754256:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654901760:0@lo:400:kworker.0 00000100:00100000:3.0:1786562579.754348:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562579.754405:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654902272:0@lo:400:kworker.0 00000100:00100000:3.0:1786562579.754449:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562579.754482:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786562579.754490:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654901888:0@lo:400:kworker.0 00000100:00100000:3.0:1786562579.754519:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562579.754540:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654902400:0@lo:400:kworker.0 00000100:00100000:3.0:1786562579.754562:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786562579.754590:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562579.754851:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902272 00000100:00100000:2.0:1786562579.754861:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902272 00000100:00100000:2.0:1786562579.754922:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1786562579.754933:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654902272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755022:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654902272:12345-0@lo:400:kworker.0 Request processed in 74us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.755030:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1786562579.755057:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654901760 00000100:00100000:2.0:1786562579.755060:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654901760 00000100:00100000:2.0:1786562579.755087:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786562579.755093:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654901760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755125:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654901760:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.755132:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786562579.755177:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902016 00000100:00100000:2.0:1786562579.755182:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902016 00000100:00100000:2.0:1786562579.755222:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1786562579.755230:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654902016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755271:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654902016:12345-0@lo:400:kworker.0 Request processed in 42us (4108us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.755278:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1786562579.755288:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654901888 00000100:00100000:2.0:1786562579.755292:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654901888 00000100:00100000:2.0:1786562579.755312:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902400 00000100:00100000:2.0:1786562579.755314:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902400 00000100:00100000:2.0:1786562579.755332:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1786562579.755338:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654901888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755368:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654901888:12345-0@lo:400:kworker.0 Request processed in 30us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.755374:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1786562579.755385:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1786562579.755392:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654902400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755435:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654902400:12345-0@lo:400:kworker.0 Request processed in 43us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.755441:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1786562579.755491:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654902016:0@lo:400:kworker.0 00000100:00080000:2.0:1786562579.755529:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562579.755533:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562579.755552:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654901888:0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755564:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654902400:0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755573:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654901760:0@lo:400:kworker.0 00000100:00100000:2.0:1786562579.755584:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654902272:0@lo:400:kworker.0 00000100:00100000:1.0:1786562579.758505:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654902528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562579.758591:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562579.758926:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902528 00000100:00100000:3.0:1786562579.758935:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902528 00000100:00100000:3.0:1786562579.758992:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1786562579.759002:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654902528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562579.759069:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 523173888 pending 0 free 3834642432 avail 3832545280 00000100:00100000:3.0:1786562579.759125:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654902528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562579.759132:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1786562579.759188:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654902528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562579.759209:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562579.759216:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654902656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562579.759241:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562579.759271:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902656 00000100:00100000:3.0:1786562579.759274:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902656 00000100:00100000:3.0:1786562579.759297:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1786562579.759304:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654902656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562579.759326:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 352911360 pending 0 free 3847225344 avail 3845128192 00000100:00100000:3.0:1786562579.759362:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654902656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562579.759369:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1786562579.759399:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654902656:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786562579.837092:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876101 is committed 00000001:02000400:2.0:1786562579.855276:0:37511:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: dd completed 00000100:00100000:3.0:1786562579.894768:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562579.894900:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652882816 00000100:00100000:0.0:1786562579.894913:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652882816 00000100:00100000:0.0:1786562579.895027:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17161 00000100:00100000:0.0:1786562579.895041:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:65285:x1873345652882816:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562579.895068:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562579.895096:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689f937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd060 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.895183:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689f93e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.895200:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689f93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.895215:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689f93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562579.895494:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562579.895500:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 37 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562579.895586:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689f93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.895616:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689f937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd060 expref: 10 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.895640:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689f93e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd060 expref: 9 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.895650:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562579.895654:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562579.895658:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268600, rc 0) 00000100:00100000:0.0:1786562579.895748:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:65285:x1873345652882816:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 710us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562579.895757:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17161 00000100:00080000:3.0:1786562579.896135:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562579.897912:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562579.897990:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652883072 00000100:00100000:3.0:1786562579.898000:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652883072 00000100:00100000:3.0:1786562579.898083:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17162 00000100:00100000:3.0:1786562579.898094:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:65285:x1873345652883072:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562579.898118:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562579.898142:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd067 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898238:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898255:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898270:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898288:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898296:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898303:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898810:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898821:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898828:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898835:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562579.898841:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898850:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898865:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562579.898868:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562579.898874:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898882:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689f94c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898897:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898904:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898909:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898914:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850caa00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562579.898918:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898924:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898931:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e999bb1900) 00010000:00010000:3.0:1786562579.898934:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562579.898938:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898944:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf66689f953 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.898986:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f945 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd067 expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.899031:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562579.899034:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562579.899038:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689f945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd067 expref: 10 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562579.899049:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca800, rc 0) 00000100:00100000:3.0:1786562579.899132:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:65285:x1873345652883072:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1039us (1229us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562579.899141:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17162 00000100:00100000:0.0:1786562579.902218:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562579.902320:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652883200 00000100:00100000:2.0:1786562579.902333:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652883200 00000100:00100000:2.0:1786562579.902418:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17163 00000100:00100000:2.0:1786562579.902432:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:65285:x1873345652883200:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562579.902533:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.902554:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.902568:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.902591:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.902598:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.902606:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903176:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903187:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903195:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562579.903237:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00000004:00200000:2.0:1786562579.903243:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562579.903258:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903273:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903281:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903289:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903300:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562579.903305:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903314:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903329:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562579.903332:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562579.903339:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903345:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f95a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903357:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903364:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903370:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903376:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562579.903379:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903386:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903398:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e9b6332800) 00010000:00010000:2.0:1786562579.903401:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562579.903404:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903423:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f961 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903439:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903446:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903452:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903457:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562579.903460:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903467:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903492:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:2.0:1786562579.903494:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562579.903498:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562579.903504:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689f968 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562579.903611:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:65285:x1873345652883200:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1180us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562579.903621:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17163 00000100:00100000:3.0:1786562579.923780:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562579.929805:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652883456 00000100:00100000:2.0:1786562579.929827:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652883456 00000100:00100000:1.0:1786562579.930031:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17164 00000100:00100000:1.0:1786562579.930045:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:65286:x1873345652883456:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562579.930075:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562579.930104:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f96f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd06e expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930207:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930226:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930239:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930257:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930265:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930276:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930724:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930734:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930741:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930747:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.930753:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930761:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930776:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562579.930779:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.930784:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930791:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880400/0x5c655bf66689f976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930806:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930812:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930819:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930825:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4880a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.930828:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930834:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930841:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562579.930844:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.930848:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930854:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880a00/0x5c655bf66689f97d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930897:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f96f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd06e expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930909:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562579.930912:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562579.930916:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f96f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd06e expref: 10 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.930927:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880200, rc 0) 00000100:00100000:1.0:1786562579.931052:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:65286:x1873345652883456:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1008us (7285us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562579.931065:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17164 00000100:00100000:2.0:1786562579.935272:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562579.935370:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652883584 00000100:00100000:1.0:1786562579.935384:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652883584 00000100:00100000:1.0:1786562579.935471:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17165 00000100:00100000:1.0:1786562579.935485:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:65286:x1873345652883584:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562579.935583:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.935605:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.935619:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.935637:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.935645:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.935651:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936134:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936146:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936155:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562579.936201:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00000004:00200000:1.0:1786562579.936206:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562579.936222:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936239:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936246:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936254:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936261:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.936266:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936275:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936290:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562579.936294:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.936299:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936306:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936319:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936331:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936337:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936342:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.936345:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936352:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936359:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562579.936361:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.936364:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936370:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f98b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936385:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936392:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936398:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936404:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.936422:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936429:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936437:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:1.0:1786562579.936440:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.936443:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.936449:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f992 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562579.936549:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:65286:x1873345652883584:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1064us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562579.936560:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17165 00000100:00100000:0.0:1786562579.967192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562579.967304:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652883712 00000100:00100000:1.0:1786562579.967317:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652883712 00000100:00100000:1.0:1786562579.967394:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17166 00000100:00100000:1.0:1786562579.967418:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:65288:x1873345652883712:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562579.967449:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562579.967477:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd075 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.967569:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.967588:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.967607:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.967625:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.967632:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.967639:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968086:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968097:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968105:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562579.968148:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00000004:00200000:1.0:1786562579.968154:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562579.968177:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968192:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968202:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968214:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968222:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968230:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.968235:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968243:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968258:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562579.968262:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.968267:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968274:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881e00/0x5c655bf66689f9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968289:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968296:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968302:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968308:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4881200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562579.968312:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968319:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968326:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562579.968329:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562579.968332:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968339:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881200/0x5c655bf66689f9a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968374:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4881400/0x5c655bf66689f999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd075 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968390:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd075 expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.968399:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:1.0:1786562579.968401:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562579.968404:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880200, rc 0) 00000100:00100000:1.0:1786562579.968510:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:65288:x1873345652883712:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1105us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562579.968521:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17166 00000100:00100000:0.0:1786562579.974253:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562579.979434:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652883840 00000100:00100000:1.0:1786562579.979455:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652883840 00000100:00100000:1.0:1786562579.979557:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17871 00000100:00100000:1.0:1786562579.979569:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652883840:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562579.979596:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562579.979623:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd07c expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562579.979657:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x735:0x0] initial LVB size: 2097152, mtime: 0x6a7cc811, atime: 0x6a7cc808, ctime: 0x6a7cc811, blocks: 0x1007 00010000:00010000:1.0:1786562579.979698:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=1012s v=(0 0) 00010000:00010000:1.0:1786562579.979704:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562579.979715:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.979739:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562579.979756:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4880a00, rc 0) 00000100:00100000:1.0:1786562579.979850:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+6:2351:x1873345652883840:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 283us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562579.979858:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17871 00000100:00080000:3.0:1786562579.979959:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562579.987252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562579.987448:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884096 00000100:00100000:0.0:1786562579.987461:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884096 00000100:00100000:0.0:1786562579.987533:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17167 00000100:00100000:0.0:1786562579.987544:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:65288:x1873345652884096:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562579.987571:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562579.987596:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f9bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd083 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.987732:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f9c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.987751:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.987765:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562579.987779:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00010000:00010000:0.0:1786562579.987935:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689f9bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd083 expref: 13 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.987956:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd083 expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.987965:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:0.0:1786562579.987968:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562579.987972:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:0.0:1786562579.988087:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+12:65288:x1873345652884096:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 544us (846us total) trans 8589950705 rc 0/0 00000100:00100000:0.0:1786562579.988111:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17167 00000100:00100000:0.0:1786562579.997707:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562579.997763:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562579.997805:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884224 00000100:00100000:0.0:1786562579.997816:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884224 00000100:00100000:0.0:1786562579.997907:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 986 00000100:00100000:0.0:1786562579.997920:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652884224:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562579.997939:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562579.997971:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689f9c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd083 expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.997995:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:0.0:1786562579.998001:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562579.998083:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652884224:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 165us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562579.998091:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 986 00000100:00100000:0.0:1786562579.998118:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884480 00000100:00100000:0.0:1786562579.998123:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884480 00000100:00100000:0.0:1786562579.998153:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17168 00000100:00100000:0.0:1786562579.998160:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:65288:x1873345652884480:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562579.998187:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562579.998204:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689f9d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd08a expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.998325:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f9d8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.998342:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.998355:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562579.998369:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4d9:0x0]: returning size 2097152 00010000:00010000:0.0:1786562579.998543:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689f9d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd08a expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.998559:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f9d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd08a expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562579.998568:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:0.0:1786562579.998571:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562579.998575:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562579.998603:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:65288:x1873345652884480:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 444us (839us total) trans 8589950706 rc 0/0 00000100:00100000:0.0:1786562579.998610:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17168 00000100:00100000:2.0:1786562580.015892:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562580.015941:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562580.016056:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884608 00000100:00100000:3.0:1786562580.016068:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884608 00000100:00100000:3.0:1786562580.016143:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884736 00000100:00100000:3.0:1786562580.016146:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884736 00000100:00100000:3.0:1786562580.016173:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11631 00000100:00100000:3.0:1786562580.016183:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652884608:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562580.016229:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.016254:0:16203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 5 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.016265:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x736:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1786562580.016270:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562580.016277:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.016320:0:16203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 5 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.016335:0:16203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 5 pid: 29963 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562580.016351:0:16203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:16203:1873345654902784:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562580.016466:0:16203:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e998317e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786562580.016501:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11632 00000100:00100000:3.0:1786562580.016508:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652884736:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562580.016525:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.016534:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x736:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562580.016537:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1786562580.016541:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.016551:0:29462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562580.019155:0:16203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:16203:1873345654902784:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562580.019190:0:16203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562580.019533:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562580.019611:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884864 00000100:00100000:1.0:1786562580.019620:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884864 00010000:00010000:1.0:1786562580.019683:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 6 pid: 29963 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562580.019726:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8745 00000100:00100000:1.0:1786562580.019738:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a695a0-b685-4180-8888-8ba29614d6e8+6:2349:x1873345652884864:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562580.019756:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562580.019786:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 6 pid: 29963 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019801:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 6 pid: 29963 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019829:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf66689f8c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd036 expref: 6 pid: 29963 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019849:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562580.019854:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562580.019860:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019871:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019880:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562580.019883:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1786562580.019886:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019895:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562580.019924:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562580.019980:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a695a0-b685-4180-8888-8ba29614d6e8+5:2349:x1873345652884864:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 245us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562580.019993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8745 00000100:00080000:3.0:1786562580.020123:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786562580.020141:0:29462:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.020152:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.025454:0:16203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.025478:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061621:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061649:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061661:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061671:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562580.061677:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061688:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061714:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562580.061730:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c665d958/0x5c655bf66689f9ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562580.061832:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652884736:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 45316us (45883us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562580.061844:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11632 00010000:00010000:2.0:1786562580.079563:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.079591:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.079613:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.079623:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562580.079630:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.079646:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.079793:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.079804:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf66689f9e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562580.079946:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652884608:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 63756us (64060us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562580.079959:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11631 00000100:00100000:1.0:1786562580.091296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562580.091450:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652884992 00000100:00100000:2.0:1786562580.091465:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652884992 00000100:00100000:2.0:1786562580.091549:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 987 00000100:00100000:2.0:1786562580.091561:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:65288:x1873345652884992:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:2.0:1786562580.091581:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562580.091616:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689f9d8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd08a expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562580.091637:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:2.0:1786562580.091644:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562580.091714:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:65288:x1873345652884992:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 155us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562580.091723:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 987 00000100:00100000:3.0:1786562580.094161:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562580.094326:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652885248 00000100:00100000:0.0:1786562580.094338:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652885248 00000100:00100000:0.0:1786562580.094417:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6301 00000100:00100000:0.0:1786562580.094429:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+12:65288:x1873345652885248:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562580.094743:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:65288:x1873345652885248:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 315us (593us total) trans 8589950707 rc 0/0 00000100:00100000:0.0:1786562580.094752:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6301 00000100:00100000:1.0:1786562580.096585:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562580.096932:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652885504 00000100:00100000:2.0:1786562580.096943:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652885504 00000100:00100000:2.0:1786562580.097038:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6302 00000100:00100000:2.0:1786562580.097050:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:65288:x1873345652885504:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562580.097421:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+14:65288:x1873345652885504:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 372us (846us total) trans 8589950708 rc 0/0 00000100:00100000:2.0:1786562580.097431:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6302 00010000:00010000:3.0:1786562580.261338:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562581.285290:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562582.309299:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562582.955237:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950707 is committed 00000001:00080000:3.0:1786562582.955267:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950708 is committed 00000020:00080000:3.0:1786562582.955285:0:33119:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969304 batchid updated 00000020:00080000:2.0:1786562582.955472:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969304 00000020:00080000:0.0:1786562582.957316:0:33151:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969304 cancel update log [0x200000bd0:0x1:0x0].71: rc = 0 00000020:00080000:0.0:1786562582.957333:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969304 00010000:00010000:1.0:1786562583.337751:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562583.866367:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866447:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866486:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866511:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866529:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562583.866595:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652885632 00000100:00100000:3.0:1786562583.866604:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652885632 00000100:00100000:3.0:1786562583.866652:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 272 00000100:00100000:3.0:1786562583.866663:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+13:2350:x1873345652885632:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562583.866729:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+13:2350:x1873345652885632:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562583.866736:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 272 00000100:00100000:3.0:1786562583.866768:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886016 00000100:00100000:3.0:1786562583.866771:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886016 00000100:00100000:0.0:1786562583.866824:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886272 00000100:00100000:0.0:1786562583.866830:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886272 00000100:00100000:3.0:1786562583.866834:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652885888 00000100:00100000:3.0:1786562583.866840:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652885888 00000100:00100000:0.0:1786562583.866877:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886400 00000100:00100000:0.0:1786562583.866889:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886400 00000100:00100000:1.0:1786562583.866904:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 466 00000100:00100000:2.0:1786562583.866959:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652885760 00000100:00100000:2.0:1786562583.866964:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652885760 00000100:00100000:1.0:1786562583.867083:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+5:2350:x1873345652886016:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562583.867117:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+5:2350:x1873345652886016:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 205us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562583.867184:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886144 00000100:00100000:2.0:1786562583.867187:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886144 00000100:00100000:2.0:1786562583.867210:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 306 00000100:00100000:2.0:1786562583.867218:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652885760:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562583.867253:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652885760:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562583.867259:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 306 00000100:00100000:2.0:1786562583.867272:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 307 00000100:00100000:2.0:1786562583.867278:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+5:2350:x1873345652886144:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562583.867302:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a695a0-b685-4180-8888-8ba29614d6e8+5:2350:x1873345652886144:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562583.867308:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 307 00000100:00080000:2.0:1786562583.867362:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562583.867368:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562583.868104:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562583.872677:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 466 00000100:00100000:0.0:1786562583.872698:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 467 00000100:00100000:1.0:1786562583.872713:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 468 00000100:00100000:1.0:1786562583.872727:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a695a0-b685-4180-8888-8ba29614d6e8+6:2350:x1873345652886400:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562583.872804:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a695a0-b685-4180-8888-8ba29614d6e8+6:2350:x1873345652886400:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 84us (6237us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562583.872811:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 468 00000100:00100000:1.0:1786562583.873209:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 469 00000100:00100000:1.0:1786562583.873218:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+6:2350:x1873345652885888:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562583.873255:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+6:2350:x1873345652885888:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 39us (6744us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562583.873262:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 469 00000100:00100000:0.0:1786562583.875255:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+5:2350:x1873345652886272:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562583.875400:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16a695a0-b685-4180-8888-8ba29614d6e8+5:2350:x1873345652886272:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 2686us (8947us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562583.875412:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 467 00010000:00010000:0.0:1786562584.360437:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562584.869615:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654902912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562584.869704:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562584.869849:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654902912 00000100:00100000:3.0:1786562584.869859:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654902912 00000100:00100000:3.0:1786562584.869916:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1786562584.869926:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654902912:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786562584.870037:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1786562584.870084:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 523173888 pending 0 free 3834642432 avail 3832545280 00000100:00100000:3.0:1786562584.870156:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654902912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562584.870164:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1786562584.870211:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654902912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562584.870265:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654903040:0@lo:400:kworker.0 00000100:00100000:1.0:1786562584.870292:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654903296:0@lo:400:kworker.0 00000100:00100000:2.0:1786562584.870307:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562584.870346:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562584.870360:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654903168:0@lo:400:kworker.0 00000100:00100000:2.0:1786562584.870366:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654903552:0@lo:400:kworker.0 00000100:00100000:1.0:1786562584.873255:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562584.873275:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654903680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562584.874114:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903296 00000100:00100000:0.0:1786562584.874126:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903296 00000100:00100000:0.0:1786562584.874199:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1786562584.874221:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654903296:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786562584.874406:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562584.874475:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562584.874518:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562584.874526:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562584.874542:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654903424:0@lo:400:kworker.0 00000100:00100000:3.0:1786562584.874557:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903552 00000100:00100000:3.0:1786562584.874562:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903552 00000100:00100000:2.0:1786562584.874584:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562584.874594:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903168 00000100:00100000:3.0:1786562584.874598:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903168 00000100:00100000:3.0:1786562584.874632:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1786562584.874640:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654903552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562584.874642:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903040 00000100:00100000:2.0:1786562584.874650:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903040 00000100:00100000:3.0:1786562584.874690:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654903552:12345-0@lo:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562584.874698:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1786562584.874715:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1786562584.874721:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654903168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562584.874749:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654903168:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562584.874755:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:3.0:1786562584.874773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562584.874801:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654903552:0@lo:400:kworker.0 00000100:00100000:3.0:1786562584.874831:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654903168:0@lo:400:kworker.0 00000100:00100000:1.0:1786562584.875051:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562584.875397:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1786562584.875409:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654903040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562584.875463:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654903040:12345-0@lo:400:kworker.0 Request processed in 57us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562584.875470:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1786562584.875519:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903424 00000100:00100000:2.0:1786562584.875525:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903424 00000100:00100000:2.0:1786562584.875566:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1786562584.875573:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654903424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562584.875609:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654903424:12345-0@lo:400:kworker.0 Request processed in 38us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562584.875616:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1786562584.879353:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903680 00000100:00100000:3.0:1786562584.879370:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903680 00000100:00100000:3.0:1786562584.879448:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1786562584.879462:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654903680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562584.879509:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 352911360 pending 0 free 3847225344 avail 3845128192 00000100:00100000:3.0:1786562584.879610:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654903680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (4559us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562584.879619:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:3.0:1786562584.879647:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562584.879653:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876101 gen 2 00000004:00080000:2.0:1786562584.879660:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98553c380, transno 17179876101 00000100:00100000:2.0:1786562584.879714:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654903680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562584.879837:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654903424:0@lo:400:kworker.0 00000100:00100000:3.0:1786562584.879850:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654903040:0@lo:400:kworker.0 00000100:00100000:0.0:1786562584.884168:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654903296:12345-0@lo:400:kworker.0 Request processed in 9889us (13753us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562584.884183:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1786562584.884244:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654903296:0@lo:400:kworker.0 00000100:00100000:1.0:1786562585.148667:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562585.148746:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886656 00000100:00100000:2.0:1786562585.148756:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886656 00000100:00100000:2.0:1786562585.148865:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17169 00000100:00100000:2.0:1786562585.148876:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:65707:x1873345652886656:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:2.0:1786562585.148930:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786562585.148961:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4880200/0x5c655bf66689f9ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd075 expref: 9 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.148986:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689f922 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd059 expref: 8 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.148999:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b46ab600) 00010000:00010000:2.0:1786562585.149044:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689f93e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd060 expref: 7 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149054:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562585.149060:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562585.149087:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149099:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149108:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149120:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149127:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149134:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149518:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149528:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.149536:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786562585.150693:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4390, 64 off356176 00000004:00080000:2.0:1786562585.150706:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1017592699804ns, next at 1018592697158ns, rc = 0 00000040:00080000:2.0:1786562585.150728:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4391, 64 off356240 00000040:00080000:2.0:1786562585.150762:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4416, 64 off358616 00000004:00080000:2.0:1786562585.150767:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1017592761508ns, next at 1018592760584ns, rc = 0 00010000:00010000:2.0:1786562585.150843:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150855:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150865:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150872:0:34450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150879:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150886:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150913:0:34450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562585.150934:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150940:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150947:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150953:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562585.150957:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150965:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150976:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:2.0:1786562585.150979:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786562585.150984:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.150990:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa02 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4d9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151042:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151054:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151059:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151064:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562585.151068:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151074:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151082:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562585.151084:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562585.151088:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151093:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689f9f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562585.151108:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a2f183b reply state 000000005ebacf91 transno 8589950709 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562585.151116:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562585.151199:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:65707:x1873345652886656:12345-192.168.204.29@tcp:36:rm.0 Request processed in 2323us (2540us total) trans 8589950709 rc 0/0 00000100:00100000:2.0:1786562585.151208:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17169 00000100:00080000:3.0:1786562585.151291:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562585.151798:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562585.151804:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151812:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562585.151816:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151824:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151835:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4d9:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:2.0:1786562585.151837:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786562585.151840:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151846:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fa09 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4d9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.151861:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562585.151863:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562585.151865:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562585.166140:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.166158:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.166166:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.166173:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562585.166178:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.166185:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.166202:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa976bffe (ffff90e9b6332600) 00010000:00010000:0.0:1786562585.166205:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562585.166210:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.166216:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689f9fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa976bffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562585.383485:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562585.696813:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562585.700430:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886784 00000100:00100000:3.0:1786562585.700938:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886784 00000100:00100000:3.0:1786562585.702353:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17170 00000100:00100000:3.0:1786562585.702373:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:65720:x1873345652886784:12345-192.168.204.29@tcp:101:lsof.0 00010000:00010000:3.0:1786562585.702401:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562585.702429:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fa10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd091 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562585.703358:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf66689fa17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562585.703376:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf66689fa17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562585.703389:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf66689fa17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562585.703469:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1786562585.703474:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 36 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562585.704126:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf66689fa17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562585.704403:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fa10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd091 expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562585.704439:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf66689fa17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd091 expref: 8 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562585.704450:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:3.0:1786562585.704453:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562585.704456:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb200, rc 0) 00000100:00100000:3.0:1786562585.705927:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:65720:x1873345652886784:12345-192.168.204.29@tcp:101:lsof.0 Request processed in 3554us (9114us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562585.705939:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17170 00000100:00100000:3.0:1786562585.717354:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562585.717625:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652886912 00000100:00100000:2.0:1786562585.717635:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652886912 00000100:00100000:2.0:1786562585.717737:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17171 00000100:00100000:2.0:1786562585.717748:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:16a695a0-b685-4180-8888-8ba29614d6e8+5:65720:x1873345652886912:12345-192.168.204.29@tcp:101:lsof.0 00010000:00010000:2.0:1786562585.717769:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562585.717791:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fa1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd098 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.717860:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.717880:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.717892:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562585.717964:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562585.717968:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 36 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562585.718000:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.718052:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fa1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd098 expref: 7 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.718071:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd098 expref: 6 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562585.718079:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:2.0:1786562585.718082:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562585.718085:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562585.718404:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:16a695a0-b685-4180-8888-8ba29614d6e8+6:65720:x1873345652886912:12345-192.168.204.29@tcp:101:lsof.0 Request processed in 658us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562585.718412:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17171 00000100:00080000:3.0:1786562585.718473:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562586.405575:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562587.430061:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562587.701965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562587.702045:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562587.702566:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652887040 00000100:00100000:0.0:1786562587.702577:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652887040 00000100:00100000:0.0:1786562587.702643:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652887168 00000100:00100000:0.0:1786562587.702646:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652887168 00000100:00100000:0.0:1786562587.702682:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 988 00000100:00100000:0.0:1786562587.702692:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+14:2349:x1873345652887040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562587.702708:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562587.702730:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9850cbc00/0x5c655bf66689f6eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf64 expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562587.702747:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562587.702802:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+13:2349:x1873345652887040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 112us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562587.702811:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 988 00000100:00100000:0.0:1786562587.702830:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 989 00000100:00100000:0.0:1786562587.702837:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+12:2348:x1873345652887168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562587.702845:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562587.702855:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9af414800/0x5c655bf66689f6f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf8e expref: 12 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562587.702865:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562587.702884:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+11:2348:x1873345652887168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 47us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562587.702890:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 989 00000100:00100000:2.0:1786562587.711503:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562587.711721:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652887296 00000100:00100000:0.0:1786562587.711731:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652887296 00000100:00100000:0.0:1786562587.711801:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 990 00000100:00100000:0.0:1786562587.711813:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b4bd338-b43c-4989-b811-79054f6124e2+11:2348:x1873345652887296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562587.711832:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562587.711852:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4880c00/0x5c655bf66689f6f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfcf95 expref: 11 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562587.711872:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562587.711938:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652887296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 128us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562587.711945:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 990 00000100:00100000:0.0:1786562587.720721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562587.720858:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652887552 00000100:00100000:2.0:1786562587.720870:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652887552 00000100:00100000:2.0:1786562587.721242:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17872 00000100:00100000:2.0:1786562587.721265:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a695a0-b685-4180-8888-8ba29614d6e8+6:2347:x1873345652887552:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:2.0:1786562587.721301:0:6659:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689f70e 00000020:00010000:2.0:1786562587.721309:0:6659:0:(genops.c:1942:obd_stale_export_put()) Put export ffff90e88bfb4000: total 0 00000100:00080000:2.0:1786562587.721314:0:6659:0:(import.c:65:import_set_state_nolock()) ffff90e88bfb0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786562587.721365:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179876101 00000020:00010000:1.0:1786562587.721552:0:7599:0:(genops.c:1928:obd_stale_export_get()) Get export ffff90e88bfb4000: total 0 00010000:00010000:1.0:1786562587.721593:0:7599:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e88bfb4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1786562587.721656:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf66689f8ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd03d expref: 5 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562587.721696:0:7599:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e88bfb4000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1786562587.721709:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562587.721711:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562587.721713:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562587.722159:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a695a0-b685-4180-8888-8ba29614d6e8+2:2347:x1873345652887552:12345-192.168.204.29@tcp:9:umount.0 Request processed in 905us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562587.722169:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17872 00000100:00080000:3.0:1786562587.723206:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562587.728916:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562587.729038:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652887680 00000100:00100000:0.0:1786562587.729047:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652887680 00000100:00100000:0.0:1786562587.729119:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17873 00000100:00100000:0.0:1786562587.729130:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16a695a0-b685-4180-8888-8ba29614d6e8+5:2347:x1873345652887680:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:0.0:1786562587.729162:0:6658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689f707 00000100:00080000:0.0:1786562587.729171:0:6658:0:(import.c:65:import_set_state_nolock()) ffff90e9b452a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786562587.729222:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843621 00000100:00100000:0.0:1786562587.729538:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16a695a0-b685-4180-8888-8ba29614d6e8+2:2347:x1873345652887680:12345-192.168.204.29@tcp:9:umount.0 Request processed in 409us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562587.729547:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17873 00010000:00010000:0.0:1786562587.729664:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786562587.730262:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562587.744234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562587.744346:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652887936 00000100:00100000:0.0:1786562587.744357:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652887936 00000100:00100000:0.0:1786562587.744437:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17172 00000100:00100000:0.0:1786562587.744460:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+6:2347:x1873345652887936:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:0.0:1786562587.744494:0:35929:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf66689f700 00000020:00010000:0.0:1786562587.744502:0:35929:0:(genops.c:1942:obd_stale_export_put()) Put export ffff90e9b452e800: total 0 00000100:00080000:0.0:1786562587.744507:0:35929:0:(import.c:65:import_set_state_nolock()) ffff90e9b4528800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786562587.744552:0:35929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589950709 00000100:00100000:0.0:1786562587.744891:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16a695a0-b685-4180-8888-8ba29614d6e8+5:2347:x1873345652887936:12345-192.168.204.29@tcp:39:umount.0 Request processed in 445us (668us total) trans 8589950710 rc 0/0 00000100:00100000:0.0:1786562587.744900:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17172 00000020:00010000:2.0:1786562587.745198:0:8412:0:(genops.c:1928:obd_stale_export_get()) Get export ffff90e9b452e800: total 0 00010000:00010000:2.0:1786562587.745204:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562587.745250:0:8412:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e9b452e800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1786562587.745299:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:2.0:1786562587.745304:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562587.745313:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fa25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd098 expref: 4 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562587.745332:0:8412:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e9b452e800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1786562587.745342:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562587.745344:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562587.745345:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786562587.746220:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1786562588.028090:0:33119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16a695a0-b685-4180-8888-8ba29614d6e8 00000001:00080000:3.0:1786562588.028108:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950710 is committed 00000020:00000080:3.0:1786562588.028114:0:33119:0:(genops.c:906:class_export_put()) final put ffff90e9b452e800/16a695a0-b685-4180-8888-8ba29614d6e8 00000001:00080000:3.0:1786562588.028142:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950709 is committed 00000004:00080000:3.0:1786562588.028148:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2919 committed 00000020:00000080:1.0:1786562588.028236:0:37431:0:(genops.c:865:class_export_destroy()) destroying export ffff90e9b452e800/16a695a0-b685-4180-8888-8ba29614d6e8 for lustre-MDT0000 00000020:00000080:1.0:1786562588.028310:0:37431:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e9b4528800 for lustre-MDT0000 00000100:00100000:0.0:1786562588.028492:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562588.028512:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654903808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786562588.028589:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562588.028659:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903808 00000100:00100000:0.0:1786562588.028683:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903808 00000100:00100000:0.0:1786562588.028742:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17874 00000100:00100000:0.0:1786562588.028751:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654903808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786562588.028784:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1818 count 1 00002000:00010000:0.0:1786562588.028818:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71a:0x0] initial LVB size: 0, mtime: 0x6a7cc808, atime: 0x6a7cc808, ctime: 0x6a7cc80d, blocks: 0x1 00010000:00010000:0.0:1786562588.028827:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.028845:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=1020s v=(0 0) 00010000:00010000:0.0:1786562588.028850:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562588.028858:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.028872:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.028883:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.028897:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.028916:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562588.029495:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654903808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 742us (902us total) trans 17179876102 rc 0/0 00000100:00100000:0.0:1786562588.029505:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17874 00010000:00010000:0.0:1786562588.029538:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562588.029544:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.029554:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562588.029559:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.029568:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.029585:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.029593:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001122ba44/0x5c655bf66689fa2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.029611:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562588.029614:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562588.029615:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786562588.029625:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1786562588.029661:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c52c700/2, rc 0, transno 17179876102 00000100:00100000:0.0:1786562588.029667:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654903808:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786562588.030235:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2892 committed 00000100:00100000:1.0:1786562588.030682:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654903936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562588.030741:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562588.030794:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654903936 00000100:00100000:1.0:1786562588.030801:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654903936 00000100:00100000:1.0:1786562588.030847:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17875 00000100:00100000:1.0:1786562588.030856:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654903936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562588.030882:0:28861:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1845 count 1 00010000:00010000:1.0:1786562588.030905:0:28861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.030922:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.030930:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=8s v=(0 0) 00010000:00010000:1.0:1786562588.030935:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562588.030939:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.030965:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.030978:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 5 pid: 6658 timeout: 1120 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562588.030990:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654904064:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562588.031068:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfc44f00 going to sleep for 11 seconds 00000100:00080000:2.0:1786562588.033703:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562588.036150:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654904064:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562588.036185:0:28861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562588.040237:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562588.040502:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888064 00000100:00100000:0.0:1786562588.040512:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888064 00010000:00010000:0.0:1786562588.040602:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 6 pid: 6658 timeout: 1120 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562588.040645:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8746 00000100:00100000:0.0:1786562588.040655:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a98cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652888064:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562588.040671:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562588.040677:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 6 pid: 6658 timeout: 1120 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786562588.040830:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786562588.040864:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 6 pid: 6658 timeout: 1120 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.040892:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97444f1/0x5c655bf66689f9b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd07c expref: 6 pid: 6658 timeout: 1120 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.040911:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562588.040917:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562588.040923:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.040938:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562588.041549:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562588.041634:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a98cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+5:2348:x1873345652888064:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 978us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562588.041644:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8746 00010000:00010000:2.0:1786562588.047546:0:28861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562588.047569:0:28861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562588.047583:0:28861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562588.047592:0:28861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562588.047675:0:28861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786562588.048487:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654903936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17627us (17740us total) trans 21474843622 rc 0/0 00000100:00100000:2.0:1786562588.048500:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17875 00000004:00080000:3.0:1786562588.048602:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bd1a300/2, rc 0, transno 21474843622 00000100:00100000:3.0:1786562588.048626:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654903936:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786562588.052903:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562588.052923:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.052939:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562588.052945:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.052961:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.052988:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.052996:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fa33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562588.053119:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562588.053122:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562588.053124:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562588.454316:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786562588.487095:0:37372:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16a695a0-b685-4180-8888-8ba29614d6e8 00000020:00000080:0.0:1786562588.487103:0:37372:0:(genops.c:906:class_export_put()) final put ffff90e9b452f800/16a695a0-b685-4180-8888-8ba29614d6e8 00000001:00080000:0.0:1786562588.487142:0:37372:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843622 is committed 00000020:00000080:2.0:1786562588.487268:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff90e9b452f800/16a695a0-b685-4180-8888-8ba29614d6e8 for lustre-OST0000 00000020:00000080:2.0:1786562588.487316:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e9b452a000 for lustre-OST0000 00000100:00100000:1.0:1786562588.987119:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562588.987163:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562588.987403:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888320 00000100:00100000:2.0:1786562588.987413:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888320 00000100:00100000:2.0:1786562588.987499:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 311 00000100:00100000:2.0:1786562588.987511:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652888320:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562588.987591:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652888320:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 82us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562588.987600:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 311 00000100:00080000:0.0:1786562588.987768:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562588.988076:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562588.988137:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888448 00000100:00100000:0.0:1786562588.988143:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888448 00000100:00100000:0.0:1786562588.988182:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 471 00000100:00100000:0.0:1786562588.988190:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652888448:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562588.988252:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+5:2351:x1873345652888448:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562588.988259:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 471 00000100:00100000:3.0:1786562588.992002:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888192 00000100:00100000:3.0:1786562588.992193:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888192 00000100:00100000:2.0:1786562588.992366:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562588.992654:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888576 00000100:00100000:1.0:1786562588.992659:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888576 00000100:00100000:1.0:1786562588.992737:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17876 00000100:00100000:1.0:1786562588.992748:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+5:2347:x1873345652888576:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1786562588.992790:0:12119:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5c655bf6668383af 00000100:00080000:1.0:1786562588.992810:0:12119:0:(import.c:65:import_set_state_nolock()) ffff90e9bfa5d800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1786562588.992855:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562588.996441:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 274 00000100:00100000:0.0:1786562588.996457:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652888192:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562588.996565:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652888192:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 110us (9400us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562588.996573:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 274 00000001:00000004:1.0:1786562589.003564:0:12119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179876102 00000100:00100000:1.0:1786562589.003811:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+2:2347:x1873345652888576:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 11058us (11442us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562589.003829:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17876 00010000:00010000:0.0:1786562589.016615:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562589.480349:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786562589.609651:0:37712:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_201 skipping ALWAYS excluded test 201 00000004:00080000:2.0:1786562589.989340:0:33136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1022431330861ns, next at 1023431328758ns, rc = 0 00000100:00100000:3.0:1786562589.993173:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654904192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562589.993271:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562589.993550:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786562589.993560:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654904320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562589.993593:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562589.993637:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654904192 00000100:00100000:0.0:1786562589.993644:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654904192 00000100:00100000:0.0:1786562589.993687:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654904320 00000100:00100000:0.0:1786562589.993691:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654904320 00000100:00100000:0.0:1786562589.993706:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1786562589.993715:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654904192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562589.993752:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 516358144 pending 0 free 3836739584 avail 3834642432 00000100:00100000:0.0:1786562589.993796:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654904192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562589.993803:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1786562589.993986:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1786562589.993994:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654904320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562589.994045:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 34275328 pending 0 free 3847225344 avail 3845128192 00000100:00100000:0.0:1786562589.994075:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654904320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562589.994080:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1786562589.994119:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654904320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562589.994145:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843622 gen 2 00000004:00080000:0.0:1786562589.994149:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bd1a300, transno 21474843622 00000100:00100000:0.0:1786562589.994161:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654904192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562589.995140:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654904576:0@lo:400:kworker.0 00000100:00100000:3.0:1786562589.995185:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562589.995230:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562589.995235:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654904704:0@lo:400:kworker.0 00000100:00100000:3.0:1786562589.995254:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562589.995279:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654904576 00000100:00100000:3.0:1786562589.995284:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654904576 00000100:00100000:3.0:1786562589.995320:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654904704 00000100:00100000:3.0:1786562589.995324:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654904704 00000100:00100000:3.0:1786562589.995344:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1786562589.995351:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654904576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562589.996990:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1786562589.997024:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654904704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562589.997095:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654904704:12345-0@lo:400:kworker.0 Request processed in 96us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562589.997102:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1786562589.997163:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654904832:0@lo:400:kworker.0 00000100:00100000:1.0:1786562589.997193:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562589.997238:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562589.997245:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654904448:0@lo:400:kworker.0 00000100:00100000:1.0:1786562589.997276:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562589.997306:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654904832 00000100:00100000:1.0:1786562589.997312:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654904832 00000100:00100000:1.0:1786562589.997343:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1786562589.997349:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654904832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562589.997896:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654904576:12345-0@lo:400:kworker.0 Request processed in 2543us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562589.997909:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1786562589.997953:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654904704:0@lo:400:kworker.0 00000100:00100000:3.0:1786562589.997966:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654904576:0@lo:400:kworker.0 00000100:00080000:2.0:1786562589.999929:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562590.000106:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654904448 00000100:00100000:2.0:1786562590.000116:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654904448 00000100:00100000:2.0:1786562590.000157:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1786562590.000166:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654904448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562590.000781:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654904448:0@lo:400:kworker.0 00000100:00100000:1.0:1786562590.004440:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654904832:12345-0@lo:400:kworker.0 Request processed in 7077us (7232us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562590.004457:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1786562590.004529:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654904832:0@lo:400:kworker.0 00000100:00100000:2.0:1786562590.005637:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654904448:12345-0@lo:400:kworker.0 Request processed in 5467us (8354us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562590.005650:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000001:00080000:0.0:1786562590.063454:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876102 is committed 00000001:00100000:0.0:1786562590.063483:0:27136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cae43410-29f4-4da8-9608-d4626744ead5 00000020:00000080:0.0:1786562590.063487:0:27136:0:(genops.c:906:class_export_put()) final put ffff90e9bfa58000/cae43410-29f4-4da8-9608-d4626744ead5 00000001:00100000:0.0:1786562590.063529:0:27136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16a695a0-b685-4180-8888-8ba29614d6e8 00000020:00000080:0.0:1786562590.063531:0:27136:0:(genops.c:906:class_export_put()) final put ffff90e88bfb4000/16a695a0-b685-4180-8888-8ba29614d6e8 00000020:00000080:1.0:1786562590.063644:0:37431:0:(genops.c:865:class_export_destroy()) destroying export ffff90e9bfa58000/cae43410-29f4-4da8-9608-d4626744ead5 for lustre-OST0001 00000020:00000080:1.0:1786562590.063714:0:37431:0:(genops.c:865:class_export_destroy()) destroying export ffff90e88bfb4000/16a695a0-b685-4180-8888-8ba29614d6e8 for lustre-OST0001 00000020:00000080:1.0:1786562590.063733:0:37431:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e9bfa5d800 for lustre-OST0001 00000020:00000080:1.0:1786562590.063738:0:37431:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90e88bfb0800 for lustre-OST0001 00010000:00010000:0.0:1786562590.501708:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786562591.437833:0:37762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 202: lfs setstripe --add-component wide striping ========================================================== 15:23:09 (1786562589) 00010000:00010000:1.0:1786562591.527484:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562591.741489:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562591.742270:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888704 00000100:00100000:0.0:1786562591.742282:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888704 00000100:00100000:0.0:1786562591.742359:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17173 00000100:00100000:0.0:1786562591.742371:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:66010:x1873345652888704:12345-192.168.204.29@tcp:101:lfs.0 00000100:00080000:2.0:1786562591.742378:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562591.742393:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562591.742459:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689fa3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd09f expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.742532:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.742547:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.742561:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.742711:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.742720:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.742727:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743152:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743162:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743168:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743189:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.743193:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743201:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743214:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:0.0:1786562591.743218:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.743222:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743228:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743239:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743245:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743250:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743256:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.743259:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743265:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743273:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab100) 00010000:00010000:0.0:1786562591.743275:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.743278:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743285:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743322:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689fa3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd09f expref: 8 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743332:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:0.0:1786562591.743335:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.743339:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf66689fa3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd09f expref: 8 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.743347:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:0.0:1786562591.743412:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:66010:x1873345652888704:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1043us (1932us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562591.743420:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17173 00000100:00100000:2.0:1786562591.764431:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562591.764542:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652888960 00000100:00100000:1.0:1786562591.764553:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652888960 00000100:00100000:1.0:1786562591.764615:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17174 00000100:00100000:1.0:1786562591.764627:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:66010:x1873345652888960:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562591.764650:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562591.764653:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562591.764692:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf66689fa17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd091 expref: 7 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.764713:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:1.0:1786562591.764725:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562591.764741:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fa4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0a6 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.765121:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.765134:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.765144:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.765157:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.765164:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.765182:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766135:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766149:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766159:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562591.766170:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00010000:00010000:1.0:1786562591.766208:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766215:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766221:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766227:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562591.766231:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766239:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766249:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562591.766252:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562591.766255:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766264:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562591.766277:0:35929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098107943 reply state 000000003e240191 transno 8589950711 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562591.766285:0:35929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786562591.766317:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fa4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766337:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 8 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.766345:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562591.766347:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562591.766350:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3400, rc 0) 00000100:00100000:1.0:1786562591.766420:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:66010:x1873345652888960:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1795us (1998us total) trans 8589950711 rc 0/0 00000100:00100000:1.0:1786562591.766429:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17174 00010000:00010000:1.0:1786562591.770822:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.770839:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.770847:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.770854:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562591.770860:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.770867:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.770884:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562591.770887:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562591.770893:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.770899:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa5d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562591.777120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562591.777406:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652889216 00000100:00100000:0.0:1786562591.777417:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652889216 00000100:00100000:0.0:1786562591.777479:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17175 00000100:00100000:0.0:1786562591.777488:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:66010:x1873345652889216:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562591.777512:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562591.777535:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0ad expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.778299:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.778317:0:36756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.778327:0:36756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.778363:0:36756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.778378:0:36756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 9 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562591.778394:0:36756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654904960:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562591.779525:0:36756:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8810df840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562591.782139:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654904960:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562591.782170:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562591.784405:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562591.784502:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652889344 00000100:00100000:3.0:1786562591.784513:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652889344 00010000:00010000:3.0:1786562591.784555:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 10 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562591.784595:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8747 00000100:00100000:3.0:1786562591.784605:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652889344:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562591.784621:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562591.784628:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 10 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562591.784641:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 10 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562591.784662:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fa64 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0a6 expref: 10 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562591.784680:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562591.784686:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562591.784695:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562591.784707:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562591.784738:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562591.784795:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652889344:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 191us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562591.784803:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8747 00010000:00010000:0.0:1786562591.785732:0:36756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.785743:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562591.785761:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00080000:0.0:1786562591.786094:0:36756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x737:0x0], index 0: 0 00010000:00010000:0.0:1786562591.786243:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786252:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786259:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786265:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.786269:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786276:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786289:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:0.0:1786562591.786292:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562591.786296:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786301:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa79 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786367:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0ad expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786386:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab100) 00010000:00010000:0.0:1786562591.786388:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562591.786393:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0ad expref: 9 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.786406:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562591.786466:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:66010:x1873345652889216:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8979us (9357us total) trans 8589950712 rc 301/301 00000100:00100000:0.0:1786562591.786475:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17175 00000100:00100000:2.0:1786562591.794982:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562591.795241:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652889600 00000100:00100000:1.0:1786562591.795251:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652889600 00000100:00100000:1.0:1786562591.795308:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6303 00000100:00100000:1.0:1786562591.795318:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986375850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:66010:x1873345652889600:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562591.795846:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986375850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:66010:x1873345652889600:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 527us (871us total) trans 8589950713 rc 0/0 00000100:00100000:1.0:1786562591.795855:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6303 00000100:00100000:3.0:1786562591.800365:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562591.800882:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652889856 00000100:00100000:0.0:1786562591.800892:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652889856 00000100:00100000:0.0:1786562591.801043:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6304 00000100:00100000:0.0:1786562591.801055:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:66010:x1873345652889856:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562591.801328:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+10:66010:x1873345652889856:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 275us (982us total) trans 8589950714 rc 0/0 00000100:00100000:0.0:1786562591.801336:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6304 00000100:00100000:3.0:1786562591.882606:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562591.882806:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652889984 00000100:00100000:1.0:1786562591.882818:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652889984 00000100:00100000:1.0:1786562591.882890:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17176 00000100:00100000:1.0:1786562591.882901:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:66016:x1873345652889984:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562591.882927:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562591.882951:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0b4 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.883653:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.883671:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.883683:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562591.883752:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1786562591.883756:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 37 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562591.883781:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.883809:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fa87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0b4 expref: 12 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.883829:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0b4 expref: 11 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562591.883839:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562591.883842:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786562591.883846:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3200, rc 0) 00000100:00100000:1.0:1786562591.883966:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:66016:x1873345652889984:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1066us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562591.883975:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17176 00000100:00100000:2.0:1786562591.891646:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562591.895600:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652890240 00000100:00100000:0.0:1786562591.895617:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652890240 00000100:00100000:0.0:1786562591.895702:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17177 00000100:00100000:0.0:1786562591.895713:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:66016:x1873345652890240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562591.895734:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562591.895757:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0bb expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.895833:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.895848:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.895860:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.895875:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.895882:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.895888:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897327:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897342:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897349:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897522:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.897528:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897540:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897556:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562591.897560:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.897565:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897572:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fa9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897588:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897594:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897600:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897607:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.897610:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897616:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897623:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab100) 00010000:00010000:0.0:1786562591.897626:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.897629:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897639:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897686:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0bb expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897696:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562591.897699:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562591.897702:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fa95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0bb expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.897712:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562591.897846:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:66016:x1873345652890240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2134us (6208us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562591.897856:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17177 00000100:00100000:3.0:1786562591.908668:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562591.912323:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652890368 00000100:00100000:0.0:1786562591.912340:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652890368 00000100:00100000:2.0:1786562591.912680:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17178 00000100:00100000:2.0:1786562591.912692:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:66016:x1873345652890368:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562591.912770:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912790:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912801:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912818:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912826:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912833:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912941:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912951:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.912958:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562591.912993:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:2.0:1786562591.912997:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562591.913035:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913049:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913055:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913062:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913068:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562591.913072:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913080:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913092:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562591.913095:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562591.913100:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913106:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689faaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913120:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913125:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913131:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913136:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562591.913139:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913145:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913152:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332700) 00010000:00010000:2.0:1786562591.913154:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562591.913157:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913166:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913190:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913196:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913200:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.913205:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562591.913208:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.914626:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.914651:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332900) 00010000:00010000:2.0:1786562591.914654:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562591.914658:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.914664:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fab8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562591.914782:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:66016:x1873345652890368:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2088us (6121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562591.914792:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17178 00000100:00100000:3.0:1786562591.969670:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562591.971534:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652890624 00000100:00100000:0.0:1786562591.971549:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652890624 00000100:00100000:0.0:1786562591.971628:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17179 00000100:00100000:0.0:1786562591.971639:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+11:66023:x1873345652890624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562591.971681:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562591.971702:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fabf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0c2 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971815:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971832:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971844:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971859:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971866:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971872:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971971:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971978:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971985:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.971991:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.971995:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972002:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972059:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562591.972062:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.972067:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972072:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972084:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972089:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972094:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972099:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562591.972101:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972106:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972112:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab100) 00010000:00010000:0.0:1786562591.972114:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562591.972117:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972122:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689facd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972152:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fabf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c2 expref: 12 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972163:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562591.972166:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562591.972180:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fabf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c2 expref: 12 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562591.972189:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562591.972259:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+11:66023:x1873345652890624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 622us (2599us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562591.972266:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17179 00000100:00100000:1.0:1786562591.975703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562591.975872:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652890752 00000100:00100000:2.0:1786562591.975881:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652890752 00000100:00100000:2.0:1786562591.975937:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17180 00000100:00100000:2.0:1786562591.975948:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:66023:x1873345652890752:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562591.976048:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976066:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976079:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976095:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976103:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976110:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976244:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976253:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976260:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562591.976295:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:2.0:1786562591.976300:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562591.976312:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976324:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976330:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976337:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976343:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562591.976346:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976363:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976376:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562591.976379:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562591.976383:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976390:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976403:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976409:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976419:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976424:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562591.976426:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976432:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976438:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332900) 00010000:00010000:2.0:1786562591.976440:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562591.976442:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976447:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fadb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976460:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976466:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976472:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976477:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562591.976479:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976487:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976493:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332700) 00010000:00010000:2.0:1786562591.976495:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562591.976498:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562591.976502:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fae2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562591.976595:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:66023:x1873345652890752:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 647us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562591.976603:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17180 00000100:00100000:3.0:1786562592.074498:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.074622:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652890880 00000100:00100000:0.0:1786562592.074638:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652890880 00000100:00100000:0.0:1786562592.074718:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17181 00000100:00100000:0.0:1786562592.074729:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:66027:x1873345652890880:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562592.074751:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562592.074773:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fae9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0c9 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074842:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074856:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074866:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074881:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074890:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074896:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.074998:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075034:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075040:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562592.075069:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:0.0:1786562592.075074:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562592.075092:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075103:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075111:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075118:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075125:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075136:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.075139:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075146:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075157:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562592.075160:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.075175:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075182:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689faf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075197:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075203:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075214:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075219:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.075222:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075227:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075238:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab100) 00010000:00010000:0.0:1786562592.075241:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.075243:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075249:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689faf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075280:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fae9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 13 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075294:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 12 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.075301:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.075304:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562592.075306:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:0.0:1786562592.075438:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+12:66027:x1873345652890880:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 710us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562592.075446:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17181 00000100:00100000:3.0:1786562592.086342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.089908:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652891008 00000100:00100000:2.0:1786562592.089931:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652891008 00000100:00100000:2.0:1786562592.090933:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17877 00000100:00100000:2.0:1786562592.090960:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+5:2348:x1873345652891008:12345-192.168.204.29@tcp:101:lfs.0 00000100:00080000:0.0:1786562592.090978:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562592.090989:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562592.091050:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0d0 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562592.091088:0:29963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786562592.091116:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x737:0x0].0x0 since=1024s v=(0 0) 00010000:00010000:2.0:1786562592.091123:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562592.091137:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 6 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.091176:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 6 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.091192:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562592.091300:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652891008:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 352us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.091308:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17877 00000100:00100000:3.0:1786562592.099234:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.099877:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652891264 00000100:00100000:0.0:1786562592.099891:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652891264 00000100:00100000:0.0:1786562592.099971:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17182 00000100:00100000:0.0:1786562592.099986:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:66027:x1873345652891264:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562592.100046:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562592.100076:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fb0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0d7 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.100246:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fb13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.100266:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fb13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.100281:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fb13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562592.100296:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00010000:00010000:0.0:1786562592.100671:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fb0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d7 expref: 15 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.100695:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fb13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d7 expref: 14 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.100705:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.100709:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562592.100713:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269200, rc 0) 00000100:00100000:0.0:1786562592.100932:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:66027:x1873345652891264:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 949us (1720us total) trans 8589950715 rc 0/0 00000100:00100000:0.0:1786562592.100943:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17182 00000100:00100000:3.0:1786562592.108234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562592.108294:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.108470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652891392 00000100:00100000:0.0:1786562592.108484:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652891392 00000100:00100000:0.0:1786562592.108580:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 991 00000100:00100000:0.0:1786562592.108593:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:2349:x1873345652891392:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562592.108617:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562592.108654:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fb13 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d7 expref: 14 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.108681:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.108687:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562592.108774:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:2349:x1873345652891392:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 170us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562592.108784:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 991 00000100:00100000:2.0:1786562592.110051:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652891648 00000100:00100000:2.0:1786562592.110074:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652891648 00000100:00100000:2.0:1786562592.110180:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6305 00000100:00100000:2.0:1786562592.110192:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:66027:x1873345652891648:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562592.110686:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+14:66027:x1873345652891648:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 495us (2389us total) trans 8589950716 rc 0/0 00000100:00100000:2.0:1786562592.110696:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6305 00000100:00100000:3.0:1786562592.115438:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562592.115639:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652891904 00000100:00100000:1.0:1786562592.115653:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652891904 00000100:00100000:1.0:1786562592.115737:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17183 00000100:00100000:1.0:1786562592.115750:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:66027:x1873345652891904:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562592.115795:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562592.115825:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fb21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0de expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.116042:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.116061:0:33113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 15 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.116073:0:33113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.116121:0:33113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 15 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.116137:0:33113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 15 pid: 33115 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.116155:0:33113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654905088:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562592.116301:0:33113:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562592.126114:0:33113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654905088:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562592.126161:0:33113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562592.128432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562592.128829:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652892032 00000100:00100000:1.0:1786562592.128843:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652892032 00010000:00010000:1.0:1786562592.128899:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 16 pid: 33115 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.128955:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8748 00000100:00100000:1.0:1786562592.128970:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:2349:x1873345652892032:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562592.128992:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562592.129050:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 16 pid: 33115 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.129069:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 16 pid: 33115 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.129099:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf66689fafe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0c9 expref: 16 pid: 33115 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.129120:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:1.0:1786562592.129126:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.129139:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.129148:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.129195:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562592.129281:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652892032:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 315us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562592.129289:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8748 00010000:00010000:2.0:1786562592.129602:0:33113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.129613:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562592.129647:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00010000:00010000:2.0:1786562592.130089:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fb21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 16 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.130113:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 15 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.130122:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:2.0:1786562592.130124:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786562592.130127:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3400, rc 0) 00000100:00100000:2.0:1786562592.130178:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:66027:x1873345652891904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 14431us (14766us total) trans 8589950717 rc 0/0 00000100:00100000:2.0:1786562592.130186:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17183 00000100:00100000:3.0:1786562592.134106:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562592.135721:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652892160 00000100:00100000:1.0:1786562592.135743:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652892160 00000100:00100000:1.0:1786562592.135848:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17184 00000100:00100000:1.0:1786562592.135860:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:66027:x1873345652892160:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562592.135896:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562592.135925:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fb36 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0e5 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.136089:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.136109:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 16 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.136119:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.136177:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 16 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.136193:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 16 pid: 33113 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.136411:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654905216:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562592.136548:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988224d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562592.142178:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.142261:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652892288 00000100:00100000:2.0:1786562592.142279:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652892288 00010000:00010000:2.0:1786562592.142348:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 17 pid: 33113 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.142413:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8749 00000100:00100000:2.0:1786562592.142425:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652892288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562592.142446:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562592.142455:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 17 pid: 33113 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.142487:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 17 pid: 33113 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.142526:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:2.0:1786562592.142533:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.142546:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.142561:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.142597:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562592.142677:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652892288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 254us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.142687:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8749 00010000:00010000:1.0:1786562592.143087:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb28 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4db:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0de expref: 16 pid: 33113 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.143111:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345654905216:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562592.143145:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.143157:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.143177:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562592.143300:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:1.0:1786562592.143307:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562592.143335:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.143377:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fb36 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.143398:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.143408:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:1.0:1786562592.143411:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562592.143414:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2a00, rc 0) 00000100:00100000:1.0:1786562592.144637:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:66027:x1873345652892160:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8764us (10526us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562592.144653:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17184 00000100:00100000:3.0:1786562592.156691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.156844:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652892544 00000100:00100000:2.0:1786562592.156857:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652892544 00000100:00100000:2.0:1786562592.156940:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17185 00000100:00100000:2.0:1786562592.156953:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:66027:x1873345652892544:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562592.157121:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.157144:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.157158:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.157239:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.157254:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 15 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.157272:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654905344:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562592.157391:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8811869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562592.161634:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.161798:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654905344:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562592.161832:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562592.165308:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652892672 00000100:00100000:0.0:1786562592.165331:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652892672 00010000:00010000:0.0:1786562592.165821:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 16 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562592.165886:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8750 00000100:00100000:0.0:1786562592.165900:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:2349:x1873345652892672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562592.165921:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562592.165929:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 16 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.165945:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 16 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.165977:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fb3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0e5 expref: 16 pid: 35929 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.166002:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.166061:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.166074:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.166083:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.166122:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562592.166703:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652892672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 802us (5082us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562592.166716:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8750 00010000:00010000:2.0:1786562592.167060:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.167072:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562592.167553:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3492113 reply state 00000000da717991 transno 8589950718 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.167566:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562592.167651:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:66027:x1873345652892544:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 10699us (10978us total) trans 8589950718 rc 0/0 00000100:00100000:2.0:1786562592.167661:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17185 00010000:00010000:0.0:1786562592.177370:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562592.177402:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1786562592.177700:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.178137:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652892928 00000100:00100000:1.0:1786562592.178150:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652892928 00000100:00100000:1.0:1786562592.178257:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6306 00000100:00100000:1.0:1786562592.178268:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:66027:x1873345652892928:12345-192.168.204.29@tcp:35:lfs.0 00010000:00010000:0.0:1786562592.178695:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.178714:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.178720:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.178732:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.178753:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.178756:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:0.0:1786562592.178772:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.178784:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689fb44 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.178791:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:66027:x1873345652892928:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 523us (1396us total) trans 8589950719 rc 0/0 00000100:00100000:1.0:1786562592.178800:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6306 00000100:00100000:1.0:1786562592.208052:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562592.208738:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652893184 00000100:00100000:3.0:1786562592.208754:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652893184 00000100:00100000:3.0:1786562592.208885:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17186 00000100:00100000:3.0:1786562592.208899:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66029:x1873345652893184:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562592.208941:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562592.208977:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0ec expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209299:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209319:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209333:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209350:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209357:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209363:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209501:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209508:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209515:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209522:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562592.209528:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209536:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209551:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562592.209555:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562592.209560:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209568:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fb52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209583:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209589:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209595:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209600:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562592.209603:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209610:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209618:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562592.209620:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562592.209623:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209629:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fb59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209676:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fb4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0ec expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209687:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562592.209689:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562592.209692:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0ec expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.209701:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca800, rc 0) 00000100:00100000:3.0:1786562592.209804:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66029:x1873345652893184:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 907us (1767us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562592.209812:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17186 00000100:00100000:3.0:1786562592.219333:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.219724:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652893312 00000100:00100000:2.0:1786562592.219740:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652893312 00000100:00100000:2.0:1786562592.219892:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17187 00000100:00100000:2.0:1786562592.219906:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:66029:x1873345652893312:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562592.220061:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220082:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220096:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220116:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220124:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220131:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220516:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220526:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220534:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562592.220579:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:2.0:1786562592.220585:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562592.220601:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220618:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220625:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220633:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220645:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.220650:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220659:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220786:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562592.220790:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.220795:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220802:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220819:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220824:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220830:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220835:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.220839:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220845:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220857:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.220860:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.220863:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220869:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220887:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220893:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220899:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220904:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.220907:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220912:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220920:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332300) 00010000:00010000:2.0:1786562592.220922:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.220925:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.220931:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb6e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.221159:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:66029:x1873345652893312:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1251us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.221180:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17187 00000100:00100000:0.0:1786562592.270069:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562592.270192:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652893568 00000100:00100000:1.0:1786562592.270206:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652893568 00000100:00100000:1.0:1786562592.270395:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17188 00000100:00100000:1.0:1786562592.270408:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:66033:x1873345652893568:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562592.270446:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562592.270487:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0f3 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270589:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270605:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270618:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270636:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270644:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270652:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270797:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270806:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270814:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270820:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562592.270826:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270834:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270848:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562592.270852:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562592.270858:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270864:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fb7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270882:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270889:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270896:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270901:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562592.270904:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270910:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270918:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562592.270920:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562592.270923:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270929:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fb83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270972:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0f3 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270983:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562592.270985:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562592.270989:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0f3 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.270998:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3400, rc 0) 00000100:00100000:1.0:1786562592.271139:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:66033:x1873345652893568:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 734us (1143us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562592.271152:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17188 00000100:00100000:3.0:1786562592.285080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.285284:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652893696 00000100:00100000:2.0:1786562592.285297:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652893696 00000100:00100000:2.0:1786562592.285431:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17189 00000100:00100000:2.0:1786562592.285445:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:66033:x1873345652893696:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562592.285568:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285590:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285604:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285623:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285631:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285638:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285789:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285797:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285806:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562592.285850:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:2.0:1786562592.285856:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562592.285870:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285888:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285895:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285903:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285910:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.285915:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285923:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285938:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562592.285941:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.285946:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285952:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fb8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285971:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285978:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285984:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285990:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.285993:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.285999:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286072:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332300) 00010000:00010000:2.0:1786562592.286074:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.286078:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286083:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fb91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286097:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286103:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286109:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286114:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.286117:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286123:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286131:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.286133:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.286136:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.286142:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fb98 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.286255:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:66033:x1873345652893696:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 811us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.286265:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17189 00000100:00100000:3.0:1786562592.325565:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.325927:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652893952 00000100:00100000:0.0:1786562592.325941:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652893952 00000100:00100000:0.0:1786562592.326118:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17190 00000100:00100000:0.0:1786562592.326131:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66035:x1873345652893952:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562592.326172:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562592.326201:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fb9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd0fa expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326312:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326330:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326344:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326361:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326368:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326375:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326694:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326704:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326712:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326718:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.326724:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326732:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326749:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562592.326753:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.326759:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326766:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326783:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326790:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326796:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326802:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.326805:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326812:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326820:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.326823:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.326826:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326832:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326883:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fb9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0fa expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326895:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562592.326898:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562592.326902:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fb9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0fa expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.326913:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268800, rc 0) 00000100:00100000:0.0:1786562592.327051:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66035:x1873345652893952:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 877us (1458us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562592.327060:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17190 00000100:00100000:0.0:1786562592.331407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.331661:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652894080 00000100:00100000:2.0:1786562592.331683:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652894080 00000100:00100000:2.0:1786562592.331759:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17191 00000100:00100000:2.0:1786562592.331771:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:66035:x1873345652894080:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562592.331872:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.331892:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.331904:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.331921:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.331929:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.331935:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332107:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332117:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332125:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562592.332180:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00000004:00200000:2.0:1786562592.332186:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562592.332201:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332420:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332430:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332438:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332450:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.332454:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332462:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332608:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562592.332611:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.332617:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332623:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332639:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332645:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332650:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332655:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.332657:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332664:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332683:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.332686:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.332688:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332694:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332710:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332716:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332723:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332727:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.332730:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332736:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332744:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332300) 00010000:00010000:2.0:1786562592.332747:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.332750:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.332755:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fbc2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.332885:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:66035:x1873345652894080:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1112us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.332896:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17191 00000100:00100000:1.0:1786562592.368858:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.368972:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652894336 00000100:00100000:0.0:1786562592.368988:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652894336 00000100:00100000:0.0:1786562592.369092:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17192 00000100:00100000:0.0:1786562592.369104:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:66036:x1873345652894336:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562592.369132:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562592.369137:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786562592.369188:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fa8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0b4 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369225:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562592.369239:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562592.369259:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fbc9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd101 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369512:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369529:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369541:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369558:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369565:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369572:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369663:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fbde lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369673:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fbde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369681:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fbde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562592.369691:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 0 00010000:00010000:0.0:1786562592.369825:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369835:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369843:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369849:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.369855:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369863:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369873:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abd00) 00010000:00010000:0.0:1786562592.369877:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.369880:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369891:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268000/0x5c655bf66689fbd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369902:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369909:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369914:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369919:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.369922:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369928:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369934:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab100) 00010000:00010000:0.0:1786562592.369937:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.369940:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369945:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fbd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.369993:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268800/0x5c655bf66689fbc9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd101 expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.370089:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fbde lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd101 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.370097:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562592.370099:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562592.370102:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269c00, rc 0) 00000100:00100000:0.0:1786562592.370194:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:66036:x1873345652894336:12345-192.168.204.29@tcp:101:dd.0 Request processed in 1092us (1351us total) trans 8589950720 rc 0/0 00000100:00100000:0.0:1786562592.370203:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17192 00000100:00100000:3.0:1786562592.379386:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.379499:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652894592 00000100:00100000:2.0:1786562592.379512:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652894592 00000100:00100000:2.0:1786562592.379589:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17193 00000100:00100000:2.0:1786562592.379601:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:66036:x1873345652894592:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:2.0:1786562592.379686:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562592.379731:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fbde lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd101 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.379756:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562592.379771:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562592.380127:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.380143:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.380155:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562592.380233:0:34450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950721 00000004:00010000:2.0:1786562592.380261:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b7bcf46 reply state 000000003951dab8 transno 8589950722 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.380272:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562592.380456:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:66036:x1873345652894592:12345-192.168.204.29@tcp:36:dd.0 Request processed in 856us (1086us total) trans 8589950722 rc 0/0 00000100:00100000:2.0:1786562592.380466:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17193 00000020:00080000:2.0:1786562592.380472:0:34450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786562592.386671:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.386698:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.386707:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.386715:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562592.386720:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.386729:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.386751:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332300) 00010000:00010000:1.0:1786562592.386755:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562592.386761:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562592.386768:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf66689fbec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562592.387926:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.388096:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652894720 00000100:00100000:2.0:1786562592.388109:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652894720 00000100:00100000:2.0:1786562592.388259:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17194 00000100:00100000:2.0:1786562592.388273:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:66036:x1873345652894720:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562592.388308:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562592.388338:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbf3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd108 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.388443:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbf3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd108 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.388462:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbf3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd108 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.388510:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.388513:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562592.388517:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfce00, rc 0) 00000100:00100000:2.0:1786562592.388603:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:66036:x1873345652894720:12345-192.168.204.29@tcp:101:dd.0 Request processed in 333us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.388611:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17194 00000100:00100000:2.0:1786562592.404456:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.404671:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652894848 00000100:00100000:0.0:1786562592.404686:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652894848 00000100:00100000:0.0:1786562592.404770:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17878 00000100:00100000:0.0:1786562592.404783:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+6:66036:x1873345652894848:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562592.404809:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562592.404834:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689fbfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd10f expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.404879:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 7 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.404890:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562592.404895:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562592.404901:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689fbfa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd10f expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.404948:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 7 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.404964:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 7 pid: 29963 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562592.404981:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654905472:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562592.405169:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9812543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562592.408182:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.408351:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652894976 00000100:00100000:2.0:1786562592.408368:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652894976 00010000:00010000:2.0:1786562592.408421:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 8 pid: 29963 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.408500:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8751 00000100:00100000:2.0:1786562592.408511:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652894976:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562592.408531:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562592.408537:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 8 pid: 29963 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.408552:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 8 pid: 29963 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.408586:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562592.408591:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562592.408600:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689fbfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd10f expref: 8 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.408611:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689fbfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd10f expref: 8 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.408655:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689fbfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd10f expref: 8 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.408672:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654905600:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562592.408783:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8811869c0 going to sleep for 11 seconds 00010000:00010000:0.0:1786562592.411096:0:28862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf66689fb05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd0d0 expref: 8 pid: 29963 timeout: 1124 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562592.411128:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654905472:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562592.411184:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002dd209aa/0x5c655bf66689fbfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd10f expref: 7 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.411202:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268800, rc 0) 00000100:00100000:0.0:1786562592.411478:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+7:66036:x1873345652894848:12345-192.168.204.29@tcp:101:dd.0 Request processed in 6687us (7031us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562592.411489:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17878 00000100:00100000:2.0:1786562592.416194:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873345654905600:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562592.416244:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562592.416557:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+6:2349:x1873345652894976:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 8046us (8401us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.416574:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8751 00000100:00100000:3.0:1786562592.416884:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.420888:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652895104 00000100:00100000:0.0:1786562592.420911:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652895104 00002000:00010000:0.0:1786562592.420976:0:6663:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1847 (0->18446744073709551615) 00002000:00100000:0.0:1786562592.420982:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961f80 with x1873345652895104 ext(0->18446744073709551615) 00002000:00010000:0.0:1786562592.420999:0:6663:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882961f80. 00000100:00100000:0.0:1786562592.421082:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11633 00000100:00100000:0.0:1786562592.421093:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652895104:12345-192.168.204.29@tcp:10:dd.0 00002000:00010000:0.0:1786562592.421756:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x737:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786562592.421764:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x737:0x0] updating lvb mtime from disk: 0 -> 1786562591 00002000:00010000:0.0:1786562592.421767:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x737:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562592.421770:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x737:0x0] updating lvb ctime from disk: 0 -> 1786562591 00002000:00010000:0.0:1786562592.421772:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x737:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786562592.421862:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652895104:12345-192.168.204.29@tcp:10:dd.0 Request processed in 769us (4976us total) trans 21474843623 rc 0/0 00000100:00100000:0.0:1786562592.421872:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11633 00002000:00010000:0.0:1786562592.421876:0:6663:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1847 (0->18446744073709551615) 00002000:00100000:0.0:1786562592.421880:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e882961f80 with x1873345652895104 ext(0->18446744073709551615) 00002000:00010000:0.0:1786562592.421886:0:6663:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e882961f80. 00000100:00100000:1.0:1786562592.463802:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562592.463870:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.464052:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652895488 00000100:00100000:2.0:1786562592.464064:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652895488 00000100:00100000:2.0:1786562592.464148:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17195 00000100:00100000:2.0:1786562592.464172:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:66036:x1873345652895488:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562592.464203:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562592.464218:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562592.464257:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fbf3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd108 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.464283:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.464299:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562592.464318:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc01 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd116 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.464607:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fc08 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.464622:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fc08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.464634:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fc08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4db:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786562592.464851:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71b:0x0], index 1: 0 00000004:00080000:2.0:1786562592.464860:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x738:0x0], index 0: 0 00010000:00010000:2.0:1786562592.465093:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fc08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4db:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd116 expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.465103:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:2.0:1786562592.465106:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562592.465118:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc01 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd116 expref: 21 pid: 33113 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.465132:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc800/0x5c655bf66689fc08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4db:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd116 expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.465170:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:2.0:1786562592.465173:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562592.465176:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc800, rc 0) 00000100:00100000:2.0:1786562592.465601:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:66036:x1873345652895488:12345-192.168.204.29@tcp:101:dd.0 Request processed in 1440us (1727us total) trans 8589950723 rc 0/0 00000100:00100000:2.0:1786562592.465612:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17195 00000100:00100000:0.0:1786562592.466336:0:16005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652895232 00000100:00100000:0.0:1786562592.466349:0:16005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652895232 00002000:00100000:0.0:1786562592.466418:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x737:0x0] (0->1048575) req@ffff90e98825e680 x1873345652895232/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:63/0 lens 488/0 e 0 to 0 dl 1786562603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562592.466430:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825e680 with x1873345652895232 ext(0->1048575) 00002000:00010000:0.0:1786562592.466436:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825e680 00000100:00100000:0.0:1786562592.466475:0:16005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11634 00000100:00100000:0.0:1786562592.466486:0:16005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652895232:12345-192.168.204.29@tcp:4:dd.0 00000100:00100000:0.0:1786562592.514901:0:16005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652895232:12345-192.168.204.29@tcp:4:dd.0 Request processed in 48402us (51103us total) trans 21474843624 rc 0/0 00000100:00100000:0.0:1786562592.514920:0:16005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11634 00002000:00100000:0.0:1786562592.514938:0:16005:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x737:0x0] (0->1048575) req@ffff90e98825e680 x1873345652895232/t21474843624(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:63/0 lens 488/448 e 0 to 0 dl 1786562603 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562592.514950:0:16005:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e98825e680 with x1873345652895232 ext(0->1048575) 00002000:00010000:0.0:1786562592.514957:0:16005:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e98825e680 00000100:00100000:0.0:1786562592.520497:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562592.520766:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652895616 00000100:00100000:1.0:1786562592.520777:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652895616 00000100:00100000:1.0:1786562592.520829:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17879 00000100:00100000:1.0:1786562592.520838:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1873345652895616:12345-192.168.204.29@tcp:8:dd.0 00010000:00080000:1.0:1786562592.520875:0:8368:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp t0 exp 0000000000000000 cur 1024 last 0 00000020:00000080:1.0:1786562592.520908:0:8368:0:(genops.c:1406:class_connect()) connect: client cae43410-29f4-4da8-9608-d4626744ead5, cookie 0x5c655bf66689fc0f 00002000:00100000:1.0:1786562592.520920:0:8368:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cae43410-29f4-4da8-9608-d4626744ead5/ffff90e9bf97c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 315228160 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786562592.520990:0:8368:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786562592.521361:0:8368:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786562592.521392:0:8368:0:(import.c:65:import_set_state_nolock()) ffff90e9bf97f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786562592.521564:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+6:2347:x1873345652895616:12345-192.168.204.29@tcp:8:dd.0 Request processed in 726us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562592.521573:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17879 00000100:00100000:2.0:1786562592.532052:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.532777:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652895744 00000100:00100000:0.0:1786562592.532789:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652895744 00000100:00100000:0.0:1786562592.532910:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17880 00000100:00100000:0.0:1786562592.532921:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+6:66036:x1873345652895744:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562592.532940:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562592.532962:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689fc16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd11d expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562592.532990:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562592.533045:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71b:0x0].0x0 since=1024s v=(0 0) 00010000:00010000:0.0:1786562592.533050:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562592.533060:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689fc16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd11d expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.533080:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030de82c4/0x5c655bf66689fc16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd11d expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.533093:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268000, rc 0) 00000100:00100000:0.0:1786562592.533148:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:66036:x1873345652895744:12345-192.168.204.29@tcp:101:dd.0 Request processed in 230us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562592.533166:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17880 00000100:00080000:2.0:1786562592.533993:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562592.551994:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562592.585671:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.585728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.585838:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652896128 00000100:00100000:2.0:1786562592.585849:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652896128 00000100:00100000:2.0:1786562592.585911:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6307 00000100:00100000:2.0:1786562592.585922:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:66036:x1873345652896128:12345-192.168.204.29@tcp:35:dd.0 00000100:00100000:2.0:1786562592.586314:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:66036:x1873345652896128:12345-192.168.204.29@tcp:35:dd.0 Request processed in 393us (654us total) trans 8589950724 rc 0/0 00000100:00100000:2.0:1786562592.586323:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6307 00000100:00100000:1.0:1786562592.586783:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652895872 00000100:00100000:1.0:1786562592.586790:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652895872 00002000:00100000:1.0:1786562592.586825:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x71b:0x0] (1048576->2097151) req@ffff90e88c52df80 x1873345652895872/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:63/0 lens 488/0 e 0 to 0 dl 1786562603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786562592.586835:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c52df80 with x1873345652895872 ext(1048576->2097151) 00002000:00010000:1.0:1786562592.586842:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c52df80 00000100:00100000:1.0:1786562592.586869:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11635 00000100:00100000:1.0:1786562592.586878:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652895872:12345-192.168.204.29@tcp:4:dd.0 00000100:00100000:3.0:1786562592.629051:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.629614:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652896256 00000100:00100000:2.0:1786562592.629635:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652896256 00000100:00100000:2.0:1786562592.629703:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17196 00000100:00100000:2.0:1786562592.629717:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:66038:x1873345652896256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562592.629741:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562592.629766:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd124 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.630131:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf66689fc24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.630147:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf66689fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.630171:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf66689fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562592.630230:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562592.630235:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 37 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562592.630262:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf66689fc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.630286:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd124 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.630304:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf66689fc24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd124 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.630313:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.630316:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562592.630319:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfdc00, rc 0) 00000100:00100000:2.0:1786562592.630393:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:66038:x1873345652896256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 680us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.630401:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17196 00000100:00100000:3.0:1786562592.634557:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.641987:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652896512 00000100:00100000:2.0:1786562592.642002:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652896512 00000100:00100000:2.0:1786562592.642081:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17197 00000100:00100000:2.0:1786562592.642094:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:66038:x1873345652896512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562592.642346:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562592.643747:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fc2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd12b expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644025:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644041:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644052:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644070:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644077:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644084:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644559:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644569:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644575:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644581:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.644586:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644592:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644606:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.644608:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.644611:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.644616:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646851:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646860:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646869:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646876:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.646882:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646890:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646905:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562592.646909:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.646914:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646921:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646975:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fc2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd12b expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.646986:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.646988:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562592.646992:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd12b expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.647001:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd800, rc 0) 00000100:00100000:2.0:1786562592.647092:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:66038:x1873345652896512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4999us (12598us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562592.647101:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17197 00000100:00100000:2.0:1786562592.656736:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.656937:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652896640 00000100:00100000:0.0:1786562592.656946:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652896640 00000100:00100000:0.0:1786562592.656999:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17198 00000100:00100000:0.0:1786562592.657029:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:66038:x1873345652896640:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562592.657105:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657122:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657135:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657151:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657172:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657179:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657285:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657293:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657301:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562592.657340:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 2097152 00000004:00200000:0.0:1786562592.657344:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562592.657356:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657369:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657375:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657382:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657389:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.657393:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657400:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657412:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:0.0:1786562592.657415:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.657420:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657426:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657438:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657448:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657454:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657458:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.657461:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657467:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657474:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab400) 00010000:00010000:0.0:1786562592.657476:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.657478:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657484:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657497:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657503:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657507:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657511:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.657514:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657520:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.657526:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:0.0:1786562592.657528:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.659677:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.659698:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc4e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562592.659900:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:66038:x1873345652896640:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2887us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562592.659911:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17198 00000001:00100000:2.0:1786562592.673082:0:27136:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cae43410-29f4-4da8-9608-d4626744ead5 00000100:00100000:1.0:1786562592.696678:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.696884:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652896896 00000100:00100000:2.0:1786562592.696895:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652896896 00000100:00100000:2.0:1786562592.696955:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17199 00000100:00100000:2.0:1786562592.696977:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9866850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:66042:x1873345652896896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562592.697000:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562592.697050:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fc55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd132 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697479:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697495:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697506:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697520:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697526:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697533:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697622:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697631:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697638:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697646:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.697649:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697657:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697720:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.697724:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.697729:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697735:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fc5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697746:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697752:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697758:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697763:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.697766:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697771:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697782:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562592.697785:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.697787:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697793:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fc63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697826:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fc55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd132 expref: 23 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697837:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.697840:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562592.697844:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fc55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd132 expref: 23 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.697852:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd800, rc 0) 00000100:00100000:2.0:1786562592.697908:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9866850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:66042:x1873345652896896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 933us (1245us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562592.697916:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17199 00000100:00100000:3.0:1786562592.704342:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562592.710500:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897024 00000100:00100000:2.0:1786562592.710516:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897024 00000100:00100000:2.0:1786562592.710589:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17200 00000100:00100000:2.0:1786562592.710601:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:66042:x1873345652897024:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562592.710694:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710712:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710726:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710742:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710750:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710757:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710851:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710859:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710865:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562592.710898:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 2097152 00000004:00200000:2.0:1786562592.710902:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562592.710914:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710927:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710933:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710943:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710949:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.710953:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710959:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710970:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562592.710973:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.710977:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710983:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fc6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.710995:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711002:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711032:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711037:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.711040:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711062:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711072:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562592.711075:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.711079:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711084:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fc71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711098:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711113:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711119:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711124:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562592.711127:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711132:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711139:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:2.0:1786562592.711142:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562592.711145:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562592.711164:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fc78 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562592.711253:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:66042:x1873345652897024:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 652us (6918us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562592.711262:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17200 00000100:00100000:2.0:1786562592.761079:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562592.761592:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897280 00000100:00100000:3.0:1786562592.761604:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897280 00000100:00100000:3.0:1786562592.761671:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17201 00000100:00100000:3.0:1786562592.761681:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:66044:x1873345652897280:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562592.761703:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562592.761725:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fc7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd139 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761817:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761831:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761843:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761860:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761867:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761874:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761980:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761988:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.761993:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762022:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562592.762028:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762035:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762047:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:3.0:1786562592.762051:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562592.762055:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762061:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689fc86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762074:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762081:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762086:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762091:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562592.762094:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762100:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762111:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e999bb1700) 00010000:00010000:3.0:1786562592.762114:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562592.762118:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762124:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689fc8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762165:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fc7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd139 expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762175:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:3.0:1786562592.762178:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562592.762181:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fc7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd139 expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562592.762190:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca600, rc 0) 00000100:00100000:3.0:1786562592.762266:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:66044:x1873345652897280:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 585us (1196us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562592.762274:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17201 00000001:00080000:2.0:1786562592.765777:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876103 is committed 00000100:00100000:0.0:1786562592.766815:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652895872:12345-192.168.204.29@tcp:4:dd.0 Request processed in 179931us (181080us total) trans 17179876103 rc 0/0 00000100:00100000:0.0:1786562592.766830:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11635 00002000:00100000:0.0:1786562592.766844:0:29458:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x71b:0x0] (1048576->2097151) req@ffff90e88c52df80 x1873345652895872/t17179876103(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:63/0 lens 488/448 e 0 to 0 dl 1786562603 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562592.766855:0:29458:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c52df80 with x1873345652895872 ext(1048576->2097151) 00002000:00010000:0.0:1786562592.766862:0:29458:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e88c52df80 00000100:00100000:2.0:1786562592.771339:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562592.771456:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897408 00000100:00100000:0.0:1786562592.771468:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897408 00000100:00100000:0.0:1786562592.771527:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17202 00000100:00100000:0.0:1786562592.771538:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:66044:x1873345652897408:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562592.771627:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771645:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771657:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771672:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771679:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771685:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771781:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771910:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771920:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562592.771956:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4db:0x0]: returning size 2097152 00000004:00200000:0.0:1786562592.771960:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562592.771971:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771984:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771992:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.771999:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772046:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.772051:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772059:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772072:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:0.0:1786562592.772075:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.772080:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772087:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689fc94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772100:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772105:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772111:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772117:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.772120:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772127:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772134:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb2b0516 (ffff90e9b46ab400) 00010000:00010000:0.0:1786562592.772137:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.772140:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772145:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268400/0x5c655bf66689fc9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb2b0516 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772171:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772177:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772183:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772188:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562592.772190:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772197:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772204:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4db:0x0].0x0 (ffff90e9b6332a00) 00010000:00010000:0.0:1786562592.772206:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562592.772209:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562592.772214:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fca2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4db:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562592.772572:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:66044:x1873345652897408:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1031us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562592.772583:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17202 00000001:00080000:0.0:1786562593.110471:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950720 is committed 00000001:00080000:0.0:1786562593.110883:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950724 is committed 00000004:00080000:0.0:1786562593.110905:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2893 committed 00000100:00100000:3.0:1786562593.111169:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562593.111192:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654905728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786562593.111273:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562593.111476:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654905728 00000100:00100000:1.0:1786562593.111483:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654905728 00000100:00100000:1.0:1786562593.111562:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17881 00000100:00100000:1.0:1786562593.111573:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654905728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562593.111599:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1846 count 1 00002000:00010000:1.0:1786562593.111802:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x736:0x0] initial LVB size: 2097152, mtime: 0x6a7cc808, atime: 0x6a7cc808, ctime: 0x6a7cc80d, blocks: 0x1007 00010000:00010000:1.0:1786562593.111812:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562593.111830:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=1025s v=(0 0) 00010000:00010000:1.0:1786562593.111834:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562593.111840:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562593.111857:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562593.111868:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562593.111877:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562593.111895:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786562593.112879:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654905728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1305us (1603us total) trans 21474843625 rc 0/0 00000100:00100000:1.0:1786562593.112889:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17881 00000100:00080000:3.0:1786562593.112983:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1786562593.113042:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88433b480/2, rc 0, transno 21474843625 00000100:00100000:3.0:1786562593.113050:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654905728:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786562593.113403:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562593.113412:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562593.113424:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562593.113428:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562593.113438:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562593.113457:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562593.113464:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0133150/0x5c655bf66689fca9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562593.113484:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562593.113486:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562593.113488:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562593.573776:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562593.649368:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843624 is committed 00000001:00080000:3.0:1786562593.649408:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843625 is committed 00000100:00100000:1.0:1786562594.104765:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562594.104804:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562594.104832:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562594.104856:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562594.104886:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897792 00000100:00100000:1.0:1786562594.104895:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897792 00000100:00100000:1.0:1786562594.104947:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897920 00000100:00100000:1.0:1786562594.104949:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897920 00000100:00100000:1.0:1786562594.104969:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 472 00000100:00100000:1.0:1786562594.104979:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+6:2349:x1873345652897792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562594.105056:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+6:2349:x1873345652897792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562594.105063:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 472 00000100:00100000:1.0:1786562594.105080:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 473 00000100:00100000:1.0:1786562594.105086:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+6:2349:x1873345652897920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562594.105109:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+6:2349:x1873345652897920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562594.105115:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 473 00000100:00080000:1.0:1786562594.105145:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562594.105149:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562594.106411:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897536 00000100:00100000:2.0:1786562594.106423:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897536 00000100:00100000:2.0:1786562594.106473:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 276 00000100:00100000:2.0:1786562594.106481:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652897536:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562594.106529:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652897536:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562594.106536:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 276 00000100:00100000:2.0:1786562594.106571:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652897664 00000100:00100000:2.0:1786562594.106575:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652897664 00000100:00100000:2.0:1786562594.106613:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 315 00000100:00100000:2.0:1786562594.106620:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652897664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562594.106653:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652897664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562594.106659:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 315 00000100:00080000:2.0:1786562594.106802:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562594.598621:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562595.109556:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654905856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562595.109663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562595.109769:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562595.109776:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654905984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562595.109800:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562595.109946:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654905856 00000100:00100000:2.0:1786562595.109957:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654905856 00000100:00100000:2.0:1786562595.110058:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654905984 00000100:00100000:2.0:1786562595.110062:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654905984 00000100:00100000:2.0:1786562595.110085:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1786562595.110095:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654905856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562595.110152:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562595.110210:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654905856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562595.110218:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1786562595.110239:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1786562595.110246:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654905984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562595.110268:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 518062080 pending 0 free 3837788160 avail 3835691008 00000100:00100000:2.0:1786562595.110297:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654905984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562595.110304:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1786562595.110651:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654906240:0@lo:400:kworker.0 00000100:00100000:1.0:1786562595.110696:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562595.110748:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562595.110755:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654906112:0@lo:400:kworker.0 00000100:00100000:1.0:1786562595.110787:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562595.110818:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654906496:0@lo:400:kworker.0 00000100:00100000:1.0:1786562595.110844:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562595.110862:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562595.110867:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654906368:0@lo:400:kworker.0 00000100:00100000:1.0:1786562595.110887:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562595.111040:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654906240 00000100:00100000:0.0:1786562595.111046:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654906240 00000100:00100000:0.0:1786562595.111085:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654906496 00000100:00100000:0.0:1786562595.111088:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654906496 00000100:00100000:0.0:1786562595.111115:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654906368 00000100:00100000:0.0:1786562595.111118:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654906368 00000100:00100000:0.0:1786562595.111144:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786562595.111152:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654906240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562595.111200:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654906240:12345-0@lo:400:kworker.0 Request processed in 49us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562595.111208:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786562595.111222:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786562595.111228:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654906496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562595.111257:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654906496:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562595.111264:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786562595.111275:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1786562595.111281:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654906368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562595.111308:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654906368:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562595.111313:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:3.0:1786562595.111897:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562595.111905:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562595.111907:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562595.111952:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843625 gen 2 00000004:00080000:3.0:1786562595.111958:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88433b480, transno 21474843625 00000100:00100000:3.0:1786562595.111981:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654905984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562595.112061:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876102 gen 2 00000004:00080000:3.0:1786562595.112065:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c52c700, transno 17179876102 00000100:00100000:3.0:1786562595.112079:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654905856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562595.113091:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654906368:0@lo:400:kworker.0 00000100:00100000:1.0:1786562595.113118:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654906496:0@lo:400:kworker.0 00000100:00100000:1.0:1786562595.113156:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654906240:0@lo:400:kworker.0 00000100:00100000:2.0:1786562595.113259:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654906112 00000100:00100000:2.0:1786562595.113268:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654906112 00000100:00100000:2.0:1786562595.113320:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1786562595.113329:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654906112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562595.113434:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654906112:12345-0@lo:400:kworker.0 Request processed in 106us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562595.113441:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1786562595.122575:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654906112:0@lo:400:kworker.0 00010000:00010000:1.0:1786562595.623257:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562596.648921:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562597.669432:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562598.693592:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562599.223125:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562599.223170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562599.223218:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562599.223415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562599.223452:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652898048 00000100:00100000:3.0:1786562599.223465:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652898048 00000100:00100000:0.0:1786562599.223605:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652898176 00000100:00100000:0.0:1786562599.223610:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652898176 00000100:00100000:0.0:1786562599.223694:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 319 00000100:00100000:0.0:1786562599.223708:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652898176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562599.223816:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652898176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 112us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562599.223825:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 319 00000100:00080000:0.0:1786562599.223856:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562599.224749:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652898432 00000100:00100000:0.0:1786562599.224759:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652898432 00000100:00100000:1.0:1786562599.224773:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652898304 00000100:00100000:1.0:1786562599.224777:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652898304 00000100:00100000:0.0:1786562599.224812:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 474 00000100:00100000:0.0:1786562599.224821:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652898432:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562599.224874:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652898432:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 54us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562599.224880:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 474 00000100:00100000:3.0:1786562599.225802:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 278 00000100:00100000:3.0:1786562599.225823:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652898048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562599.225877:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652898048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 62us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562599.225884:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 278 00000100:00100000:0.0:1786562599.226989:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 475 00000100:00100000:0.0:1786562599.227049:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652898304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562599.227118:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652898304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 115us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562599.227126:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 475 00000100:00080000:2.0:1786562599.227620:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562599.227629:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786562599.718205:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786562599.913726:0:37963:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 203: mirror file preserve mirror ID === 15:23:17 (1786562597) 00000100:00100000:3.0:1786562600.015592:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.016853:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652898560 00000100:00100000:0.0:1786562600.016865:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652898560 00000100:00100000:0.0:1786562600.016924:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17203 00000100:00100000:0.0:1786562600.016936:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:66615:x1873345652898560:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.016956:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562600.016976:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689fcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd140 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017073:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017088:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017098:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017112:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017119:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017125:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017391:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017400:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017406:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017413:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.017417:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017429:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017441:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:0.0:1786562600.017444:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.017448:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017454:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689fcb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017464:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017470:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017475:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017480:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.017483:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017489:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017495:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b46abe00) 00010000:00010000:0.0:1786562600.017497:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.017500:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017508:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017539:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689fcb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd140 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017549:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:0.0:1786562600.017551:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.017555:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689fcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd140 expref: 9 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.017564:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:0.0:1786562600.017640:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:66615:x1873345652898560:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 706us (2057us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562600.017648:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17203 00000100:00100000:0.0:1786562600.027780:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.028501:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652898816 00000100:00100000:1.0:1786562600.028512:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652898816 00000100:00100000:1.0:1786562600.028567:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17204 00000100:00100000:1.0:1786562600.028576:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:66615:x1873345652898816:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.028595:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.028598:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562600.028623:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf66689fc24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd124 expref: 8 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.028640:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:1.0:1786562600.028651:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562600.028667:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fcc5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd147 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.028978:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.028991:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.029000:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.029044:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.029051:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.029058:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032052:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032073:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032084:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.032097:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:1.0:1786562600.032137:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032160:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032166:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032173:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.032177:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032184:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032197:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562600.032201:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.032206:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032212:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fccc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562600.032227:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5867396 reply state 00000000e91cc412 transno 8589950725 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.032235:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786562600.032274:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fcc5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 10 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032294:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 9 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.032306:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562600.032309:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562600.032311:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2400, rc 0) 00000100:00100000:1.0:1786562600.032398:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:66615:x1873345652898816:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3822us (4629us total) trans 8589950725 rc 0/0 00000100:00100000:1.0:1786562600.032407:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17204 00000100:00100000:0.0:1786562600.046876:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.046916:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652899072 00000100:00100000:0.0:1786562600.046926:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652899072 00000100:00100000:0.0:1786562600.046995:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17205 00000100:00100000:0.0:1786562600.047034:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:66615:x1873345652899072:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.047061:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562600.047088:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689fce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd14e expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.047270:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.047286:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.047297:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.047331:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.047345:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 11 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.047359:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654906624:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562600.047444:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce3900 going to sleep for 11 seconds 00010000:00010000:3.0:1786562600.053831:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.053848:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.053854:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.053860:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.053864:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.053872:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.053889:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9bc2a2a00) 00010000:00010000:3.0:1786562600.053892:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562600.053896:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.053902:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fcd3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.056538:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.056623:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652899200 00000100:00100000:2.0:1786562600.056631:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652899200 00010000:00010000:2.0:1786562600.056744:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 11 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.056781:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8752 00000100:00100000:2.0:1786562600.056790:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652899200:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562600.056805:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562600.056812:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 11 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.056823:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 11 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.056843:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:2.0:1786562600.056848:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.056856:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.056863:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.056882:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562600.056976:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652899200:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 186us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562600.056984:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8752 00010000:00010000:1.0:1786562600.057576:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fcda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd147 expref: 10 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.057594:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654906624:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562600.057613:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.057622:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.057628:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.057647:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00080000:1.0:1786562600.058877:0:33115:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71c:0x0], index 1: 0 00000004:00080000:1.0:1786562600.058892:0:33115:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x739:0x0], index 0: 0 00010000:00010000:1.0:1786562600.059113:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.059124:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.059138:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.059384:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.059389:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.059397:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.059414:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562600.059417:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562600.059421:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.059427:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf66689fcef lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.059693:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689fce8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd14e expref: 10 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.059705:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abe00) 00010000:00010000:0.0:1786562600.059707:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562600.059711:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689fce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd14e expref: 10 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.059723:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:0.0:1786562600.059833:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:66615:x1873345652899072:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 12827us (12965us total) trans 8589950726 rc 301/301 00000100:00100000:0.0:1786562600.059846:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17205 00000100:00100000:0.0:1786562600.063034:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.063118:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652899456 00000100:00100000:2.0:1786562600.063128:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652899456 00000100:00100000:2.0:1786562600.063199:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6308 00000100:00100000:2.0:1786562600.063259:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:66615:x1873345652899456:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562600.063623:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+10:66615:x1873345652899456:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 367us (629us total) trans 8589950727 rc 0/0 00000100:00100000:2.0:1786562600.063631:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6308 00000100:00100000:1.0:1786562600.067836:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.067982:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652899712 00000100:00100000:0.0:1786562600.067991:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652899712 00000100:00100000:0.0:1786562600.068415:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6309 00000100:00100000:0.0:1786562600.068426:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986377850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:66615:x1873345652899712:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562600.068692:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986377850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:66615:x1873345652899712:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 267us (866us total) trans 8589950728 rc 0/0 00000100:00100000:0.0:1786562600.068700:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6309 00000100:00100000:0.0:1786562600.085843:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.086084:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652899840 00000100:00100000:2.0:1786562600.086096:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652899840 00000100:00100000:2.0:1786562600.086197:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17206 00000100:00100000:2.0:1786562600.086216:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:66616:x1873345652899840:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.086241:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.086275:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fcfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd155 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.086346:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fd04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.086361:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fd04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.086373:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fd04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562600.086440:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562600.086444:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 38 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562600.086465:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fd04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.086489:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fcfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd155 expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.086509:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fd04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd155 expref: 12 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.086517:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:2.0:1786562600.086520:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562600.086523:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562600.086592:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:66616:x1873345652899840:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 379us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562600.086599:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17206 00000100:00100000:2.0:1786562600.090369:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.090667:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652900096 00000100:00100000:0.0:1786562600.090677:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652900096 00000100:00100000:0.0:1786562600.090958:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17207 00000100:00100000:0.0:1786562600.090979:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+12:66616:x1873345652900096:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.091485:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.092269:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fd0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd15c expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092360:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092374:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092384:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092405:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092412:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092419:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092555:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092564:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092570:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.092580:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:1.0:1786562600.092668:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092675:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092681:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092687:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.092691:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092701:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092712:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:1.0:1786562600.092715:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.092720:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092725:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092738:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092744:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092750:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092761:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.092764:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092770:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092777:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562600.092779:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.092782:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092791:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fd19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092832:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fd0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 15 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092846:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.092852:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562600.092854:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562600.092857:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3400, rc 0) 00000100:00100000:1.0:1786562600.092931:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:66616:x1873345652900096:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1955us (3399us total) trans 8589950729 rc 0/0 00000100:00100000:1.0:1786562600.092940:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17207 00000100:00100000:1.0:1786562600.097193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.097916:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652900224 00000100:00100000:0.0:1786562600.097928:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652900224 00000100:00100000:0.0:1786562600.098094:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17882 00000100:00100000:0.0:1786562600.098106:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+6:2348:x1873345652900224:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.098126:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562600.098149:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689fd2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd163 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562600.098187:0:8368:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562600.098215:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x739:0x0].0x0 since=1032s v=(0 0) 00010000:00010000:0.0:1786562600.098221:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562600.098229:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689fd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd163 expref: 7 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.098247:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078ebb69e/0x5c655bf66689fd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd163 expref: 7 pid: 8368 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.098262:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268400, rc 0) 00000100:00100000:0.0:1786562600.098337:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652900224:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 233us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.098345:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17882 00000100:00100000:1.0:1786562600.100795:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.100887:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652900480 00000100:00100000:2.0:1786562600.100896:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652900480 00000100:00100000:2.0:1786562600.100951:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6310 00000100:00100000:2.0:1786562600.100962:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:66616:x1873345652900480:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562600.101624:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:66616:x1873345652900480:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 661us (836us total) trans 8589950730 rc 0/0 00000100:00100000:2.0:1786562600.101633:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6310 00000100:00100000:1.0:1786562600.105954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.106085:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652900736 00000100:00100000:2.0:1786562600.106095:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652900736 00000100:00100000:2.0:1786562600.106158:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17208 00000100:00100000:2.0:1786562600.106169:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:66616:x1873345652900736:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.106193:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.106226:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fd35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd16a expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.106412:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fd3c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.106427:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fd3c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.106438:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fd3c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562600.106449:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:2.0:1786562600.106579:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fd35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd16a expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.106597:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fd3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd16a expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.106606:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:2.0:1786562600.106609:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786562600.106612:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd800, rc 0) 00000100:00100000:2.0:1786562600.106730:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:66616:x1873345652900736:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 562us (785us total) trans 8589950731 rc 0/0 00000100:00100000:2.0:1786562600.106737:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17208 00000100:00100000:1.0:1786562600.112976:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.113119:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652900992 00000100:00100000:0.0:1786562600.113130:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652900992 00000100:00100000:0.0:1786562600.113195:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17209 00000100:00100000:0.0:1786562600.113268:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:66616:x1873345652900992:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.113413:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562600.113435:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fd4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd171 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.113536:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.113551:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.113561:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.113601:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.113616:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 18 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.113629:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654906752:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562600.113815:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce3900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562600.116756:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.117363:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652901120 00000100:00100000:1.0:1786562600.117373:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652901120 00010000:00010000:1.0:1786562600.117416:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 19 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.117450:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8753 00000100:00100000:1.0:1786562600.117460:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652901120:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562600.117479:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562600.117486:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 19 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.117510:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 19 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.117534:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562600.117540:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.117549:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.117556:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.117574:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562600.117628:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652901120:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 168us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.117636:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8753 00010000:00010000:0.0:1786562600.118814:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fd20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd15c expref: 18 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.118839:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345654906752:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562600.118860:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.119485:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.119503:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.119526:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:1.0:1786562600.119685:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fd4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd171 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.119707:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd171 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.119716:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562600.119720:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562600.119723:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:1.0:1786562600.119789:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:66616:x1873345652900992:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6585us (6823us total) trans 8589950732 rc 0/0 00000100:00100000:1.0:1786562600.119798:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17209 00000100:00100000:3.0:1786562600.122688:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.122798:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652901248 00000100:00100000:1.0:1786562600.122809:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652901248 00000100:00100000:0.0:1786562600.122950:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6311 00000100:00100000:0.0:1786562600.122963:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:66616:x1873345652901248:12345-192.168.204.29@tcp:33:lfs.0 00000100:00100000:0.0:1786562600.123129:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:66616:x1873345652901248:12345-192.168.204.29@tcp:33:lfs.0 Request processed in 169us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.123138:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6311 00000100:00100000:3.0:1786562600.129642:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.129754:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652901504 00000100:00100000:1.0:1786562600.129765:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652901504 00000100:00100000:1.0:1786562600.129854:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6312 00000100:00100000:1.0:1786562600.129876:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:66616:x1873345652901504:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562600.130158:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:66616:x1873345652901504:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 295us (525us total) trans 8589950733 rc 0/0 00000100:00100000:1.0:1786562600.130167:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6312 00000100:00100000:3.0:1786562600.134113:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.134311:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652901760 00000100:00100000:2.0:1786562600.134320:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652901760 00000100:00100000:2.0:1786562600.134379:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17210 00000100:00100000:2.0:1786562600.134390:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:66616:x1873345652901760:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.134417:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.134420:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1786562600.134447:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fd51 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd171 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134470:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fd3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd16a expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134481:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:2.0:1786562600.134491:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562600.134518:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fd5f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd178 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134616:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fd66 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134628:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fd66 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134637:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fd66 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562600.134649:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:2.0:1786562600.134771:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fd5f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd178 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134786:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fd66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd178 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.134800:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562600.134802:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562600.134805:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfce00, rc 0) 00000100:00100000:2.0:1786562600.134870:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:66616:x1873345652901760:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 475us (760us total) trans 8589950734 rc 0/0 00000100:00100000:2.0:1786562600.134878:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17210 00000100:00100000:3.0:1786562600.155104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.155188:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652902016 00000100:00100000:0.0:1786562600.155198:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652902016 00000100:00100000:0.0:1786562600.155252:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6313 00000100:00100000:0.0:1786562600.155262:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:66616:x1873345652902016:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:0.0:1786562600.155353:0:35899:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000404:0x4dd:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fd66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd178 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155393:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155406:0:35899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155415:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155776:0:35899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155785:0:35899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155792:0:35899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155798:0:35899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.155803:0:35899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155810:0:35899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155820:0:35899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562600.155824:0:35899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786562600.155828:0:35899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155835:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd74 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.155846:0:35899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562600.155848:0:35899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562600.155853:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fd66 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd178 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.155998:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:66616:x1873345652902016:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 737us (903us total) trans 8589950735 rc -22/-22 00000100:00100000:0.0:1786562600.156046:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6313 00000100:00100000:3.0:1786562600.176426:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.176621:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652902144 00000100:00100000:1.0:1786562600.176636:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652902144 00000100:00100000:1.0:1786562600.176713:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17211 00000100:00100000:1.0:1786562600.176725:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:66616:x1873345652902144:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.176760:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.176785:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd17f expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.176853:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.177179:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.177206:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562600.177210:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562600.177213:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2e00, rc 0) 00000100:00100000:1.0:1786562600.177603:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:66616:x1873345652902144:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 878us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.177612:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17211 00000100:00100000:3.0:1786562600.185682:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.185762:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652902400 00000100:00100000:0.0:1786562600.185772:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652902400 00000100:00100000:0.0:1786562600.185833:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17212 00000100:00100000:0.0:1786562600.185843:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:66616:x1873345652902400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.185878:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562600.185881:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786562600.185909:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf66689fd04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd155 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.185929:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:0.0:1786562600.185940:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562600.185956:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd186 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.187146:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.187162:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.187172:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562600.187181:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4de:0x0]: returning size 0 00010000:00010000:0.0:1786562600.189471:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fd82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.189507:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 21 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.189516:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4de:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562600.189519:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562600.189522:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562600.189607:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:66616:x1873345652902400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3764us (3935us total) trans 8589950736 rc 0/0 00000100:00100000:0.0:1786562600.189615:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17212 00000100:00100000:3.0:1786562600.194390:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.194484:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652902656 00000100:00100000:1.0:1786562600.194494:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652902656 00000100:00100000:1.0:1786562600.194560:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17213 00000100:00100000:1.0:1786562600.194571:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:66616:x1873345652902656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.194599:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.194621:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fd97 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd18d expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.194722:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fd9e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.194735:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fd9e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.194747:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fd9e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.194760:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:1.0:1786562600.194882:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689fd97 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd18d expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.194900:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fd9e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd18d expref: 23 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.194909:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562600.194912:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562600.194915:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3800, rc 0) 00000100:00100000:1.0:1786562600.194970:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:66616:x1873345652902656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 401us (591us total) trans 8589950737 rc 0/0 00000100:00100000:1.0:1786562600.194977:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17213 00000100:00100000:3.0:1786562600.198243:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.202580:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652902912 00000100:00100000:2.0:1786562600.202598:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652902912 00000100:00100000:2.0:1786562600.202671:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6314 00000100:00100000:2.0:1786562600.202682:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986376c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:66616:x1873345652902912:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1786562600.202771:0:33116:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000404:0x4dd:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fd9e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd18d expref: 23 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.202814:0:33116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.202828:0:33116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 23 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.202837:0:33116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.202884:0:33116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 23 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.202898:0:33116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 23 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.202915:0:33116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:33116:1873345654906880:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562600.203043:0:33116:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562600.206813:0:33116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:33116:1873345654906880:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562600.206845:0:33116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562600.208637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.209364:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652903040 00000100:00100000:2.0:1786562600.209374:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652903040 00010000:00010000:2.0:1786562600.209416:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 24 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.209513:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8754 00000100:00100000:2.0:1786562600.209525:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345652903040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562600.209540:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562600.209548:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 24 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.209561:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 24 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.209584:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689fd7b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd17f expref: 24 pid: 33113 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.209601:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:2.0:1786562600.209607:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.209617:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.209625:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.209659:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562600.209716:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345652903040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 193us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562600.209724:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8754 00010000:00010000:3.0:1786562600.210431:0:33116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.210441:0:33116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.210464:0:33116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.210478:0:33116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.210486:0:33116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.210529:0:33116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.210542:0:33116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 22 pid: 33114 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562600.210557:0:33116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:33116:1873345654907008:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562600.210630:0:33116:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562600.214488:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.214804:0:33116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:33116:1873345654907008:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562600.214830:0:33116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.216074:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652903168 00000100:00100000:0.0:1786562600.216085:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652903168 00010000:00010000:0.0:1786562600.216127:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 23 pid: 33114 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.216162:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8755 00000100:00100000:0.0:1786562600.216172:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:2348:x1873345652903168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562600.216186:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562600.216195:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 23 pid: 33114 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216266:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 23 pid: 33114 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216353:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fd89 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd186 expref: 23 pid: 33114 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216368:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4de:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562600.216373:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216383:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216391:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216417:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562600.216470:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345652903168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 298us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.216478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8755 00010000:00010000:0.0:1786562600.216594:0:33116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.216603:0:33116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.218530:0:33116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:33116:1873345654907136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786562600.218638:0:33116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562600.218681:0:33116:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881821780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562600.218763:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907136 00000100:00100000:2.0:1786562600.218770:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907136 00000100:00100000:2.0:1786562600.218821:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1786562600.218829:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33116:x1873345654907136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786562600.218914:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33116:x1873345654907136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562600.218920:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00080000:0.0:1786562600.219044:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562600.219754:0:33116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:33116:1873345654907136:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1786562600.219825:0:33116:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950738 00000001:00080000:3.0:1786562600.219981:0:33116:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950739 00010000:00010000:3.0:1786562600.220213:0:33116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220225:0:33116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220233:0:33116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220240:0:33116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.220245:0:33116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220252:0:33116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220267:0:33116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4de:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562600.220278:0:33116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786562600.220387:0:33116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220396:0:33116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fdb3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4de:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220418:0:33116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220424:0:33116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220431:0:33116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220440:0:33116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.220443:0:33116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220450:0:33116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220458:0:33116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:3.0:1786562600.220461:0:33116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786562600.220464:0:33116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220469:0:33116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fdac lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.220481:0:33116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:3.0:1786562600.220484:0:33116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562600.220490:0:33116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fd9e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd18d expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562600.220596:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986376c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:66616:x1873345652902912:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 17915us (22360us total) trans 8589950740 rc 0/0 00000100:00100000:3.0:1786562600.220606:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6314 00000020:00080000:3.0:1786562600.220612:0:33116:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1786562600.223213:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.223287:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652903296 00000100:00100000:1.0:1786562600.223297:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652903296 00000100:00100000:1.0:1786562600.223350:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17214 00000100:00100000:1.0:1786562600.223359:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:66616:x1873345652903296:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.223382:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.223404:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd194 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.223459:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.223475:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.223494:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562600.223497:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562600.223501:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3400, rc 0) 00000100:00100000:1.0:1786562600.223560:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:66616:x1873345652903296:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 202us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.223568:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17214 00000100:00100000:1.0:1786562600.228662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.228741:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652903552 00000100:00100000:2.0:1786562600.228751:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652903552 00000100:00100000:2.0:1786562600.228810:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6315 00000100:00100000:2.0:1786562600.228820:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:66616:x1873345652903552:12345-192.168.204.29@tcp:35:lfs.0 00000004:00080000:2.0:1786562600.229442:0:35899:0:(mdd_object.c:4018:mdd_close()) Object [0x200000404:0x4de:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786562600.229540:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4417, 64 off358680 00000004:00080000:2.0:1786562600.229551:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032671544973ns, next at 1033671543000ns, rc = 0 00000001:00080000:2.0:1786562600.229558:0:35899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950741 00010000:00010000:2.0:1786562600.229607:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.229628:0:35899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.229640:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.229647:0:35899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.229653:0:35899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.229659:0:35899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.229680:0:35899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786562600.229770:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+26:66616:x1873345652903552:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 951us (1116us total) trans 8589950742 rc 0/0 00000100:00100000:2.0:1786562600.229780:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6315 00000020:00080000:2.0:1786562600.229784:0:35899:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786562600.230350:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562600.230366:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.230378:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562600.230382:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.230389:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.230403:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4de:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:3.0:1786562600.230406:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786562600.230410:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.230416:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdc1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4de:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.230434:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562600.230436:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562600.230437:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562600.232091:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654907520:0@lo:400:kworker.0 00000100:00100000:0.0:1786562600.232153:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562600.232186:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562600.232192:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654907648:0@lo:400:kworker.0 00000100:00100000:0.0:1786562600.232230:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562600.232262:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907648 00000100:00100000:0.0:1786562600.232280:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907648 00000100:00100000:0.0:1786562600.232335:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1786562600.232344:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654907648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562600.232552:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654907648:12345-0@lo:400:kworker.0 Request processed in 207us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.232559:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00080000:0.0:1786562600.232580:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562600.232608:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654907648:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.232697:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654907392:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.232728:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562600.232759:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786562600.232765:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654907264:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.232791:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562600.232816:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654907776:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.232836:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562600.232883:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907264 00000100:00100000:1.0:1786562600.232887:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907264 00000100:00100000:1.0:1786562600.232913:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1786562600.232920:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654907264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.232954:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654907264:12345-0@lo:400:kworker.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.232960:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1786562600.232992:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654907264:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.233039:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907520 00000100:00100000:1.0:1786562600.233042:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907520 00000100:00100000:1.0:1786562600.233069:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907392 00000100:00100000:1.0:1786562600.233072:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907392 00000100:00100000:1.0:1786562600.233088:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907776 00000100:00100000:1.0:1786562600.233090:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907776 00000100:00100000:1.0:1786562600.233104:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1786562600.233110:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654907520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.233143:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654907520:12345-0@lo:400:kworker.0 Request processed in 32us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.233148:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1786562600.233160:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786562600.233166:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654907392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.233191:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654907392:12345-0@lo:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.233419:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786562600.233441:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1786562600.233448:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654907776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.233480:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654907776:12345-0@lo:400:kworker.0 Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.233485:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1786562600.233502:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562600.233521:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654907776:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.233529:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654907392:0@lo:400:kworker.0 00000100:00100000:1.0:1786562600.233554:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654907520:0@lo:400:kworker.0 00000100:00100000:3.0:1786562600.233856:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562600.233877:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654907904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562600.233911:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562600.233943:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654907904 00000100:00100000:3.0:1786562600.233947:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654907904 00000100:00100000:3.0:1786562600.233978:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1786562600.233984:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654907904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562600.234040:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 518062080 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562600.234080:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654907904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562600.234086:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1786562600.234119:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654907904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562600.235066:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562600.235078:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654908032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562600.235117:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562600.235233:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654908032 00000100:00100000:0.0:1786562600.235239:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654908032 00000100:00100000:0.0:1786562600.235290:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1786562600.235299:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654908032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562600.235323:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562600.235720:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654908032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 422us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.235728:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1786562600.235771:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654908032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562600.236768:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.236841:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652903808 00000100:00100000:2.0:1786562600.236848:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652903808 00000100:00100000:2.0:1786562600.236899:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6316 00000100:00100000:2.0:1786562600.236908:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:66616:x1873345652903808:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562600.237248:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+27:66616:x1873345652903808:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 339us (482us total) trans 8589950743 rc 0/0 00000100:00100000:2.0:1786562600.237256:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6316 00000100:00100000:2.0:1786562600.253122:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.253204:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652903936 00000100:00100000:1.0:1786562600.253218:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652903936 00000100:00100000:1.0:1786562600.253304:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17215 00000100:00100000:1.0:1786562600.253315:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+27:66617:x1873345652903936:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.253349:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.253373:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd19b expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.253436:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fdcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.253449:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.253460:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.253520:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1786562600.253524:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 38 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562600.253547:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.253570:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd19b expref: 29 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.253590:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fdcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd19b expref: 28 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.253600:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:1.0:1786562600.253603:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786562600.253607:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2800, rc 0) 00000100:00100000:1.0:1786562600.253676:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:66617:x1873345652903936:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 363us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.253683:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17215 00000100:00100000:1.0:1786562600.259327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.259510:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652904192 00000100:00100000:2.0:1786562600.259520:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652904192 00000100:00100000:2.0:1786562600.259583:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17216 00000100:00100000:2.0:1786562600.259593:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:66617:x1873345652904192:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.259614:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.259634:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1a2 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.259717:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.259733:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.259744:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.259757:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.259764:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.259771:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260182:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260190:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260201:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260206:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.260210:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260218:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260231:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:2.0:1786562600.260234:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.260238:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260244:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260257:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260564:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260572:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260578:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.260582:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260593:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260601:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b6332100) 00010000:00010000:2.0:1786562600.260604:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.260607:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260612:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fde4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260758:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdd6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1a2 expref: 29 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260769:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:2.0:1786562600.260771:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562600.260774:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689fdd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1a2 expref: 29 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.260785:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd800, rc 0) 00000100:00100000:2.0:1786562600.260965:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:66617:x1873345652904192:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1372us (1646us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562600.260974:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17216 00000100:00100000:3.0:1786562600.276093:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.278916:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652904320 00000100:00100000:1.0:1786562600.278933:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652904320 00000100:00100000:1.0:1786562600.279055:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17217 00000100:00100000:1.0:1786562600.279067:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:66617:x1873345652904320:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562600.279144:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279161:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279171:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279186:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279193:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279200:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279317:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279325:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279333:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.279379:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:1.0:1786562600.279384:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562600.279396:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279408:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279415:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279422:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279429:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.279434:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279442:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279454:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:1.0:1786562600.279458:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.279462:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279468:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fdeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279483:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279489:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279495:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279500:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.279503:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279509:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279516:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562600.279519:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.279522:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279528:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fdf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279542:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279548:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279554:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279559:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.279561:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279567:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279574:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562600.279576:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.279579:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.279585:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fdf9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.279666:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+28:66617:x1873345652904320:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 602us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.279675:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17217 00000100:00100000:2.0:1786562600.308861:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.308960:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652904576 00000100:00100000:1.0:1786562600.308971:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652904576 00000100:00100000:1.0:1786562600.309088:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17218 00000100:00100000:1.0:1786562600.309099:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:66618:x1873345652904576:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.309119:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.309140:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fe00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1a9 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309219:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309233:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309245:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309259:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309278:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309291:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309402:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309410:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309416:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309422:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.309426:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309438:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309450:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:1.0:1786562600.309453:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.309456:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309462:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf66689fe07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309475:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309481:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309487:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309492:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.309495:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309501:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309508:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562600.309511:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.309514:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309523:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309557:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fe00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1a9 expref: 29 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309567:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:1.0:1786562600.309569:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562600.309573:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fe00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1a9 expref: 29 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.309582:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2a00, rc 0) 00000100:00100000:1.0:1786562600.309658:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:66618:x1873345652904576:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 561us (805us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562600.309665:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17218 00000100:00100000:3.0:1786562600.313913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.314085:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652904704 00000100:00100000:0.0:1786562600.314095:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652904704 00000100:00100000:0.0:1786562600.314149:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17219 00000100:00100000:0.0:1786562600.314160:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:66618:x1873345652904704:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562600.314244:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314259:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314270:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314286:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314293:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314299:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314398:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314407:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314413:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562600.314459:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:0.0:1786562600.314464:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562600.314476:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314489:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314495:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314501:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314506:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.314510:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314516:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314529:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:0.0:1786562600.314532:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.314536:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314542:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314555:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314560:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314569:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314573:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.314576:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314581:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314589:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b46abc00) 00010000:00010000:0.0:1786562600.314591:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.314594:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314599:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314612:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314617:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314622:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314627:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.314629:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314638:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314645:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562600.314647:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.314650:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.314656:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe23 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.314736:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+28:66618:x1873345652904704:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 577us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.314744:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17219 00000100:00100000:3.0:1786562600.348748:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.348913:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652904960 00000100:00100000:2.0:1786562600.348924:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652904960 00000100:00100000:2.0:1786562600.348987:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17220 00000100:00100000:2.0:1786562600.348998:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:66619:x1873345652904960:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.349072:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.349095:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1b0 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349169:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349184:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349206:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349223:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349231:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349238:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349341:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349349:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349356:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349362:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.349366:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349373:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349385:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:2.0:1786562600.349388:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.349391:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349397:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349409:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349415:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349420:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349424:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.349427:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349562:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349571:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b6332100) 00010000:00010000:2.0:1786562600.349574:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.349577:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349583:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349619:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1b0 expref: 29 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349628:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:2.0:1786562600.349630:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562600.349634:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1b0 expref: 29 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.349643:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562600.349806:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:66619:x1873345652904960:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 809us (1066us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562600.349814:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17220 00000100:00100000:2.0:1786562600.358065:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.358149:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652905088 00000100:00100000:0.0:1786562600.358158:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652905088 00000100:00100000:0.0:1786562600.358221:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17221 00000100:00100000:0.0:1786562600.358231:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:66619:x1873345652905088:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562600.358316:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358332:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358343:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358357:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358370:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358377:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358474:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358483:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358490:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562600.358525:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:0.0:1786562600.358529:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562600.358543:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358557:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358563:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358570:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358575:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.358579:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358586:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358597:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:0.0:1786562600.358600:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.358604:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358610:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf66689fe3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358622:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358627:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358633:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358637:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.358653:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358659:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358666:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b46abc00) 00010000:00010000:0.0:1786562600.358668:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.358671:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358679:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf66689fe46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358694:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358700:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358706:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358710:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.358713:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358718:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358724:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562600.358726:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.358729:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.358735:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689fe4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.358813:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:66619:x1873345652905088:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 582us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.358822:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17221 00000100:00100000:3.0:1786562600.375421:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.375549:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652905344 00000100:00100000:2.0:1786562600.375560:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652905344 00000100:00100000:2.0:1786562600.375620:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17222 00000100:00100000:2.0:1786562600.375631:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:66620:x1873345652905344:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.375652:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.375674:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1b7 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375755:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375774:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375786:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375801:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375809:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375816:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375964:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fe69 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375973:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fe69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.375980:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fe69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562600.375989:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:2.0:1786562600.376119:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376127:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376133:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376139:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.376143:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376149:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376160:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:2.0:1786562600.376163:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.376168:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376173:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689fe5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376184:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376190:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376195:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376212:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.376215:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376221:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376232:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b6332100) 00010000:00010000:2.0:1786562600.376235:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.376238:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376244:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376300:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1b7 expref: 31 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376314:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fe69 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1b7 expref: 30 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.376321:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562600.376324:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562600.376327:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfcc00, rc 0) 00000100:00100000:2.0:1786562600.376399:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+30:66620:x1873345652905344:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 769us (1212us total) trans 8589950744 rc 0/0 00000100:00100000:2.0:1786562600.376407:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17222 00000100:00100000:3.0:1786562600.381591:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.381686:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652905600 00000100:00100000:1.0:1786562600.381696:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652905600 00000100:00100000:1.0:1786562600.381760:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17223 00000100:00100000:1.0:1786562600.381770:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+30:66620:x1873345652905600:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.381798:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.381802:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562600.381830:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2800/0x5c655bf66689fdcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd19b expref: 30 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.381850:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2000) 00010000:00010000:1.0:1786562600.381872:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562600.381887:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fe77 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1be expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.382515:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.382529:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.382539:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.382549:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4df:0x0]: returning size 0 00010000:00010000:1.0:1786562600.382594:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fe77 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 32 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.382614:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 31 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.382622:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e9bc2a2600) 00010000:00010000:1.0:1786562600.382626:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562600.382628:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3200, rc 0) 00000100:00100000:1.0:1786562600.382687:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+31:66620:x1873345652905600:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 918us (1107us total) trans 8589950745 rc 0/0 00000100:00100000:1.0:1786562600.382695:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17223 00000100:00100000:0.0:1786562600.388768:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.388897:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652905856 00000100:00100000:2.0:1786562600.388906:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652905856 00000100:00100000:2.0:1786562600.389085:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17224 00000100:00100000:2.0:1786562600.389097:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:66620:x1873345652905856:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.389123:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.389147:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1c5 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.389261:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.389277:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 32 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.389286:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.389318:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 32 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.389332:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 32 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.389345:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654908160:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562600.389419:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9812540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562600.392439:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654908160:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562600.392466:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.393129:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.393207:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652905984 00000100:00100000:1.0:1786562600.393214:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652905984 00010000:00010000:1.0:1786562600.393250:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 33 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.393293:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8756 00000100:00100000:1.0:1786562600.393302:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+33:2350:x1873345652905984:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562600.393316:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562600.393323:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 33 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.393335:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 33 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.393357:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fe7e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1be expref: 33 pid: 34450 timeout: 1132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.393376:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e9bc2a2600) 00010000:00010000:1.0:1786562600.393381:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.393390:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.393398:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.393426:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562600.393477:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+32:2350:x1873345652905984:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 176us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.393485:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8756 00010000:00010000:3.0:1786562600.393807:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.393815:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562600.393835:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4df:0x0]: returning size 0 00000004:00080000:3.0:1786562600.394075:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73a:0x0], index 0: 0 00000004:00080000:3.0:1786562600.394083:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71d:0x0], index 1: 0 00010000:00010000:3.0:1786562600.394904:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.394917:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.394925:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.394931:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.394935:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.394942:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.394961:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e9bc2a2600) 00010000:00010000:3.0:1786562600.394965:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562600.394968:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.394974:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689fe93 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.395151:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1c5 expref: 32 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.395163:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:3.0:1786562600.395165:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562600.395169:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf66689fe8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1c5 expref: 32 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.395182:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:3.0:1786562600.396492:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:66620:x1873345652905856:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 7388us (7725us total) trans 8589950746 rc 301/301 00000100:00100000:3.0:1786562600.396503:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17224 00000100:00100000:3.0:1786562600.400825:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.400963:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652906240 00000100:00100000:2.0:1786562600.400972:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652906240 00000100:00100000:2.0:1786562600.401192:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6317 00000100:00100000:2.0:1786562600.401211:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:66620:x1873345652906240:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562600.401578:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+32:66620:x1873345652906240:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 368us (761us total) trans 8589950747 rc 0/0 00000100:00100000:2.0:1786562600.401587:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6317 00000100:00100000:0.0:1786562600.404954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.405157:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652906368 00000100:00100000:1.0:1786562600.405166:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652906368 00000100:00100000:1.0:1786562600.405278:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17225 00000100:00100000:1.0:1786562600.405289:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+32:66620:x1873345652906368:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.405312:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.405346:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fea1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1cc expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.405438:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fea8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.405460:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.405472:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.405530:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4df:0x0]: returning size 0 00000004:00200000:1.0:1786562600.405534:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562600.405558:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.405599:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3200/0x5c655bf66689fea1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1cc expref: 34 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.405627:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1cc expref: 33 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.405636:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562600.405639:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562600.405642:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2a00, rc 0) 00000100:00100000:1.0:1786562600.405729:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+33:66620:x1873345652906368:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 442us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.405737:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17225 00000100:00100000:0.0:1786562600.411579:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.411634:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.411717:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652906496 00000100:00100000:1.0:1786562600.411743:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652906496 00000100:00100000:1.0:1786562600.411801:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652906624 00000100:00100000:1.0:1786562600.411805:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652906624 00000100:00100000:1.0:1786562600.411870:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17883 00000100:00100000:1.0:1786562600.411892:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652906496:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.411922:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.411954:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069df5504/0x5c655bf66689feaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1d3 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562600.411997:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562600.412091:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73a:0x0].0x0 since=1032s v=(0 0) 00010000:00010000:1.0:1786562600.412097:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562600.412106:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069df5504/0x5c655bf66689feaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1d3 expref: 8 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.412133:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069df5504/0x5c655bf66689feaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1d3 expref: 8 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.412148:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2800, rc 0) 00000100:00100000:1.0:1786562600.412234:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652906496:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 345us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.412242:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17883 00000100:00100000:1.0:1786562600.412327:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17884 00000100:00100000:1.0:1786562600.412337:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+6:2351:x1873345652906624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562600.412345:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562600.412368:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f13c5c9/0x5c655bf66689feb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1da expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562600.412396:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562600.412408:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71d:0x0].0x0 since=1032s v=(0 0) 00010000:00010000:1.0:1786562600.412411:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562600.412417:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f13c5c9/0x5c655bf66689feb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1da expref: 7 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.412475:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f13c5c9/0x5c655bf66689feb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1da expref: 7 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.412484:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3200, rc 0) 00000100:00100000:1.0:1786562600.412507:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652906624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 172us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.412513:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17884 00000100:00100000:3.0:1786562600.419585:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.419688:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652906880 00000100:00100000:2.0:1786562600.419698:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652906880 00000100:00100000:2.0:1786562600.419775:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17226 00000100:00100000:2.0:1786562600.419784:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+33:66620:x1873345652906880:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.419804:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.419825:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689febd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1e1 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.420312:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fec4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.420328:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fec4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.420339:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fec4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562600.420353:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00010000:00010000:2.0:1786562600.420477:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf66689febd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e1 expref: 36 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.420503:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fec4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e1 expref: 35 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.420513:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562600.420515:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562600.420519:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562600.420623:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+35:66620:x1873345652906880:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 839us (1047us total) trans 8589950748 rc 0/0 00000100:00100000:2.0:1786562600.420631:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17226 00000100:00100000:0.0:1786562600.425967:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.426228:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907008 00000100:00100000:1.0:1786562600.426243:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907008 00000100:00100000:1.0:1786562600.426377:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17885 00000100:00100000:1.0:1786562600.426390:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652907008:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562600.426451:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426468:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562600.426473:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562600.426479:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426493:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426524:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426533:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426542:0:29965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426550:0:29965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562600.426555:0:29965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426564:0:29965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426592:0:29965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.426600:0:29965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf66689fed2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.426720:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652907008:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 332us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.426728:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17885 00000100:00100000:0.0:1786562600.506407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.510233:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907136 00000100:00100000:1.0:1786562600.510249:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907136 00000100:00100000:1.0:1786562600.510326:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17227 00000100:00100000:1.0:1786562600.510337:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+35:66620:x1873345652907136:12345-192.168.204.29@tcp:44:lfs.0 00000100:00100000:1.0:1786562600.571635:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+35:66620:x1873345652907136:12345-192.168.204.29@tcp:44:lfs.0 Request processed in 61290us (65228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.571651:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17227 00000001:00080000:3.0:1786562600.572246:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950738 is committed 00000001:00080000:3.0:1786562600.572264:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950745 is committed 00000001:00080000:3.0:1786562600.572289:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950748 is committed 00000004:00080000:3.0:1786562600.572301:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2920 committed 00000100:00100000:1.0:1786562600.572493:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654908288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786562600.572565:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562600.572635:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654908288 00000100:00100000:3.0:1786562600.572643:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654908288 00000100:00100000:3.0:1786562600.572690:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17886 00000100:00100000:3.0:1786562600.572699:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654908288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786562600.572727:0:29967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1820 count 1 00002000:00010000:3.0:1786562600.572762:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562600.572771:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.572789:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71c:0x0].0x0 since=1033s v=(0 0) 00010000:00010000:3.0:1786562600.572793:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562600.572801:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.572816:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.572828:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.572836:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.572856:0:29967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786562600.574682:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654908288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1977us (2121us total) trans 17179876104 rc 0/0 00000100:00100000:3.0:1786562600.574697:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17886 00010000:00010000:3.0:1786562600.574731:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562600.574738:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.574752:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562600.574756:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.574767:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.574787:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.574795:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fed97e64/0x5c655bf66689fed9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.574816:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562600.574818:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562600.574820:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562600.574899:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.574932:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.575027:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907392 00000100:00100000:0.0:1786562600.575034:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907392 00000100:00100000:0.0:1786562600.575075:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907264 00000100:00100000:0.0:1786562600.575079:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907264 00000100:00100000:0.0:1786562600.575102:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17887 00000100:00100000:0.0:1786562600.575110:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652907392:12345-192.168.204.29@tcp:16:lfs.0 00000100:00100000:0.0:1786562600.575215:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652907392:12345-192.168.204.29@tcp:16:lfs.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.575222:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17887 00000100:00100000:0.0:1786562600.575240:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17888 00000100:00100000:0.0:1786562600.575247:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652907264:12345-192.168.204.29@tcp:16:lfs.0 00000100:00100000:0.0:1786562600.575288:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652907264:12345-192.168.204.29@tcp:16:lfs.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.575295:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17888 00000004:00080000:1.0:1786562600.576639:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c52ce00/2, rc 0, transno 17179876104 00000100:00100000:1.0:1786562600.576652:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654908288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562600.602512:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.602804:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907520 00000100:00100000:0.0:1786562600.602817:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907520 00000100:00100000:0.0:1786562600.602960:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17889 00000100:00100000:0.0:1786562600.602972:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652907520:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562600.603080:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603106:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x739:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562600.603111:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562600.603118:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603138:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603177:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603186:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603387:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603396:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562600.603401:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603411:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603430:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.603439:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf66689fee0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.603593:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652907520:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 622us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.603602:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17889 00000100:00100000:0.0:1786562600.608433:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562600.608532:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907776 00000100:00100000:3.0:1786562600.608543:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907776 00000100:00100000:3.0:1786562600.608815:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17228 00000100:00100000:3.0:1786562600.608826:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:66620:x1873345652907776:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562600.608894:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562600.608927:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf66689fea8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4df:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1cc expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.608960:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:3.0:1786562600.608973:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562600.609070:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.609093:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.609105:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562600.609296:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab723903 reply state 000000003ef07b24 transno 8589950749 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562600.609304:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562600.609404:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:66620:x1873345652907776:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 579us (979us total) trans 8589950749 rc 0/0 00000100:00100000:3.0:1786562600.609412:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17228 00000100:00100000:2.0:1786562600.616940:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562600.617167:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652907904 00000100:00100000:3.0:1786562600.617177:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652907904 00000100:00100000:3.0:1786562600.617249:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17229 00000100:00100000:3.0:1786562600.617259:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+12:66620:x1873345652907904:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562600.617284:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562600.617305:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1e8 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.617371:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.617385:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.617410:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562600.617413:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562600.617417:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb600, rc 0) 00000100:00100000:3.0:1786562600.617475:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:66620:x1873345652907904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 217us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562600.617483:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17229 00010000:00010000:1.0:1786562600.617957:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.617967:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.617974:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.617980:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.617985:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.618024:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.618039:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:1.0:1786562600.618042:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.618046:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.618052:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf66689fee7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.625291:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.625486:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652908032 00000100:00100000:2.0:1786562600.625497:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652908032 00000100:00100000:2.0:1786562600.625558:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17890 00000100:00100000:2.0:1786562600.625569:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652908032:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:2.0:1786562600.626547:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786562600.626553:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73a:0x0] updating lvb mtime from disk: 0 -> 1786562599 00002000:00010000:2.0:1786562600.626556:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73a:0x0] updating lvb atime from disk: 0 -> 1786562599 00002000:00010000:2.0:1786562600.626558:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73a:0x0] updating lvb ctime from disk: 0 -> 1786562599 00002000:00010000:2.0:1786562600.626561:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786562600.626767:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652908032:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 1196us (1482us total) trans 21474843626 rc 0/0 00000100:00100000:2.0:1786562600.626776:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17890 00000100:00100000:3.0:1786562600.631547:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.631894:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652908160 00000100:00100000:1.0:1786562600.631905:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652908160 00000100:00100000:1.0:1786562600.631968:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17891 00000100:00100000:1.0:1786562600.631980:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652908160:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562600.632279:0:37002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562600.632283:0:37002:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71d:0x0] updating lvb mtime from disk: 0 -> 1786562599 00002000:00010000:1.0:1786562600.632285:0:37002:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x71d:0x0] updating lvb atime from disk: 0 -> 1786562599 00002000:00010000:1.0:1786562600.632287:0:37002:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71d:0x0] updating lvb ctime from disk: 0 -> 1786562599 00002000:00010000:1.0:1786562600.632289:0:37002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562600.632353:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652908160:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 376us (817us total) trans 17179876105 rc 0/0 00000100:00100000:1.0:1786562600.632361:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17891 00000100:00100000:2.0:1786562600.642314:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.643676:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652908416 00000100:00100000:1.0:1786562600.643695:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652908416 00000100:00100000:1.0:1786562600.643775:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17230 00000100:00100000:1.0:1786562600.643787:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+12:66620:x1873345652908416:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562600.643859:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562600.643887:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf66689fe69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1b7 expref: 12 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.643908:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562600.643913:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562600.643953:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.643967:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.643977:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562600.644178:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000175b2c20 reply state 000000006538f50f transno 8589950750 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.644198:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562600.644297:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+13:66620:x1873345652908416:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 512us (1993us total) trans 8589950750 rc 0/0 00000100:00100000:1.0:1786562600.644305:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17230 00010000:00010000:0.0:1786562600.648058:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.648077:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.648086:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.648093:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.648098:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.648105:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.648122:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562600.648125:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.648129:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.648136:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf66689fef5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.654187:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562600.655256:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652908544 00000100:00100000:3.0:1786562600.655269:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652908544 00000100:00100000:3.0:1786562600.655339:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17892 00000100:00100000:3.0:1786562600.655349:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652908544:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562600.655581:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x739:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786562600.655585:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x739:0x0] updating lvb mtime from disk: 0 -> 1786562599 00002000:00010000:3.0:1786562600.655587:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x739:0x0] updating lvb atime from disk: 0 -> 1786562599 00002000:00010000:3.0:1786562600.655589:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x739:0x0] updating lvb ctime from disk: 0 -> 1786562599 00002000:00010000:3.0:1786562600.655591:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x739:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786562600.655674:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652908544:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 327us (1497us total) trans 21474843627 rc 0/0 00000100:00100000:3.0:1786562600.655683:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17892 00000100:00100000:3.0:1786562600.659178:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.659353:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652908800 00000100:00100000:2.0:1786562600.659363:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652908800 00000100:00100000:2.0:1786562600.659427:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6318 00000100:00100000:2.0:1786562600.659438:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+12:66620:x1873345652908800:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1786562600.659521:0:34647:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000404:0x4dd:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fec4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e1 expref: 12 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.659562:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.659576:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.659585:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.659618:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.659631:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 12 pid: 34450 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.659645:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654908416:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562600.659789:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474840 going to sleep for 11 seconds 00000100:00100000:1.0:1786562600.674468:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.674565:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652908928 00000100:00100000:0.0:1786562600.674574:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652908928 00010000:00010000:0.0:1786562600.674906:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 13 pid: 34450 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.675057:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8757 00000100:00100000:0.0:1786562600.675069:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:2349:x1873345652908928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562600.675088:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562600.675096:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 13 pid: 34450 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.675110:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 13 pid: 34450 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.675133:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562600.675139:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.675160:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.675167:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.675386:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562600.675505:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:2349:x1873345652908928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 437us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.675514:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8757 00010000:00010000:2.0:1786562600.675612:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689fdba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd194 expref: 12 pid: 34450 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.675629:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654908416:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562600.675649:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675658:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675667:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675688:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675708:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675716:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675743:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 11 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.675754:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 11 pid: 33113 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.675767:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654908544:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562600.675833:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474840 going to sleep for 11 seconds 00000100:00100000:1.0:1786562600.688031:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.688177:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654908544:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562600.688214:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562600.691956:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652909056 00000100:00100000:3.0:1786562600.691981:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652909056 00010000:00010000:3.0:1786562600.692121:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 12 pid: 33113 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.692305:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8758 00000100:00100000:1.0:1786562600.692332:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652909056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562600.692354:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562600.692366:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 12 pid: 33113 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.692384:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 12 pid: 33113 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.692407:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf66689feee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e8 expref: 12 pid: 33113 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.692424:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:1.0:1786562600.692430:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.692439:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.692447:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.692526:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562600.692589:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652909056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 271us (4594us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.692597:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8758 00010000:00010000:2.0:1786562600.699980:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.700026:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562600.700635:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654908672:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1786562600.700705:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562600.700747:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562600.700971:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654908672 00000100:00100000:0.0:1786562600.700980:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654908672 00000100:00100000:0.0:1786562600.701063:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1786562600.701074:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:34647:x1873345654908672:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562600.701166:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:34647:x1873345654908672:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 93us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.701173:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1786562600.701882:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654908672:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562600.701943:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654908800:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562600.702042:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562600.702063:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562600.702366:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654908800 00000100:00100000:0.0:1786562600.702372:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654908800 00000100:00100000:0.0:1786562600.702405:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1786562600.702412:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:34647:x1873345654908800:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562600.702476:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:34647:x1873345654908800:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 64us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.702483:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1786562600.702627:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654908800:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562600.702687:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654908928:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562600.702727:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562600.702752:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99c1fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562600.702800:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654908928 00000100:00100000:0.0:1786562600.702804:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654908928 00000100:00100000:0.0:1786562600.702835:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1786562600.702850:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345654908928:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562600.702910:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345654908928:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.702916:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1786562600.702987:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654908928:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:2.0:1786562600.703736:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].72, 280 off70664 00000001:00080000:2.0:1786562600.703750:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950751 00000100:00100000:2.0:1786562600.703812:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654909056:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1786562600.703852:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562600.703869:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562600.704097:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909056 00000100:00100000:0.0:1786562600.704103:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909056 00000100:00100000:0.0:1786562600.704141:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1786562600.704149:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345654909056:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562600.704319:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:34647:x1873345654909056:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 171us (466us total) trans 17179876106 rc 0/0 00000100:00100000:0.0:1786562600.704326:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1786562600.704604:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654909056:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1786562600.704636:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654909184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1786562600.704664:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562600.704696:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881186e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562600.704783:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909184 00000100:00100000:1.0:1786562600.704788:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909184 00000100:00100000:1.0:1786562600.704811:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:1.0:1786562600.704817:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:34647:x1873345654909184:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562600.705711:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345654909184:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 890us (1042us total) trans 21474843628 rc 0/0 00000100:00100000:1.0:1786562600.705720:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1786562600.712374:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345654909184:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1786562600.712560:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950752 00010000:00010000:3.0:1786562600.712611:0:34647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712622:0:34647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712629:0:34647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712635:0:34647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.712639:0:34647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712647:0:34647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712662:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562600.712666:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786562600.712671:0:34647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712677:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff03 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4df:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712927:0:34647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712934:0:34647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712941:0:34647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.712947:0:34647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.713331:0:34647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.713338:0:34647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.713348:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562600.713351:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786562600.713354:0:34647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.713360:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689fefc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.713376:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562600.713378:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562600.713385:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689fec4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1e1 expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562600.713505:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+12:66620:x1873345652908800:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 54068us (54336us total) trans 8589950753 rc 0/0 00000100:00100000:3.0:1786562600.713517:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6318 00000020:00080000:3.0:1786562600.713523:0:34647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1786562600.720408:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.720565:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652909184 00000100:00100000:2.0:1786562600.720575:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652909184 00000100:00100000:2.0:1786562600.720683:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17231 00000100:00100000:2.0:1786562600.720703:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+12:66620:x1873345652909184:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.720733:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.720756:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689ff0a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1ef expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.720818:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689ff0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1ef expref: 13 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.720835:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfca00/0x5c655bf66689ff0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1ef expref: 13 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.720855:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:2.0:1786562600.720859:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562600.720863:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfca00, rc 0) 00000100:00100000:2.0:1786562600.720930:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:66620:x1873345652909184:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 237us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562600.720938:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17231 00000100:00100000:0.0:1786562600.725430:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.725528:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652909440 00000100:00100000:1.0:1786562600.725538:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652909440 00000100:00100000:1.0:1786562600.725600:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6319 00000100:00100000:1.0:1786562600.725610:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882851850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:66620:x1873345652909440:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562600.725847:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882851850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:66620:x1873345652909440:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 238us (428us total) trans 8589950754 rc 0/0 00000100:00100000:1.0:1786562600.725855:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6319 00000100:00100000:3.0:1786562600.729151:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.729412:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652909696 00000100:00100000:0.0:1786562600.729425:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652909696 00000100:00100000:0.0:1786562600.729538:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6320 00000100:00100000:0.0:1786562600.729552:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:66620:x1873345652909696:12345-192.168.204.29@tcp:35:lfs.0 00000004:00080000:0.0:1786562600.730528:0:33116:0:(mdd_object.c:4018:mdd_close()) Object [0x200000404:0x4df:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1786562600.730804:0:33116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.730827:0:33116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.730841:0:33116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.730851:0:33116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.730857:0:33116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.730865:0:33116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.730973:0:33116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562600.731162:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:66620:x1873345652909696:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1608us (2022us total) trans 8589950755 rc 0/0 00000100:00100000:0.0:1786562600.731173:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6320 00010000:00010000:1.0:1786562600.735446:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562600.735467:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.735481:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562600.735486:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.735502:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.735527:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4df:0x0].0x0 (ffff90e9b46abc00) 00010000:00010000:1.0:1786562600.735531:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786562600.735537:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.735543:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff11 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.735582:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562600.735584:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562600.735586:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562600.742367:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562600.747066:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.747411:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652909824 00000100:00100000:2.0:1786562600.747426:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652909824 00000100:00100000:2.0:1786562600.747502:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17232 00000100:00100000:2.0:1786562600.747513:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:66621:x1873345652909824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.747546:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.747579:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf66689ff18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1f6 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.747775:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689ff1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.747794:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.747810:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562600.748126:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562600.748132:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 38 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562600.748506:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.748543:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf66689ff18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1f6 expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.748565:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1f6 expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.748576:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562600.748580:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562600.748584:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562600.748773:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:66621:x1873345652909824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1260us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562600.748784:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17232 00000100:00100000:2.0:1786562600.757941:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.758072:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652910080 00000100:00100000:0.0:1786562600.758088:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652910080 00000100:00100000:0.0:1786562600.758165:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17233 00000100:00100000:0.0:1786562600.758180:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:66621:x1873345652910080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562600.758217:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562600.758249:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd1fd expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758369:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758387:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758400:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758417:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758424:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758431:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758823:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758832:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758839:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758850:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.758854:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758863:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758878:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562600.758881:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.758887:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758893:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758908:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758914:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758920:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758926:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.758929:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758936:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758947:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562600.758950:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.758953:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.758959:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.759064:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1fd expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.759076:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562600.759078:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562600.759082:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1fd expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.759093:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269000, rc 0) 00000100:00100000:0.0:1786562600.759190:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:66621:x1873345652910080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1012us (1266us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562600.759201:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17233 00000100:00100000:2.0:1786562600.763741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.763857:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652910208 00000100:00100000:1.0:1786562600.763870:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652910208 00000100:00100000:1.0:1786562600.763941:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17234 00000100:00100000:1.0:1786562600.763953:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66621:x1873345652910208:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562600.764212:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764234:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764248:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764265:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764277:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764285:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764680:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764690:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764697:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.764743:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:1.0:1786562600.764749:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562600.764763:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764780:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764788:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764795:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764801:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.764806:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764814:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764829:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562600.764832:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.764838:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764844:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ff3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764859:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764865:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764870:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764875:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.764878:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764885:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764892:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9bc2a2600) 00010000:00010000:1.0:1786562600.764895:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.764898:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764907:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ff42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764922:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764928:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764934:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764939:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.764942:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764948:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764955:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:1.0:1786562600.764957:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.764960:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.764966:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ff49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.765968:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66621:x1873345652910208:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2004us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.765983:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17234 00000100:00100000:3.0:1786562600.780951:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.781529:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652910464 00000100:00100000:2.0:1786562600.781543:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652910464 00000100:00100000:2.0:1786562600.781622:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17235 00000100:00100000:2.0:1786562600.781635:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:66622:x1873345652910464:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.781663:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.781691:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689ff50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd204 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.781794:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.781811:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.781825:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.781845:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.781857:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.781863:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782491:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782503:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782510:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782518:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.782523:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782531:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782547:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562600.782551:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.782555:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782561:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782574:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782581:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782588:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782594:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.782597:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782603:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782610:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562600.782612:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.782615:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782620:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782665:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689ff50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd204 expref: 17 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782677:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562600.782679:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562600.782682:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689ff50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd204 expref: 17 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.782699:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562600.782790:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:66622:x1873345652910464:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1157us (1853us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562600.782800:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17235 00000100:00100000:2.0:1786562600.787140:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.787392:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652910592 00000100:00100000:0.0:1786562600.787404:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652910592 00000100:00100000:0.0:1786562600.787484:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17236 00000100:00100000:0.0:1786562600.787496:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:66622:x1873345652910592:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562600.787600:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.787622:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.787635:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.787651:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.787659:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.787676:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788094:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788105:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788112:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562600.788161:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:0.0:1786562600.788167:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562600.788182:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788198:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788205:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788212:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788218:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.788223:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788231:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788245:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562600.788249:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.788256:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788262:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788277:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788283:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788289:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788294:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.788298:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788304:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788311:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562600.788314:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.788317:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788322:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788343:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788350:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788356:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788361:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.788364:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788371:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788377:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:0.0:1786562600.788380:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.788383:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.788389:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf66689ff73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.788495:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:66622:x1873345652910592:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1000us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.788507:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17236 00000100:00100000:0.0:1786562600.810651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562600.810862:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652910848 00000100:00100000:2.0:1786562600.810875:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652910848 00000100:00100000:2.0:1786562600.811666:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17237 00000100:00100000:2.0:1786562600.811679:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:66623:x1873345652910848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562600.811709:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562600.811739:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689ff7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd20b expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.811904:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.811922:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.811934:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.811951:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.811958:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.811969:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812384:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812393:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812401:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812407:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.812412:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812420:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812436:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562600.812439:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.812444:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.812449:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf66689ff81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813474:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813494:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813501:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813508:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562600.813511:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813521:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813535:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562600.813538:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562600.813541:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813547:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf66689ff88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813613:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689ff7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd20b expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813625:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562600.813628:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562600.813631:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf66689ff7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd20b expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562600.813642:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562600.813782:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:66623:x1873345652910848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2097us (3137us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562600.813798:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17237 00000100:00100000:3.0:1786562600.819948:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562600.820149:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652910976 00000100:00100000:0.0:1786562600.820161:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652910976 00000100:00100000:0.0:1786562600.820249:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17238 00000100:00100000:0.0:1786562600.820260:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66623:x1873345652910976:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562600.820379:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.820400:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.820416:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.820434:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.820441:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.820448:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821136:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821150:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821158:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562600.821323:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:0.0:1786562600.821329:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562600.821347:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821363:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821371:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821379:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821385:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.821391:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821399:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821414:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562600.821418:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.821435:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821442:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf66689ff8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821455:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821461:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821467:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821472:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.821475:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821481:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821489:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562600.821492:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.821495:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821501:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf66689ff96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821521:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821529:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821534:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821539:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562600.821541:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821546:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821553:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:0.0:1786562600.821555:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562600.821558:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562600.821563:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf66689ff9d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562600.822216:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:66623:x1873345652910976:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1950us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562600.822230:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17238 00000100:00100000:0.0:1786562600.851124:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562600.851467:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652911232 00000100:00100000:3.0:1786562600.851482:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652911232 00000100:00100000:3.0:1786562600.851564:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17239 00000100:00100000:3.0:1786562600.851578:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:66624:x1873345652911232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562600.851606:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562600.851635:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689ffa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd212 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.851737:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.851753:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.851767:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.851784:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.851791:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.851802:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852678:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852692:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852699:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852706:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.852711:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852718:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852735:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:3.0:1786562600.852738:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562600.852743:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852750:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf66689ffab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852766:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852772:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852779:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852785:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562600.852788:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852795:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852803:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562600.852805:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562600.852809:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852815:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf66689ffb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852865:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689ffa4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd212 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852877:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:3.0:1786562600.852879:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562600.852882:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf66689ffa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd212 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562600.852892:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb400, rc 0) 00000100:00100000:3.0:1786562600.854370:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:66624:x1873345652911232:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2784us (3251us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562600.854390:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17239 00000100:00100000:2.0:1786562600.871537:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562600.871679:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652911360 00000100:00100000:1.0:1786562600.871692:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652911360 00000100:00100000:1.0:1786562600.871768:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17240 00000100:00100000:1.0:1786562600.871780:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:66624:x1873345652911360:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562600.871883:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.871904:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.871917:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.871936:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.871944:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.871950:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.872918:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.872934:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.872944:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562600.872999:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4dd:0x0]: returning size 0 00000004:00200000:1.0:1786562600.873054:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562600.874591:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874626:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874635:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874643:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874651:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.874656:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874666:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874686:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562600.874691:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.874696:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874702:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874724:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874729:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874735:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874740:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.874743:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874750:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874757:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdeaaee82 (ffff90e9bc2a2600) 00010000:00010000:1.0:1786562600.874760:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.874763:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874769:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2e00/0x5c655bf66689ffc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdeaaee82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874789:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874795:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874801:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874806:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562600.874809:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874815:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874822:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4dd:0x0].0x0 (ffff90e9b6332b00) 00010000:00010000:1.0:1786562600.874825:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562600.874828:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562600.874834:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf66689ffc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562600.874984:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:66624:x1873345652911360:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3199us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562600.875050:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17240 00010000:00010000:0.0:1786562601.765842:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562602.789272:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562603.416958:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876106 is committed 00000001:00080000:0.0:1786562603.416982:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876105 is committed 00010000:00010000:1.0:1786562603.814602:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562603.919435:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843628 is committed 00000001:00080000:3.0:1786562603.919460:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843626 is committed 00000001:00080000:3.0:1786562603.919466:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843627 is committed 00000100:00100000:1.0:1786562604.343938:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562604.343990:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562604.344061:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562604.344089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562604.344245:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652911488 00000100:00100000:3.0:1786562604.344259:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652911488 00000100:00100000:3.0:1786562604.344337:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 280 00000100:00100000:3.0:1786562604.344349:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652911488:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562604.344449:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652911488:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562604.344460:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 280 00000100:00100000:3.0:1786562604.344512:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652911744 00000100:00100000:3.0:1786562604.344517:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652911744 00000100:00100000:3.0:1786562604.344569:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652911872 00000100:00100000:3.0:1786562604.344573:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652911872 00000100:00100000:3.0:1786562604.344604:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 477 00000100:00100000:3.0:1786562604.344613:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652911744:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562604.344649:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652911744:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562604.344655:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 477 00000100:00100000:3.0:1786562604.344667:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 478 00000100:00100000:3.0:1786562604.344673:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652911872:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562604.344697:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652911872:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562604.344706:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 478 00000100:00080000:3.0:1786562604.344723:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562604.344728:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562604.344955:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652911616 00000100:00100000:2.0:1786562604.344961:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652911616 00000100:00100000:2.0:1786562604.345044:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 323 00000100:00100000:2.0:1786562604.345053:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652911616:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562604.345088:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652911616:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 38us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562604.345095:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 323 00000100:00080000:3.0:1786562604.345888:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562604.839356:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562605.349498:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562605.350035:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654909440:0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.350279:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654909568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562605.351261:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654909824:0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.351517:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562605.351578:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654910080:0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.351605:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562605.351631:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562605.351637:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654909696:0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.351659:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562605.351749:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909568 00000100:00100000:3.0:1786562605.351756:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909568 00000100:00100000:3.0:1786562605.351811:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1786562605.351821:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654909568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562605.351857:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 518062080 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562605.351917:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654909568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562605.351925:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1786562605.351951:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654910080 00000100:00100000:3.0:1786562605.351954:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654910080 00000100:00100000:3.0:1786562605.351979:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909696 00000100:00100000:3.0:1786562605.351982:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909696 00000100:00100000:3.0:1786562605.352022:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1786562605.352031:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654910080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.352070:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654910080:12345-0@lo:400:kworker.0 Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562605.352078:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1786562605.352091:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1786562605.352097:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654909696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.352123:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654909696:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562605.352129:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:3.0:1786562605.352145:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562605.352150:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562605.352176:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654909696:0@lo:400:kworker.0 00000100:00100000:2.0:1786562605.352615:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562605.352652:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562605.352869:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562605.352918:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654909312:0@lo:400:kworker.0 00000100:00100000:1.0:1786562605.352953:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562605.352985:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654909952:0@lo:400:kworker.0 00000100:00100000:1.0:1786562605.353031:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562605.353066:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909312 00000100:00100000:1.0:1786562605.353071:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909312 00000100:00100000:1.0:1786562605.353105:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1786562605.353112:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562605.353151:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654909312:12345-0@lo:400:kworker.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562605.353161:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1786562605.353299:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909440 00000100:00100000:2.0:1786562605.353303:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909440 00000100:00100000:2.0:1786562605.353456:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1786562605.353464:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654909440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562605.353502:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654909440:12345-0@lo:400:kworker.0 Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562605.353508:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:2.0:1786562605.353532:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562605.353655:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909952 00000100:00100000:1.0:1786562605.353659:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909952 00000100:00100000:1.0:1786562605.353727:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1786562605.353733:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562605.353764:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654909952:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562605.353769:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1786562605.353799:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876106 gen 2 00000004:00080000:1.0:1786562605.353805:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c52ce00, transno 17179876104 00000004:00080000:1.0:1786562605.353815:0:3290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179876106 committed transno 17179876106 00000100:00100000:1.0:1786562605.353834:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654909952:0@lo:400:kworker.0 00000100:00100000:1.0:1786562605.353845:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654909440:0@lo:400:kworker.0 00000100:00100000:1.0:1786562605.353853:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654909312:0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.354728:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654910080:0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.354742:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843628 gen 2 00000004:00080000:3.0:1786562605.354746:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474843628 committed transno 21474843628 00000100:00100000:3.0:1786562605.354823:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654909568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562605.357610:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562605.357711:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654910208 00000100:00100000:0.0:1786562605.357720:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654910208 00000100:00100000:0.0:1786562605.357769:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1786562605.357781:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654910208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562605.357821:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562605.357877:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654910208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (5223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562605.357884:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1786562605.357967:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562605.360532:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654909824 00000100:00100000:3.0:1786562605.360547:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654909824 00000100:00100000:3.0:1786562605.360610:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1786562605.360620:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654909824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562605.360711:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654909824:12345-0@lo:400:kworker.0 Request processed in 93us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562605.360719:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1786562605.360768:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654909824:0@lo:400:kworker.0 00000100:00080000:2.0:1786562605.366474:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562605.863329:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562605.964300:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950755 is committed 00000020:00080000:1.0:1786562605.964341:0:33119:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e882474840 refcount 2 committed 0 result 0 batchid 4294969305 00000020:00080000:1.0:1786562605.964347:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e998342a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e9863ae3c0 00000020:00080000:1.0:1786562605.964352:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9bb278d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e882474f00 00000020:00080000:1.0:1786562605.964355:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9bb278f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e9baf3ac00 00000020:00080000:1.0:1786562605.964358:0:33119:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].72 00000020:00080000:2.0:1786562605.964446:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969305 committed batchid 4294969304 00000020:00080000:2.0:1786562605.964718:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969304 00010000:00010000:0.0:1786562606.886706:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786562607.301949:0:38163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 204a: FLR write/stale/resync tests with self-extending mirror ========================================================== 15:23:25 (1786562605) 00000100:00100000:0.0:1786562607.575299:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562607.575447:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912128 00000100:00100000:1.0:1786562607.575459:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912128 00000100:00100000:1.0:1786562607.575546:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17241 00000100:00100000:1.0:1786562607.575559:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:67195:x1873345652912128:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:1.0:1786562607.575619:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562607.575651:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf66689ff1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd1f6 expref: 9 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.575673:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562607.575685:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562607.575989:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.576052:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.576064:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.576080:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.576089:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.576096:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562607.577172:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e0:0x0]: returning size 512 00010000:00010000:1.0:1786562607.577185:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.577193:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.577204:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.577211:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562607.577215:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786562607.577216:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562607.577222:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.577235:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562607.577239:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562607.577242:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.577249:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf66689ffce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562607.577265:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e027a83f reply state 00000000acaa6f2b transno 8589950756 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562607.577274:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562607.577361:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:67195:x1873345652912128:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 1803us (2082us total) trans 8589950756 rc 0/0 00000100:00100000:1.0:1786562607.577369:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17241 00010000:00010000:1.0:1786562607.583568:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.583587:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.583599:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.583605:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562607.583610:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.583618:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.583635:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x84e5157e (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562607.583639:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562607.583643:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.583649:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf66689ffd5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562607.630802:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562607.630909:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912256 00000100:00100000:2.0:1786562607.630921:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912256 00000100:00100000:2.0:1786562607.630994:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17242 00000100:00100000:2.0:1786562607.631041:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:67201:x1873345652912256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562607.631068:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562607.631093:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689ffdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd219 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.631176:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689ffe3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.631190:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689ffe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.631201:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689ffe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562607.631261:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562607.631265:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 39 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562607.631285:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689ffe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.631309:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf66689ffdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd219 expref: 11 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.631328:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689ffe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd219 expref: 10 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.631336:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:2.0:1786562607.631339:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562607.631342:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562607.631392:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:67201:x1873345652912256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 390us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562607.631402:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17242 00000100:00100000:2.0:1786562607.653215:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.653382:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912384 00000100:00100000:0.0:1786562607.653392:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912384 00000100:00100000:0.0:1786562607.653457:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17243 00000100:00100000:0.0:1786562607.653467:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:67201:x1873345652912384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562607.653488:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562607.653524:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689ffea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd220 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653747:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653762:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653774:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653793:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653800:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653807:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653933:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689ffff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653943:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689ffff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.653950:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689ffff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562607.653986:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e0:0x0]: returning size 512 00000004:00200000:0.0:1786562607.653990:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562607.654049:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689ffff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654062:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654068:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654076:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654086:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.654091:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654099:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654296:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:0.0:1786562607.654300:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.654305:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654312:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf66689fff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654326:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654331:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654336:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654341:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.654343:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654349:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654360:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x84e5157e (ffff90e9b46abf00) 00010000:00010000:0.0:1786562607.654363:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.654366:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654371:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf66689fff8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x84e5157e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654405:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf66689ffea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd220 expref: 12 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654421:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269400/0x5c655bf66689ffff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd220 expref: 11 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.654428:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.654431:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786562607.654433:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269400, rc 0) 00000100:00100000:0.0:1786562607.654742:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+11:67201:x1873345652912384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1274us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562607.654751:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17243 00000100:00100000:1.0:1786562607.668521:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.674817:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912512 00000100:00100000:0.0:1786562607.674836:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912512 00000100:00100000:0.0:1786562607.675024:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17244 00000100:00100000:0.0:1786562607.675038:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:67201:x1873345652912512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562607.675061:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562607.675082:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0006 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd227 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675163:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675178:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675190:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675233:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675240:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675247:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675319:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675326:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675332:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675338:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.675342:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675353:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675366:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.675369:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.675375:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675381:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a000d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675395:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675402:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675408:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675413:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.675415:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675421:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675427:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46abf00) 00010000:00010000:0.0:1786562607.675429:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.675432:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675437:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0014 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675472:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0006 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd227 expref: 12 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675482:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.675484:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.675488:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0006 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd227 expref: 12 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.675496:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562607.675590:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:67201:x1873345652912512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 555us (7080us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562607.675598:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17244 00000100:00100000:2.0:1786562607.680412:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562607.680831:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912640 00000100:00100000:3.0:1786562607.680841:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912640 00000100:00100000:3.0:1786562607.680948:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17245 00000100:00100000:3.0:1786562607.680959:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:67201:x1873345652912640:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562607.680979:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562607.681002:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a001b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd22e expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681111:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681135:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681146:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681163:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681170:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681177:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681242:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681250:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681258:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681265:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562607.681269:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681276:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681289:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562607.681293:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562607.681298:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681305:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0022 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681318:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681325:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681331:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681337:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562607.681340:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681347:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681359:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e999bb1e00) 00010000:00010000:3.0:1786562607.681362:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562607.681365:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681371:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0029 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681404:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a001b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd22e expref: 12 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681415:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562607.681417:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562607.681421:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a001b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd22e expref: 12 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.681431:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca800, rc 0) 00000100:00100000:3.0:1786562607.681485:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:67201:x1873345652912640:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 528us (1081us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562607.681493:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17245 00000100:00100000:2.0:1786562607.689181:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.689280:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912768 00000100:00100000:0.0:1786562607.689290:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912768 00000100:00100000:0.0:1786562607.689346:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17246 00000100:00100000:0.0:1786562607.689357:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:67201:x1873345652912768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562607.689378:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562607.689398:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd235 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.689470:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0037 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.689483:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0037 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.689496:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0037 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562607.689553:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e0:0x0]: returning size 512 00000004:00200000:0.0:1786562607.689557:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562607.689582:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0037 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.689607:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd235 expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.689626:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0037 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd235 expref: 12 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.689634:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.689637:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562607.689641:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562607.689710:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:67201:x1873345652912768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 355us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562607.689717:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17246 00000100:00100000:1.0:1786562607.694105:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.695128:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652912896 00000100:00100000:0.0:1786562607.695140:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652912896 00000100:00100000:0.0:1786562607.695207:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17247 00000100:00100000:0.0:1786562607.695218:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+12:67201:x1873345652912896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562607.695239:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562607.695260:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a003e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd23c expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695334:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695348:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695358:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695374:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695381:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695388:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695448:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695456:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695462:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695468:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.695471:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695482:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695508:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.695512:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.695517:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695523:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0045 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695536:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695542:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695547:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695553:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.695567:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695574:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695582:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46abf00) 00010000:00010000:0.0:1786562607.695584:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.695587:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695594:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a004c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695629:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a003e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd23c expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695642:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.695645:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.695649:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a003e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd23c expref: 13 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.695659:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268600, rc 0) 00000100:00100000:0.0:1786562607.695729:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+12:67201:x1873345652912896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 513us (1633us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562607.695736:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17247 00000100:00100000:3.0:1786562607.698987:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.699428:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652913152 00000100:00100000:0.0:1786562607.699437:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652913152 00000100:00100000:0.0:1786562607.699487:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17248 00000100:00100000:0.0:1786562607.699495:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+12:67201:x1873345652913152:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562607.699513:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562607.699515:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786562607.699542:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0037 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd235 expref: 12 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699574:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.699579:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562607.699598:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0053 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd243 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699878:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699892:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699902:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699916:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699923:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.699929:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702351:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702374:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702388:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562607.702403:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 0 00010000:00010000:0.0:1786562607.702432:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702444:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702452:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702458:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.702463:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702470:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702482:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.702485:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.702490:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702509:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a005a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562607.702522:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a626c2d reply state 00000000a2805494 transno 8589950757 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562607.702531:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562607.702570:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0053 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702584:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 13 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.702597:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:0.0:1786562607.702599:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562607.702601:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562607.702710:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:67201:x1873345652913152:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3206us (3724us total) trans 8589950757 rc 0/0 00000100:00100000:0.0:1786562607.702720:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17248 00010000:00010000:2.0:1786562607.705905:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.705921:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.705928:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.705934:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562607.705938:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.705945:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.705961:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46ab500) 00010000:00010000:2.0:1786562607.705964:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562607.705968:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.705975:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0061 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562607.706393:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562607.706422:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652913408 00000100:00100000:3.0:1786562607.706430:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652913408 00000100:00100000:3.0:1786562607.706476:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17249 00000100:00100000:3.0:1786562607.706484:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67201:x1873345652913408:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562607.706508:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562607.706526:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0076 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd24a expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.707000:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.707035:0:33113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.707045:0:33113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.707087:0:33113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.707100:0:33113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 1140 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562607.707113:0:33113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654910336:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562607.707215:0:33113:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562607.711913:0:33113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:33113:1873345654910336:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562607.711942:0:33113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562607.712062:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562607.713458:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652913536 00000100:00100000:2.0:1786562607.713469:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652913536 00010000:00010000:2.0:1786562607.713589:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 1140 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562607.713638:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8759 00000100:00100000:2.0:1786562607.713727:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652913536:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562607.713744:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562607.713751:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 1140 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.713871:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 1140 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.713898:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0068 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd243 expref: 15 pid: 33114 timeout: 1140 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.713917:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:2.0:1786562607.713922:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.713931:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.713939:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.713972:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562607.714090:0:33113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.714099:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562607.714120:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 0 00000100:00100000:2.0:1786562607.714389:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:2349:x1873345652913536:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 663us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562607.714398:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8759 00000004:00080000:0.0:1786562607.714612:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73b:0x0], index 0: 0 00000004:00080000:0.0:1786562607.714624:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71e:0x0], index 1: 0 00010000:00010000:0.0:1786562607.714934:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.714944:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.714951:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.714975:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.714980:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.714987:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.715043:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:0.0:1786562607.715046:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562607.715050:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.715056:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca800/0x5c655bf6668a007d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.715128:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0076 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd24a expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.715139:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.715142:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562607.715146:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0076 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd24a expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.715155:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cbc00, rc 0) 00000100:00100000:0.0:1786562607.715201:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67201:x1873345652913408:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8718us (8812us total) trans 8589950758 rc 301/301 00000100:00100000:0.0:1786562607.715209:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17249 00000100:00100000:3.0:1786562607.719433:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.719613:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652913792 00000100:00100000:0.0:1786562607.719625:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652913792 00000100:00100000:0.0:1786562607.720533:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6321 00000100:00100000:0.0:1786562607.720547:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:67201:x1873345652913792:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562607.721471:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:67201:x1873345652913792:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 922us (2040us total) trans 8589950759 rc 0/0 00000100:00100000:0.0:1786562607.721482:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6321 00000100:00100000:2.0:1786562607.726617:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.726718:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652914048 00000100:00100000:0.0:1786562607.726728:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652914048 00000100:00100000:0.0:1786562607.726793:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6322 00000100:00100000:0.0:1786562607.726803:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67201:x1873345652914048:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562607.727089:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67201:x1873345652914048:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 287us (481us total) trans 8589950760 rc 0/0 00000100:00100000:0.0:1786562607.727097:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6322 00000100:00100000:3.0:1786562607.742816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562607.742924:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652914304 00000100:00100000:2.0:1786562607.742935:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652914304 00000100:00100000:2.0:1786562607.742997:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17250 00000100:00100000:2.0:1786562607.743050:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67204:x1873345652914304:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562607.743150:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562607.743175:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a008b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd251 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.743427:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.743443:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.743454:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.743470:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.744799:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.744820:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.744962:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.744973:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.744982:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562607.744993:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 0 00010000:00010000:2.0:1786562607.745417:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745426:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745433:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745440:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562607.745445:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745453:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745468:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562607.745471:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562607.745476:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745484:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0092 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745619:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745630:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745636:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745642:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562607.745645:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745651:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745660:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332400) 00010000:00010000:2.0:1786562607.745663:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562607.745666:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745672:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0099 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745863:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a008b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd251 expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745882:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd251 expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.745890:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562607.745893:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562607.745896:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:2.0:1786562607.746056:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:67204:x1873345652914304:12345-192.168.204.29@tcp:101:dd.0 Request processed in 3049us (3247us total) trans 8589950761 rc 0/0 00000100:00100000:2.0:1786562607.746067:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17250 00000100:00100000:3.0:1786562607.766733:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562607.767146:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652914560 00000100:00100000:2.0:1786562607.767158:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652914560 00000100:00100000:2.0:1786562607.767228:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17251 00000100:00100000:2.0:1786562607.767240:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:67204:x1873345652914560:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562607.767266:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562607.767269:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562607.767297:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00a0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd251 expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.767317:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562607.767327:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562607.767343:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a00ae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd258 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.767394:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a00b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.767406:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a00b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.767416:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a00b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786562607.768585:0:34450:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71f:0x0], index 1: 0 00000040:00080000:2.0:1786562607.768758:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4392, 88 off356328 00000004:00080000:2.0:1786562607.768779:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1040210773211ns, next at 1023431328758ns, rc = 0 00000040:00080000:2.0:1786562607.768845:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4418, 88 off358768 00000004:00080000:2.0:1786562607.768863:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1040210857308ns, next at 1033671543000ns, rc = 0 00000040:00080000:2.0:1786562607.768899:0:34450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4419, 88 off358856 00000004:00080000:2.0:1786562607.768903:0:34450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1040210897858ns, next at 1033671543000ns, rc = 0 00000001:00080000:1.0:1786562607.809847:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950760 is committed 00000001:00080000:1.0:1786562607.809886:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950762 is committed 00000004:00080000:1.0:1786562607.809891:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2922 committed 00000004:00080000:1.0:1786562607.809903:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2921 committed 00000004:00080000:1.0:1786562607.809906:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2894 committed 00000020:00080000:1.0:1786562607.809921:0:33119:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969305 batchid updated 00000020:00080000:1.0:1786562607.810025:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969305 00000100:00100000:3.0:1786562607.810284:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654910464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562607.810353:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562607.810393:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562607.810399:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654910592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562607.810424:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562607.810448:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562607.810455:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654910720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562607.810476:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562607.810505:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654910464 00000100:00100000:3.0:1786562607.810513:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654910464 00000100:00100000:3.0:1786562607.810562:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654910592 00000100:00100000:3.0:1786562607.810566:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654910592 00000100:00100000:3.0:1786562607.810581:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654910720 00000100:00100000:3.0:1786562607.810584:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654910720 00000100:00100000:3.0:1786562607.810603:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17893 00000100:00100000:3.0:1786562607.810611:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654910464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562607.810906:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654910464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 294us (552us total) trans 17179876107 rc 0/0 00000100:00100000:3.0:1786562607.810914:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17893 00000100:00100000:3.0:1786562607.810930:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17894 00000100:00100000:3.0:1786562607.810936:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654910592:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1786562607.811448:0:33151:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969305 cancel update log [0x200000bd0:0x1:0x0].72: rc = 0 00000020:00080000:1.0:1786562607.811461:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969305 00010000:00010000:2.0:1786562607.811560:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a00b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd258 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.811574:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562607.811578:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562607.811592:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a00ae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd258 expref: 12 pid: 34450 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.811610:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a00b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd258 expref: 11 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.811640:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562607.811643:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562607.811645:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfcc00, rc 0) 00000100:00100000:2.0:1786562607.811797:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:67204:x1873345652914560:12345-192.168.204.29@tcp:101:dd.0 Request processed in 44558us (45110us total) trans 8589950762 rc 0/0 00000100:00100000:2.0:1786562607.811806:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17251 00000100:00100000:3.0:1786562607.812257:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654910592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1319us (1831us total) trans 17179876108 rc 0/0 00000100:00100000:3.0:1786562607.812265:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17894 00000100:00100000:3.0:1786562607.812282:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17895 00000100:00100000:3.0:1786562607.812292:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654910720:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1786562607.812330:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562607.812336:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562607.812894:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654910720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 603us (2414us total) trans 21474843629 rc 0/0 00000100:00100000:3.0:1786562607.812901:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17895 00000004:00080000:0.0:1786562607.812928:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9af24f100/2, rc 0, transno 21474843629 00000100:00100000:0.0:1786562607.812934:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654910720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562607.812937:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88720c380/2, rc 0, transno 17179876108 00000100:00100000:3.0:1786562607.812941:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654910592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562607.812950:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88720ce00/2, rc 0, transno 17179876107 00000100:00100000:3.0:1786562607.812953:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654910464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562607.817957:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562607.818396:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652914688 00000100:00100000:1.0:1786562607.818406:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652914688 00000100:00100000:1.0:1786562607.818487:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11636 00000100:00100000:1.0:1786562607.818499:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652914688:12345-192.168.204.29@tcp:4:dd.0 00002000:00010000:1.0:1786562607.818547:0:13913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562607.818558:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.818574:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=1040s v=(0 0) 00010000:00010000:1.0:1786562607.818578:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562607.818585:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562607.818601:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786562607.822486:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562607.823455:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.823766:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652914816 00000100:00100000:0.0:1786562607.823777:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652914816 00000100:00100000:0.0:1786562607.824096:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11637 00000100:00100000:0.0:1786562607.824109:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652914816:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:0.0:1786562607.824148:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.824167:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562607.824172:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562607.824179:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.824193:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562607.870485:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843630 is committed 00000001:00080000:2.0:1786562607.870508:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843629 is committed 00002000:00010000:0.0:1786562607.871198:0:13913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1786562607.871204:0:13913:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb mtime from disk: 0 -> 1786562607 00002000:00010000:0.0:1786562607.871207:0:13913:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb ctime from disk: 0 -> 1786562607 00002000:00010000:0.0:1786562607.871209:0:13913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1786562607.871227:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.871241:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.871251:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.871258:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562607.871264:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.871274:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.871295:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.871303:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce5bb92/0x5c655bf6668a00bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562607.871411:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652914688:12345-192.168.204.29@tcp:4:dd.0 Request processed in 52908us (53457us total) trans 21474843630 rc 0/0 00000100:00100000:0.0:1786562607.871422:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11636 00010000:00010000:0.0:1786562607.909354:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562607.909990:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843631 is committed 00002000:00010000:3.0:1786562607.910341:0:14369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1786562607.910361:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.910377:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.910387:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.910395:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562607.910401:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.910411:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.910433:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.910441:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32d77c0/0x5c655bf6668a00c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562607.910605:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652914816:12345-192.168.204.29@tcp:4:dd.0 Request processed in 86493us (87150us total) trans 21474843631 rc 0/0 00000100:00100000:3.0:1786562607.910617:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11637 00000100:00100000:1.0:1786562607.914634:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562607.914730:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652915072 00000100:00100000:3.0:1786562607.914741:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652915072 00000100:00100000:3.0:1786562607.914799:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6323 00000100:00100000:3.0:1786562607.914809:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:67204:x1873345652915072:12345-192.168.204.29@tcp:35:dd.0 00000001:00080000:3.0:1786562607.916447:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950763 00000100:00100000:3.0:1786562607.916599:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67204:x1873345652915072:12345-192.168.204.29@tcp:35:dd.0 Request processed in 1786us (1970us total) trans 8589950764 rc 0/0 00000100:00100000:3.0:1786562607.916611:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6323 00000020:00080000:3.0:1786562607.916617:0:34647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786562607.941813:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562607.941998:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652915328 00000100:00100000:2.0:1786562607.942267:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652915328 00000100:00100000:0.0:1786562607.942386:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17252 00000100:00100000:0.0:1786562607.942396:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:67205:x1873345652915328:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562607.942420:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562607.942441:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a00ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd25f expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942516:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942530:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942541:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942555:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942566:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942572:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942930:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942938:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942945:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942951:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.942956:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942963:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942977:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.942980:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.942985:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.942991:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a00d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943034:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943171:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943178:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943183:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562607.943187:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943192:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943200:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46ab700) 00010000:00010000:0.0:1786562607.943203:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562607.943206:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943212:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a00d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943252:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a00ca lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd25f expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943263:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562607.943265:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562607.943269:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a00ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd25f expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562607.943283:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562607.943356:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:67205:x1873345652915328:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 960us (1552us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562607.943364:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17252 00000100:00100000:0.0:1786562607.947519:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562607.947735:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652915584 00000100:00100000:3.0:1786562607.947745:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652915584 00000100:00100000:3.0:1786562607.947802:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17253 00000100:00100000:3.0:1786562607.947813:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67205:x1873345652915584:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562607.947834:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562607.947865:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a00df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd266 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562607.948170:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e0:0x0]: returning size 7680 00010000:00010000:3.0:1786562607.948339:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a00df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd266 expref: 15 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.948354:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:3.0:1786562607.948357:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562607.948362:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a00df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd266 expref: 15 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562607.948375:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb400, rc 0) 00000100:00100000:3.0:1786562607.948441:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67205:x1873345652915584:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 630us (932us total) trans 8589950765 rc 301/301 00000100:00100000:3.0:1786562607.948449:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17253 00000100:00100000:1.0:1786562607.954596:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562607.954707:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652915712 00000100:00100000:2.0:1786562607.954719:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652915712 00000100:00100000:2.0:1786562607.954782:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17254 00000100:00100000:2.0:1786562607.954792:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:67205:x1873345652915712:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562607.954886:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.954904:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.954916:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.954932:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.954940:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.954946:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955685:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955697:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955705:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562607.955743:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00000004:00200000:2.0:1786562607.955748:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562607.955761:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955776:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955783:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955790:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955796:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562607.955800:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955808:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955821:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562607.955824:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562607.955829:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955835:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a00ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955846:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955864:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955870:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955876:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562607.955879:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955885:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955891:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332200) 00010000:00010000:2.0:1786562607.955894:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562607.955897:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955903:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a00f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955917:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955924:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955929:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955934:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562607.955938:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955944:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.955955:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562607.955958:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562607.956413:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562607.956421:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a00fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562607.956549:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:67205:x1873345652915712:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1755us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562607.956559:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17254 00000100:00100000:2.0:1786562607.962033:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562607.962225:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652915968 00000100:00100000:0.0:1786562607.962234:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652915968 00000100:00100000:0.0:1786562607.962288:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6324 00000100:00100000:0.0:1786562607.962298:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67205:x1873345652915968:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562607.963425:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67205:x1873345652915968:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1123us (1414us total) trans 8589950766 rc 0/0 00000100:00100000:2.0:1786562607.963436:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6324 00000100:00100000:0.0:1786562608.011244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.011350:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652916224 00000100:00100000:2.0:1786562608.011360:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652916224 00000100:00100000:2.0:1786562608.011424:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17255 00000100:00100000:2.0:1786562608.011436:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:67210:x1873345652916224:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.011462:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.011487:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0102 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd26d expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011570:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011584:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011596:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011613:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011621:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011628:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011974:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011983:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011989:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.011995:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.011999:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012157:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012171:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.012174:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.012178:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012185:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0109 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012198:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012204:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012210:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012216:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.012219:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012224:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012230:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332200) 00010000:00010000:2.0:1786562608.012233:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.012235:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012241:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0110 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012277:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0102 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd26d expref: 16 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012293:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.012295:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562608.012299:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0102 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd26d expref: 16 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.012308:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562608.012433:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:67210:x1873345652916224:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 998us (1202us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562608.012442:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17255 00000100:00100000:2.0:1786562608.015971:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.016029:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652916480 00000100:00100000:3.0:1786562608.016038:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652916480 00000100:00100000:3.0:1786562608.016095:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17256 00000100:00100000:3.0:1786562608.016105:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67210:x1873345652916480:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562608.016130:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562608.016151:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd274 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.016393:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf6668a011e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.016408:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf6668a011e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.016419:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf6668a011e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562608.016433:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e0:0x0]: returning size 7680 00010000:00010000:3.0:1786562608.016603:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd274 expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.016625:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb200/0x5c655bf6668a011e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd274 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.016632:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.016635:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562608.016638:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb200, rc 0) 00000100:00100000:3.0:1786562608.017569:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:67210:x1873345652916480:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1460us (1603us total) trans 8589950767 rc 0/0 00000100:00100000:3.0:1786562608.017581:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17256 00000100:00100000:0.0:1786562608.020777:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.020885:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652916608 00000100:00100000:2.0:1786562608.020897:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652916608 00000100:00100000:2.0:1786562608.020989:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17257 00000100:00100000:2.0:1786562608.021000:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:67210:x1873345652916608:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562608.021261:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.021278:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.021290:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.021305:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.021522:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.021532:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022331:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022343:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022351:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562608.022389:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00000004:00200000:2.0:1786562608.022394:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562608.022405:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022418:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022611:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022620:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022626:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.022630:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022638:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022652:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.022656:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.022660:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022741:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a012c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022755:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022761:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022767:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022773:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.022776:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022782:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022790:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332d00) 00010000:00010000:2.0:1786562608.022793:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.022796:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022801:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0133 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022816:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022822:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022827:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022832:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.022835:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022841:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022858:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.022861:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.022864:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.022870:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a013a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.025207:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:67210:x1873345652916608:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 4198us (4429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562608.025223:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17257 00000100:00100000:2.0:1786562608.062222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.063661:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652916864 00000100:00100000:0.0:1786562608.063675:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652916864 00000100:00100000:0.0:1786562608.063743:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17258 00000100:00100000:0.0:1786562608.063754:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:67216:x1873345652916864:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562608.063777:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562608.063798:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0141 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd27b expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.063889:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.063905:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.063918:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.063934:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.063942:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.063948:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064367:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064376:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064505:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064511:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562608.064515:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064523:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064534:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562608.064538:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562608.064542:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064549:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0148 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064563:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064570:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064576:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064581:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562608.064585:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064590:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064598:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46ab700) 00010000:00010000:0.0:1786562608.064601:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562608.064603:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064609:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a014f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064651:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0141 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd27b expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064661:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562608.064664:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562608.064668:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0141 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd27b expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.064678:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268a00, rc 0) 00000100:00100000:0.0:1786562608.064801:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:67216:x1873345652916864:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1048us (2594us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562608.064809:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17258 00000100:00100000:1.0:1786562608.082879:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.087828:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652916992 00000100:00100000:0.0:1786562608.087854:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652916992 00000100:00100000:0.0:1786562608.087945:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17259 00000100:00100000:0.0:1786562608.087956:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:67216:x1873345652916992:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562608.088057:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088074:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088086:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088100:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088107:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088122:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088478:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088489:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088702:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562608.088739:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00000004:00200000:0.0:1786562608.088744:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562608.088756:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088770:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088776:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088783:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088789:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562608.088793:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088800:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088812:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:0.0:1786562608.088815:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562608.088820:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088830:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0156 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088843:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088861:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088867:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088873:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562608.088876:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088882:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088890:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46ab700) 00010000:00010000:0.0:1786562608.088892:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562608.088895:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088901:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a015d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088919:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088926:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088933:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088938:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562608.088941:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088946:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088953:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:0.0:1786562608.088955:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562608.088957:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.088963:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0164 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.089109:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:67216:x1873345652916992:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1151us (6235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562608.089713:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17259 00000100:00100000:2.0:1786562608.119519:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.119670:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652917120 00000100:00100000:3.0:1786562608.119681:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652917120 00000100:00100000:3.0:1786562608.119747:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17260 00000100:00100000:3.0:1786562608.119759:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:67220:x1873345652917120:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562608.119794:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562608.119815:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a016b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd282 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.119894:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.119909:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.119921:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.119936:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.119945:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.119952:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120354:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120364:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120372:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562608.120407:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00000004:00200000:3.0:1786562608.120412:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562608.120430:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120443:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120452:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120459:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120465:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120476:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.120481:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120488:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120881:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.120885:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.120891:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120897:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0172 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120912:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120918:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120923:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120928:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850caa00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.120932:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120937:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120948:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e999bb1800) 00010000:00010000:3.0:1786562608.120951:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.120953:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120960:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a0179 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.120994:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a016b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd282 expref: 19 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.121078:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd282 expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.121085:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:3.0:1786562608.121088:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562608.121090:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb000, rc 0) 00000100:00100000:2.0:1786562608.122694:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:67220:x1873345652917120:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2927us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562608.122707:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17260 00000100:00100000:2.0:1786562608.127381:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.127466:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652917248 00000100:00100000:3.0:1786562608.127477:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652917248 00000100:00100000:3.0:1786562608.127550:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17896 00000100:00100000:3.0:1786562608.127562:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652917248:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562608.127581:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562608.127601:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd289 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562608.127628:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73b:0x0] initial LVB size: 2097152, mtime: 0x6a7cc82f, atime: 0x0, ctime: 0x6a7cc82f, blocks: 0x1007 00010000:00010000:3.0:1786562608.127650:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=1040s v=(0 0) 00010000:00010000:3.0:1786562608.127655:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.127955:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.127976:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.127990:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cbe00, rc 0) 00000100:00100000:3.0:1786562608.128089:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652917248:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 529us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562608.128096:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17896 00000100:00100000:0.0:1786562608.137056:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.137658:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652917504 00000100:00100000:2.0:1786562608.137670:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652917504 00000100:00100000:2.0:1786562608.137807:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17261 00000100:00100000:2.0:1786562608.137818:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:67220:x1873345652917504:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.137841:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.137871:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a018e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd290 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.137995:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0195 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.138054:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0195 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.138067:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0195 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562608.138078:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00010000:00010000:2.0:1786562608.138214:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a018e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd290 expref: 21 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.138233:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0195 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd290 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.138241:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.138245:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562608.138249:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:2.0:1786562608.138322:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:67220:x1873345652917504:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 505us (1282us total) trans 8589950768 rc 0/0 00000100:00100000:2.0:1786562608.138331:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17261 00000100:00100000:2.0:1786562608.149219:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.149301:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652917632 00000100:00100000:1.0:1786562608.149310:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652917632 00000100:00100000:1.0:1786562608.149388:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 992 00000100:00100000:1.0:1786562608.149398:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:2350:x1873345652917632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562608.149413:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562608.149437:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0195 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd290 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.149459:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:1.0:1786562608.149463:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562608.149519:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345652917632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 122us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562608.149527:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 992 00000100:00100000:3.0:1786562608.150779:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.151093:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652917888 00000100:00100000:2.0:1786562608.151101:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652917888 00000100:00100000:2.0:1786562608.151166:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17262 00000100:00100000:2.0:1786562608.151175:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:67220:x1873345652917888:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.151196:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.151214:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd297 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.151306:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a01aa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.151320:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a01aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.151330:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a01aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562608.151342:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00010000:00010000:2.0:1786562608.151482:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd297 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.151792:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a01aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd297 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.151807:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.151810:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562608.151813:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfda00, rc 0) 00000100:00100000:2.0:1786562608.151881:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:67220:x1873345652917888:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 707us (1108us total) trans 8589950769 rc 0/0 00000100:00100000:2.0:1786562608.151889:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17262 00000100:00100000:3.0:1786562608.162560:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.162780:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918016 00000100:00100000:0.0:1786562608.162790:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918016 00000100:00100000:0.0:1786562608.162862:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17897 00000100:00100000:0.0:1786562608.162874:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652918016:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562608.162931:0:8368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.162965:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.162974:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562608.162979:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562608.162985:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.163312:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.163330:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 9 pid: 29967 timeout: 1140 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.163349:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654910848:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562608.163512:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562608.168632:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.170209:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654910848:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562608.170239:0:8368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.170761:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918144 00000100:00100000:2.0:1786562608.170768:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918144 00010000:00010000:2.0:1786562608.170808:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 10 pid: 29967 timeout: 1140 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.170864:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8760 00000100:00100000:2.0:1786562608.170874:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652918144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562608.170891:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562608.170916:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 10 pid: 29967 timeout: 1140 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.170930:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 10 pid: 29967 timeout: 1140 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.170955:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a0187 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd289 expref: 10 pid: 29967 timeout: 1140 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.170974:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562608.170980:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562608.170986:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.170998:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.171091:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562608.171158:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652918144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 284us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562608.171166:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8760 00010000:00010000:3.0:1786562608.171336:0:8368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171346:0:8368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171371:0:8368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171378:0:8368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171385:0:8368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171392:0:8368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562608.171396:0:8368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171405:0:8368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171418:0:8368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.171426:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f71bff1e/0x5c655bf6668a01b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.171475:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652918016:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 8605us (8925us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562608.171483:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17897 00000100:00100000:1.0:1786562608.174948:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.175771:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918400 00000100:00100000:3.0:1786562608.175782:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918400 00000100:00100000:3.0:1786562608.175857:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17263 00000100:00100000:3.0:1786562608.175868:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:67220:x1873345652918400:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562608.175924:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786562608.175953:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0180 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd282 expref: 21 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.175977:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a00b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd258 expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.175989:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:3.0:1786562608.175994:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562608.177769:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.177792:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.177804:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562608.178460:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4393, 88 off356416 00000004:00080000:3.0:1786562608.178472:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1040620465402ns, next at 1023431328758ns, rc = 0 00000040:00080000:3.0:1786562608.178525:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4420, 88 off358944 00000004:00080000:3.0:1786562608.178531:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1040620525632ns, next at 1033671543000ns, rc = 0 00000040:00080000:3.0:1786562608.178553:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4421, 88 off359032 00000004:00080000:3.0:1786562608.178557:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1040620551216ns, next at 1033671543000ns, rc = 0 00000001:00080000:2.0:1786562608.213206:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950766 is committed 00000001:00080000:2.0:1786562608.213228:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950769 is committed 00000001:00080000:2.0:1786562608.213235:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950770 is committed 00000004:00080000:2.0:1786562608.213240:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2924 committed 00000004:00080000:2.0:1786562608.213256:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2923 committed 00000004:00080000:2.0:1786562608.213259:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2895 committed 00000100:00100000:2.0:1786562608.213358:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654910976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562608.213428:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562608.213609:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654910976 00000100:00100000:2.0:1786562608.213616:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654910976 00000100:00100000:2.0:1786562608.213735:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17898 00000100:00100000:2.0:1786562608.213745:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654910976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562608.215132:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654911232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562608.215184:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562608.215221:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562608.215226:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654911104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562608.215247:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562608.215278:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654911232 00000100:00100000:0.0:1786562608.215284:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654911232 00000100:00100000:0.0:1786562608.215324:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654911104 00000100:00100000:0.0:1786562608.215327:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654911104 00000100:00100000:0.0:1786562608.215350:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17899 00000100:00100000:1.0:1786562608.215358:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17900 00000100:00100000:0.0:1786562608.215358:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654911232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562608.215366:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654911104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562608.215597:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3290:x1873345654911232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (411us total) trans 17179876109 rc 0/0 00000100:00100000:0.0:1786562608.215605:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17899 00000004:00080000:0.0:1786562608.215654:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bf04e00/2, rc 0, transno 17179876109 00000100:00100000:0.0:1786562608.215660:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654911232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562608.215961:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3290:x1873345654911104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 595us (712us total) trans 17179876110 rc 0/0 00000100:00100000:1.0:1786562608.215968:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17900 00000004:00080000:0.0:1786562608.216037:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a994bb80/2, rc 0, transno 17179876110 00000100:00100000:0.0:1786562608.216042:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654911104:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1786562608.216161:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c394efb reply state 0000000010e51f4d transno 8589950770 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.216173:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562608.216338:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654910976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2595us (2910us total) trans 21474843632 rc 0/0 00000100:00100000:2.0:1786562608.216346:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17898 00000100:00100000:2.0:1786562608.216380:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843629 gen 2 00000004:00080000:2.0:1786562608.216385:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9af24f100, transno 21474843629 00000100:00100000:2.0:1786562608.216403:0:3292:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e889f54000 x1873345654910976/t21474843632(21474843632) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562624 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786562608.216412:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f54000/2, rc 0, transno 21474843632 00000100:00100000:2.0:1786562608.216416:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654910976:0@lo:2:osp-syn-0-0.0 00010000:00080000:0.0:1786562608.216455:0:33113:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1786562608.216475:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67220:x1873345652918400:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 40608us (41534us total) trans 8589950770 rc 0/0 00000100:00100000:0.0:1786562608.216482:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17263 00010000:00010000:2.0:1786562608.216545:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.216554:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.216562:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.216573:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.216577:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.216583:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.216598:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.216601:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562608.216605:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.216611:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a01bf lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.220610:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.220875:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918528 00000100:00100000:2.0:1786562608.220886:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918528 00000100:00100000:2.0:1786562608.220983:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17264 00000100:00100000:2.0:1786562608.220994:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:67220:x1873345652918528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.221036:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.221067:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd29e expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.221140:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.221155:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.221177:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.221179:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562608.221183:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562608.221303:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+13:67220:x1873345652918528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 310us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562608.221312:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17264 00000100:00100000:1.0:1786562608.225891:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.226066:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918656 00000100:00100000:2.0:1786562608.226077:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918656 00000100:00100000:2.0:1786562608.226126:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17265 00000100:00100000:2.0:1786562608.226135:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67220:x1873345652918656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.226154:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.226176:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a01cd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2a5 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.226267:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a01d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.226286:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a01d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.226296:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a01d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562608.226322:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097153 00000004:00200000:2.0:1786562608.226326:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562608.226344:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a01d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.226370:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a01cd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2a5 expref: 15 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.226385:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a01d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2a5 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.226393:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.226396:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562608.226400:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfce00, rc 0) 00000100:00100000:2.0:1786562608.226655:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:67220:x1873345652918656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 511us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562608.226663:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17265 00000100:00100000:1.0:1786562608.236140:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.236320:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918784 00000100:00100000:3.0:1786562608.236330:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918784 00000100:00100000:3.0:1786562608.236425:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17901 00000100:00100000:3.0:1786562608.236436:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652918784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562608.236463:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562608.236483:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2ac expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562608.236511:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73b:0x0] initial LVB size: 2097152, mtime: 0x6a7cc82f, atime: 0x0, ctime: 0x6a7cc82f, blocks: 0x1007 00010000:00010000:3.0:1786562608.236643:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=1040s v=(0 0) 00010000:00010000:3.0:1786562608.236657:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.236668:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 9 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.236687:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 9 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.236700:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb000, rc 0) 00000100:00100000:3.0:1786562608.236758:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652918784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 324us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562608.236765:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17901 00000100:00100000:2.0:1786562608.320689:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.320778:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652918912 00000100:00100000:3.0:1786562608.320789:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652918912 00000100:00100000:3.0:1786562608.320860:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17902 00000100:00100000:3.0:1786562608.320869:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652918912:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:1.0:1786562608.358559:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843632 is committed 00000100:00100000:0.0:1786562608.365385:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652918912:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 44503us (44691us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562608.365402:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17902 00000100:00100000:1.0:1786562608.369221:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.369322:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919040 00000100:00100000:0.0:1786562608.369332:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919040 00000100:00100000:0.0:1786562608.369420:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17903 00000100:00100000:0.0:1786562608.369429:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652919040:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:0.0:1786562608.369553:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652919040:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 125us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562608.369562:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17903 00000100:00100000:1.0:1786562608.377483:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.377523:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.377662:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919296 00000100:00100000:2.0:1786562608.377671:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919296 00000100:00100000:2.0:1786562608.377736:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919168 00000100:00100000:2.0:1786562608.377739:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919168 00000100:00100000:2.0:1786562608.377767:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11638 00000100:00100000:2.0:1786562608.377778:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652919296:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562608.377811:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.377830:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562608.377834:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562608.377850:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.377865:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.378605:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11639 00000100:00100000:3.0:1786562608.378618:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652919168:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562608.378639:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.378650:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.378654:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.378658:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.378673:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407045:0:13965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407070:0:13965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407079:0:13965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407086:0:13965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562608.407090:0:13965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407099:0:13965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407130:0:13965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.407138:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e41fccf/0x5c655bf6668a01e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.407240:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652919296:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 29459us (29762us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562608.407251:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11638 00010000:00010000:3.0:1786562608.415685:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.415706:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.415715:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.415722:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850caa00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562608.415727:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.415737:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.415770:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.415778:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a01e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.415863:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652919168:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 37245us (38336us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562608.415875:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11639 00000100:00100000:3.0:1786562608.430586:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.431179:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919424 00000100:00100000:0.0:1786562608.431190:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919424 00000100:00100000:0.0:1786562608.431295:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11640 00000100:00100000:0.0:1786562608.431305:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345652919424:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:0.0:1786562608.431353:0:16203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562608.431362:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.431379:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=1040s v=(0 0) 00010000:00010000:0.0:1786562608.431383:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562608.431390:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.431404:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786562608.432755:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1786562608.489754:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876109 is committed 00000001:00080000:2.0:1786562608.489773:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876110 is committed 00000001:00080000:2.0:1786562608.533031:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876111 is committed 00002000:00010000:0.0:1786562608.533311:0:16203:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1786562608.533317:0:16203:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb mtime from disk: 0 -> 1786562607 00002000:00010000:0.0:1786562608.533320:0:16203:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb ctime from disk: 0 -> 1786562607 00002000:00010000:0.0:1786562608.533322:0:16203:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1786562608.533338:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.533353:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.533362:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.533375:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562608.533380:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.533389:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.533409:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.533417:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a01f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.533617:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345652919424:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 102308us (103035us total) trans 17179876111 rc 0/0 00000100:00100000:0.0:1786562608.533629:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11640 00000100:00100000:0.0:1786562608.542499:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.542654:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919552 00000100:00100000:3.0:1786562608.542665:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919552 00000100:00100000:3.0:1786562608.542741:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11641 00000100:00100000:3.0:1786562608.542752:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345652919552:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:3.0:1786562608.542798:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562608.542807:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.542824:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=1040s v=(0 0) 00010000:00010000:3.0:1786562608.542828:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.542834:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.542858:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562608.591932:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1786562608.591942:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb mtime from disk: 0 -> 1786562607 00002000:00010000:1.0:1786562608.591945:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb ctime from disk: 0 -> 1786562607 00002000:00010000:1.0:1786562608.591947:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1786562608.591963:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.591978:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.591986:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.591993:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850caa00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562608.591999:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.592043:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.592066:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.592074:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000940380a2/0x5c655bf6668a01f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562608.592181:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652919552:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 49426us (49688us total) trans 17179876112 rc 0/0 00000100:00100000:1.0:1786562608.592191:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11641 00000001:00080000:2.0:1786562608.595567:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876112 is committed 00000100:00100000:2.0:1786562608.611258:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.611427:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919808 00000100:00100000:0.0:1786562608.611437:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919808 00000100:00100000:0.0:1786562608.611507:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17266 00000100:00100000:0.0:1786562608.611519:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:67220:x1873345652919808:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562608.611579:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562608.611611:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a01d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2a5 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.611637:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:0.0:1786562608.611642:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562608.611921:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.611934:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.611943:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562608.611999:0:33114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950771 00000004:00010000:0.0:1786562608.612102:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029c1ae27 reply state 00000000aab0242f transno 8589950772 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.612111:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562608.612557:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:67220:x1873345652919808:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 688us (957us total) trans 8589950772 rc 0/0 00000100:00100000:0.0:1786562608.612570:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17266 00000020:00080000:0.0:1786562608.612577:0:33114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786562608.615554:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.615573:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.615582:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.615589:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.615595:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.615603:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.615629:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.615633:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.615638:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.615644:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a01fe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.618268:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.618993:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652919936 00000100:00100000:1.0:1786562608.619048:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652919936 00000100:00100000:1.0:1786562608.619117:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17904 00000100:00100000:1.0:1786562608.619127:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+7:67220:x1873345652919936:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562608.619146:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562608.619170:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2b3 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562608.619204:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71e:0x0] initial LVB size: 1048576, mtime: 0x6a7cc82f, atime: 0x0, ctime: 0x6a7cc82f, blocks: 0x803 00010000:00010000:1.0:1786562608.619243:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=1041s v=(0 0) 00010000:00010000:1.0:1786562608.619248:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562608.619258:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 8 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.619276:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 8 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.619289:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:1.0:1786562608.619353:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:67220:x1873345652919936:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 228us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562608.619361:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17904 00000100:00100000:0.0:1786562608.625822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.625925:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652920064 00000100:00100000:3.0:1786562608.625937:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652920064 00000100:00100000:3.0:1786562608.625999:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17905 00000100:00100000:3.0:1786562608.626050:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:67220:x1873345652920064:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562608.626072:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562608.626096:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2ba expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562608.626136:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71f:0x0] initial LVB size: 2097152, mtime: 0x6a7cc82f, atime: 0x0, ctime: 0x6a7cc82f, blocks: 0x807 00010000:00010000:3.0:1786562608.626159:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=1041s v=(0 0) 00010000:00010000:3.0:1786562608.626164:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.626172:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.626188:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.626200:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cac00, rc 0) 00000100:00100000:3.0:1786562608.626423:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:67220:x1873345652920064:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 376us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562608.626431:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17905 00000100:00100000:2.0:1786562608.629382:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.629487:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652920192 00000100:00100000:0.0:1786562608.629498:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652920192 00002000:00010000:0.0:1786562608.629542:0:29461:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1823 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562608.629546:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f56a00 with x1873345652920192 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562608.629558:0:29461:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f56a00. 00000100:00100000:0.0:1786562608.629590:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11642 00000100:00100000:0.0:1786562608.629599:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652920192:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562608.629905:0:29461:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562608.629910:0:29461:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb mtime from disk: 1786562607 -> 1786562607 00002000:00010000:0.0:1786562608.629913:0:29461:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562608.629915:0:29461:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb ctime from disk: 1786562607 -> 1786562607 00002000:00010000:0.0:1786562608.629917:0:29461:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562608.629993:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652920192:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 393us (619us total) trans 17179876113 rc 0/0 00000100:00100000:0.0:1786562608.630001:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11642 00002000:00010000:0.0:1786562608.630058:0:29461:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1823 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562608.630063:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e889f56a00 with x1873345652920192 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562608.630068:0:29461:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e889f56a00. 00000100:00100000:2.0:1786562608.633885:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.633988:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652920448 00000100:00100000:0.0:1786562608.633997:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652920448 00000100:00100000:0.0:1786562608.634186:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17267 00000100:00100000:0.0:1786562608.634196:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67220:x1873345652920448:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562608.634309:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.634327:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.634338:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562608.634463:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000046c6ef8 reply state 0000000097035dc1 transno 8589950773 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.634473:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562608.634573:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:67220:x1873345652920448:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 378us (697us total) trans 8589950773 rc 0/0 00000100:00100000:0.0:1786562608.634580:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17267 00010000:00010000:3.0:1786562608.636430:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.636459:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.636468:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.636474:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.636479:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.636487:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.636507:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:3.0:1786562608.636510:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.636516:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.636523:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0213 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.639460:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.639548:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652920576 00000100:00100000:1.0:1786562608.639559:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652920576 00000100:00100000:1.0:1786562608.639613:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17906 00000100:00100000:1.0:1786562608.639624:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+9:67220:x1873345652920576:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562608.639642:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562608.639662:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2c1 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.639705:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 10 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.639714:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786562608.639719:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562608.639724:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->10485759] (req 0->10485759) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.639759:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 10 pid: 29966 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.639773:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 10 pid: 29966 timeout: 1141 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562608.639787:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654911360:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562608.639895:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8820206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562608.644487:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.644575:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652920704 00000100:00100000:3.0:1786562608.644585:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652920704 00010000:00010000:3.0:1786562608.644628:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 11 pid: 29966 timeout: 1141 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.644689:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8761 00000100:00100000:3.0:1786562608.644699:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652920704:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562608.644716:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562608.644743:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 11 pid: 29966 timeout: 1141 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.644759:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 11 pid: 29966 timeout: 1141 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.644788:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.644793:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562608.644801:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.644817:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.644866:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 11 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.644881:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654911488:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562608.644970:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562608.647517:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873345654911488:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562608.647544:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562608.647604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652920704:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2905us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562608.647626:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8761 00010000:00010000:0.0:1786562608.649611:0:37002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000357c41f4/0x5c655bf6668a01db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ac expref: 10 pid: 29966 timeout: 1141 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.649636:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654911360:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562608.649670:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 9 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.649686:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0600, rc 0) 00000100:00100000:0.0:1786562608.649804:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+9:67220:x1873345652920576:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 10181us (10354us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562608.649814:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17906 00000100:00100000:2.0:1786562608.653561:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.653672:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652920832 00000100:00100000:1.0:1786562608.653683:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652920832 00000100:00100000:1.0:1786562608.653773:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17907 00000100:00100000:1.0:1786562608.653784:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652920832:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562608.654331:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562608.654336:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb mtime from disk: 1786562607 -> 1786562607 00002000:00010000:1.0:1786562608.654338:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb atime from disk: 0 -> 1786562606 00002000:00010000:1.0:1786562608.654340:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb ctime from disk: 1786562607 -> 1786562607 00002000:00010000:1.0:1786562608.654342:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562608.654447:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652920832:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 663us (895us total) trans 21474843633 rc 0/0 00000100:00100000:1.0:1786562608.654456:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17907 00000100:00100000:2.0:1786562608.657858:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562608.658740:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652921088 00000100:00100000:0.0:1786562608.658752:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652921088 00000100:00100000:0.0:1786562608.658893:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6325 00000100:00100000:0.0:1786562608.658905:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881db4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:67220:x1873345652921088:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:0.0:1786562608.658966:0:35899:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4e1:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a01aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd297 expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.659048:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.659063:0:35899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.659077:0:35899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.659119:0:35899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.659131:0:35899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 16 pid: 35929 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.659145:0:35899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654911616:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562608.659227:0:35899:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88118f540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562608.661955:0:35899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654911616:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562608.661991:0:35899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562608.664762:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.664929:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652921216 00000100:00100000:1.0:1786562608.664939:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652921216 00010000:00010000:1.0:1786562608.664988:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 17 pid: 35929 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562608.665067:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8762 00000100:00100000:1.0:1786562608.665081:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652921216:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562608.665113:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562608.665123:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 17 pid: 35929 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.665137:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 17 pid: 35929 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.665169:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a01c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd29e expref: 17 pid: 35929 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.665194:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:1.0:1786562608.665200:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.665222:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.665230:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.665270:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562608.665341:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652921216:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 263us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562608.665351:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8762 00010000:00010000:0.0:1786562608.665606:0:35899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562608.665615:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562608.666337:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4394, 88 off356504 00000004:00080000:0.0:1786562608.666347:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1041108341038ns, next at 1023431328758ns, rc = 0 00000040:00080000:0.0:1786562608.666403:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4422, 88 off359120 00000004:00080000:0.0:1786562608.666407:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1041108401238ns, next at 1033671543000ns, rc = 0 00000040:00080000:0.0:1786562608.666431:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4423, 88 off359208 00000004:00080000:0.0:1786562608.666436:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1041108430198ns, next at 1033671543000ns, rc = 0 00000001:00080000:3.0:1786562608.699048:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950774 is committed 00000004:00080000:3.0:1786562608.699060:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2926 committed 00000004:00080000:3.0:1786562608.699074:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2925 committed 00000004:00080000:3.0:1786562608.699077:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2896 committed 00000100:00100000:0.0:1786562608.699383:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654912000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562608.699454:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1786562608.699522:0:35899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018874147 reply state 00000000838ae395 transno 8589950774 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562608.699535:0:35899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562608.699545:0:35899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:0.0:1786562608.699548:0:35899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562608.699556:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a01aa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd297 expref: 12 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1786562608.699656:0:35899:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1786562608.699669:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881db4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:67220:x1873345652921088:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 40767us (41821us total) trans 8589950774 rc 0/0 00000100:00100000:0.0:1786562608.699679:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6325 00000100:00100000:1.0:1786562608.699797:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912000 00000100:00100000:1.0:1786562608.699805:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912000 00000100:00100000:1.0:1786562608.699860:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17908 00000100:00100000:1.0:1786562608.699869:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654912000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562608.700135:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562608.700139:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb mtime from disk: 1786562607 -> 1786562607 00002000:00010000:1.0:1786562608.700142:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb atime from disk: 1786562606 -> 1786562606 00002000:00010000:1.0:1786562608.700144:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb ctime from disk: 1786562607 -> 1786562607 00002000:00010000:1.0:1786562608.700146:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73b:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562608.700182:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654912000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (728us total) trans 21474843634 rc 0/0 00000100:00100000:1.0:1786562608.700189:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17908 00000100:00100000:0.0:1786562608.700639:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843632 gen 2 00000004:00080000:0.0:1786562608.700645:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f54000, transno 21474843632 00000100:00100000:0.0:1786562608.700659:0:3289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9bf8dd180 x1873345654912000/t21474843634(21474843634) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562624 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562608.700670:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bf8dd180/2, rc 0, transno 21474843634 00000100:00100000:0.0:1786562608.700676:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654912000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562608.702290:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654911872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562608.702394:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562608.702413:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654911744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562608.702446:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786562608.702467:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.702479:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.702488:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.702496:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.702501:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.702513:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.702534:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562608.702538:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562608.702543:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.702549:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0221 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562608.703794:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654911872 00000100:00100000:1.0:1786562608.703808:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654911872 00000100:00100000:1.0:1786562608.703879:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654911744 00000100:00100000:1.0:1786562608.703884:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654911744 00000100:00100000:1.0:1786562608.703915:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17909 00000100:00100000:1.0:1786562608.703926:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654911872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562608.704528:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17910 00000100:00100000:0.0:1786562608.704539:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654911744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562608.704612:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.704651:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652921344 00000100:00100000:2.0:1786562608.704656:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652921344 00000100:00100000:2.0:1786562608.704700:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17268 00000100:00100000:2.0:1786562608.704710:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:67220:x1873345652921344:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.704726:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.704747:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0228 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2c8 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.704798:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0228 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c8 expref: 12 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.704813:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0228 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c8 expref: 12 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.704859:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:2.0:1786562608.704863:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562608.704868:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfdc00, rc 0) 00000100:00100000:2.0:1786562608.704922:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:67220:x1873345652921344:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 213us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562608.704928:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17268 00002000:00010000:1.0:1786562608.705662:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562608.705669:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb mtime from disk: 1786562607 -> 1786562607 00002000:00010000:1.0:1786562608.705672:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562608.705674:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb ctime from disk: 1786562607 -> 1786562607 00002000:00010000:1.0:1786562608.705677:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71f:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562608.706029:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3292:x1873345654911872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2102us (3631us total) trans 17179876115 rc 0/0 00000100:00100000:2.0:1786562608.706336:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876110 gen 2 00000004:00080000:2.0:1786562608.706343:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88720ce00, transno 17179876107 00002000:00010000:0.0:1786562608.706439:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1786562608.706443:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb mtime from disk: 1786562607 -> 1786562607 00002000:00010000:0.0:1786562608.706445:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562608.706448:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb ctime from disk: 1786562607 -> 1786562607 00002000:00010000:0.0:1786562608.706451:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x71e:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:0.0:1786562608.706492:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3291:x1873345654911744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1955us (4044us total) trans 17179876114 rc 0/0 00000100:00100000:0.0:1786562608.706502:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17910 00000100:00100000:1.0:1786562608.706569:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17909 00000004:00080000:2.0:1786562608.707512:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88720c380, transno 17179876108 00000004:00080000:2.0:1786562608.708766:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bf04e00, transno 17179876109 00000004:00080000:2.0:1786562608.708775:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a994bb80, transno 17179876110 00000100:00100000:2.0:1786562608.708788:0:3292:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9bf8dd500 x1873345654911872/t17179876115(17179876115) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562624 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786562608.708802:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bf8dd500/2, rc 0, transno 17179876115 00000100:00100000:2.0:1786562608.708808:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654911872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562608.708895:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b11e300/2, rc 0, transno 17179876114 00000100:00100000:0.0:1786562608.708901:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654911744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562608.710378:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.710558:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652921600 00000100:00100000:3.0:1786562608.710567:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652921600 00000100:00100000:3.0:1786562608.710621:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6326 00000100:00100000:3.0:1786562608.710632:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+12:67220:x1873345652921600:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562608.711178:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:67220:x1873345652921600:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 547us (805us total) trans 8589950775 rc 0/0 00000100:00100000:3.0:1786562608.711188:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6326 00000100:00100000:3.0:1786562608.763420:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.763513:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652921856 00000100:00100000:2.0:1786562608.763526:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652921856 00000100:00100000:2.0:1786562608.763593:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17269 00000100:00100000:2.0:1786562608.763603:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67226:x1873345652921856:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.763645:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.763668:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a022f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2cf expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.763887:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.763902:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.763914:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.763931:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.763939:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.763945:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769048:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769071:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769081:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769087:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.769093:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769111:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769132:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.769135:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.769140:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769146:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0236 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769164:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769170:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769175:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769180:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.769184:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769190:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769198:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332400) 00010000:00010000:3.0:1786562608.769201:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.769436:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769445:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a023d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769506:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a022f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2cf expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769518:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.769522:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562608.769525:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a022f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2cf expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.769537:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:3.0:1786562608.769915:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67226:x1873345652921856:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6028us (6220us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562608.769926:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17269 00000100:00100000:0.0:1786562608.774040:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.774133:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652921984 00000100:00100000:1.0:1786562608.774146:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652921984 00000100:00100000:1.0:1786562608.774292:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17270 00000100:00100000:1.0:1786562608.774305:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67226:x1873345652921984:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562608.774390:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.774410:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.774424:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.774440:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.774452:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.774459:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777176:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777198:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777292:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562608.777341:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097152 00000004:00200000:1.0:1786562608.777346:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562608.777359:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777375:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777381:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777387:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777393:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562608.777397:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777406:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777419:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:1.0:1786562608.777422:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562608.777427:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777432:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0244 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777459:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777465:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777471:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777477:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562608.777480:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777485:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777492:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562608.777495:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562608.777498:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777504:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a024b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777532:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777538:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777543:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777548:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562608.777551:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777556:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777563:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:1.0:1786562608.777566:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562608.777569:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.777574:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0252 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562608.779104:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67226:x1873345652921984:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 4792us (5102us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562608.779119:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17270 00000100:00100000:0.0:1786562608.822278:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.828942:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652922240 00000100:00100000:2.0:1786562608.828961:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652922240 00000100:00100000:2.0:1786562608.829566:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17271 00000100:00100000:2.0:1786562608.829580:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67231:x1873345652922240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.829601:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.829626:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0259 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2d6 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.829705:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.829721:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.829733:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.829847:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830449:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830464:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830848:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830857:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830863:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830870:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.830875:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830883:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830896:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.830899:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.830904:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830911:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0260 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830923:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830929:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830936:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830941:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.830944:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830950:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830957:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332300) 00010000:00010000:2.0:1786562608.830959:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.830963:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.830968:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0267 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.831066:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0259 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2d6 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.831078:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.831080:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562608.831085:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0259 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2d6 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.831095:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562608.831162:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67231:x1873345652922240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1585us (8893us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562608.831188:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17271 00000100:00100000:3.0:1786562608.842659:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.843313:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652922368 00000100:00100000:2.0:1786562608.843326:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652922368 00000100:00100000:2.0:1786562608.843382:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17272 00000100:00100000:2.0:1786562608.843394:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:67231:x1873345652922368:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562608.843472:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843489:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843502:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843518:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843526:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843532:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843959:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843970:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.843978:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562608.844041:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097152 00000004:00200000:2.0:1786562608.844046:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562608.844059:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844072:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844078:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844085:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844091:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.844095:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844102:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844114:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.844118:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.844122:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844129:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a026e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844141:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844152:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844158:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844162:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.844165:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844171:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844179:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332300) 00010000:00010000:2.0:1786562608.844181:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.844185:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844191:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0275 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844205:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844211:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844217:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844222:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.844226:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844232:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844239:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:2.0:1786562608.844247:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.844250:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.844256:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a027c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.844714:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:67231:x1873345652922368:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1316us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562608.844739:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17272 00000100:00100000:0.0:1786562608.883705:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.883915:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652922624 00000100:00100000:3.0:1786562608.883925:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652922624 00000100:00100000:3.0:1786562608.883993:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17273 00000100:00100000:3.0:1786562608.884039:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67238:x1873345652922624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562608.884062:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562608.884085:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0283 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2dd expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884170:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884186:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884197:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884212:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884218:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884225:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884569:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884582:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884589:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884594:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.884599:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.884606:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885202:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.885207:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.885213:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885222:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a028a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885238:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885244:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885251:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885257:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.885260:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885266:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885274:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e999bb1500) 00010000:00010000:3.0:1786562608.885276:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.885279:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885284:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0291 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885325:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0283 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2dd expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885335:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.885338:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562608.885341:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0283 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2dd expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.885350:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cba00, rc 0) 00000100:00100000:3.0:1786562608.885416:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67238:x1873345652922624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1414us (1721us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562608.885426:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17273 00000100:00100000:0.0:1786562608.891572:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562608.894982:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652922752 00000100:00100000:1.0:1786562608.894999:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652922752 00000100:00100000:1.0:1786562608.895878:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17274 00000100:00100000:1.0:1786562608.895893:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67238:x1873345652922752:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562608.895977:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.895995:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896047:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896066:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896075:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896082:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896458:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896468:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896475:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562608.896511:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097152 00000004:00200000:1.0:1786562608.896517:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562608.896530:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896543:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896550:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896557:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896564:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562608.896568:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896575:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896587:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:1.0:1786562608.896591:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562608.896595:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896602:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0298 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896647:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896654:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896665:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896670:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562608.896673:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896680:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896688:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562608.896691:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562608.896694:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896699:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a029f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896726:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896743:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896749:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896754:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562608.896757:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896768:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896776:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:1.0:1786562608.896778:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562608.896781:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.896788:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a02a6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562608.896885:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67238:x1873345652922752:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 993us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562608.896894:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17274 00000100:00100000:1.0:1786562608.931741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562608.931936:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923008 00000100:00100000:2.0:1786562608.931947:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923008 00000100:00100000:2.0:1786562608.932051:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17275 00000100:00100000:2.0:1786562608.932061:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67245:x1873345652923008:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562608.932084:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562608.932115:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a02ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2e4 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932197:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932212:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932224:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932245:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932252:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932258:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.932610:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562608.936118:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562608.936314:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936325:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936332:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.936338:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936348:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936366:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.936370:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.936375:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936382:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936401:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936408:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936414:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936419:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562608.936422:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936428:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936436:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332300) 00010000:00010000:2.0:1786562608.936438:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562608.936441:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936447:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936503:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a02ad lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2e4 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936526:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562608.936528:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562608.936533:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a02ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2e4 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562608.936543:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:2.0:1786562608.936625:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67245:x1873345652923008:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4555us (4894us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562608.936634:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17275 00000100:00100000:2.0:1786562608.950604:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562608.950936:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923136 00000100:00100000:3.0:1786562608.950946:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923136 00000100:00100000:3.0:1786562608.951057:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17276 00000100:00100000:3.0:1786562608.951068:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:67245:x1873345652923136:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562608.951155:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.951172:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.951186:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.951201:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.951209:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.951216:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953175:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953193:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953204:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562608.953244:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097152 00000004:00200000:3.0:1786562608.953249:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562608.953262:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953276:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953284:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953292:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953298:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cba00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.953302:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953310:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953323:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:3.0:1786562608.953326:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.953331:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953337:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a02c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953348:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953354:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953360:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953366:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.953369:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953375:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953381:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e999bb1500) 00010000:00010000:3.0:1786562608.953384:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.953387:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953392:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a02c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953406:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953412:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953418:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953422:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562608.953425:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953430:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953436:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:3.0:1786562608.953439:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562608.953442:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562608.953447:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a02d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562608.953543:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:67245:x1873345652923136:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2473us (2947us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562608.953555:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17276 00000100:00100000:0.0:1786562609.004915:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562609.005059:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923392 00000100:00100000:2.0:1786562609.005071:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923392 00000100:00100000:2.0:1786562609.005145:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17277 00000100:00100000:2.0:1786562609.005156:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+13:67249:x1873345652923392:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562609.005177:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562609.005199:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a02d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2eb expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005280:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005296:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005308:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005323:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005330:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005340:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005721:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005730:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005738:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005743:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562609.005750:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005756:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005767:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562609.005770:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562609.005774:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005780:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a02de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005791:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005797:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005803:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005808:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562609.005810:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005816:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005822:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332300) 00010000:00010000:2.0:1786562609.005825:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562609.005840:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005846:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a02e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005880:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a02d7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2eb expref: 14 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005890:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562609.005892:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562609.005895:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a02d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2eb expref: 14 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.005903:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:2.0:1786562609.006164:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+13:67249:x1873345652923392:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1009us (1259us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562609.006176:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17277 00000100:00080000:3.0:1786562609.006244:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562609.013431:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562609.013517:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923520 00000100:00100000:2.0:1786562609.013528:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923520 00000100:00100000:2.0:1786562609.013590:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17278 00000100:00100000:2.0:1786562609.013601:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67249:x1873345652923520:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562609.013691:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.013708:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.013720:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.013735:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.013742:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.013748:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014155:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014166:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014173:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562609.014207:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097152 00000004:00200000:2.0:1786562609.014212:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562609.014224:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014237:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014243:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014251:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014256:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562609.014261:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014267:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014278:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562609.014282:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562609.014286:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014293:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a02ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014305:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014316:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014322:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014326:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562609.014329:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014335:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014341:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332d00) 00010000:00010000:2.0:1786562609.014344:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562609.014346:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014352:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a02f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014365:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014371:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014376:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014381:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562609.014384:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014389:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014395:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:2.0:1786562609.014397:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562609.014399:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562609.014405:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a02fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562609.014490:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67249:x1873345652923520:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 890us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562609.014499:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17278 00000100:00100000:1.0:1786562609.470376:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562609.470489:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562609.470528:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562609.470563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562609.471257:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923648 00000100:00100000:0.0:1786562609.471280:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923648 00000100:00100000:0.0:1786562609.471394:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 282 00000100:00100000:0.0:1786562609.471407:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652923648:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562609.471446:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924032 00000100:00100000:3.0:1786562609.471452:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924032 00000100:00100000:3.0:1786562609.471487:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923904 00000100:00100000:3.0:1786562609.471490:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923904 00000100:00100000:3.0:1786562609.471519:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 481 00000100:00100000:3.0:1786562609.471528:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652924032:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562609.471708:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 482 00000100:00100000:1.0:1786562609.471733:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652923904:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562609.471906:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652923648:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 501us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562609.471914:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 282 00000100:00100000:2.0:1786562609.474761:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652923776 00000100:00100000:2.0:1786562609.474776:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652923776 00000100:00100000:2.0:1786562609.474936:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 327 00000100:00100000:2.0:1786562609.474949:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:2348:x1873345652923776:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562609.476904:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652923904:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 5176us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562609.476920:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 482 00000100:00080000:1.0:1786562609.476998:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562609.478782:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:2348:x1873345652923776:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 3827us (8407us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562609.478795:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 327 00000100:00100000:3.0:1786562609.480265:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652924032:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 8731us (9768us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562609.480280:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 481 00010000:00010000:1.0:1786562609.962182:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562610.469141:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562610.469162:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654912128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562610.469229:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562610.469404:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912128 00000100:00100000:3.0:1786562610.469413:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912128 00000100:00100000:3.0:1786562610.469464:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786562610.469472:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654912128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562610.469508:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 521207808 pending 0 free 3835691008 avail 3833593856 00000100:00100000:3.0:1786562610.469558:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654912128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562610.469566:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786562610.469612:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654912128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786562610.469622:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562610.469885:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562610.469895:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654912256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562610.469926:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562610.470153:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654912768:0@lo:400:kworker.0 00000100:00100000:3.0:1786562610.470189:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562610.470225:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562610.470232:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654912384:0@lo:400:kworker.0 00000100:00100000:3.0:1786562610.470261:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562610.470276:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912256 00000100:00100000:0.0:1786562610.470282:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912256 00000100:00100000:3.0:1786562610.470306:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912768 00000100:00100000:3.0:1786562610.470312:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912768 00000100:00100000:0.0:1786562610.470323:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1786562610.470334:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654912256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562610.470358:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42795008 pending 0 free 3844079616 avail 3841982464 00000100:00100000:3.0:1786562610.470359:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1786562610.470372:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654912768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562610.470402:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654912256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562610.470411:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786562610.470423:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654912768:12345-0@lo:400:kworker.0 Request processed in 53us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562610.470431:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1786562610.470480:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654912768:0@lo:400:kworker.0 00000100:00100000:1.0:1786562610.470480:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654912256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562610.470509:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654912512:0@lo:400:kworker.0 00000100:00100000:1.0:1786562610.470515:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654912640:0@lo:400:kworker.0 00000100:00100000:3.0:1786562610.470538:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562610.470559:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912384 00000100:00100000:1.0:1786562610.470564:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912384 00000100:00100000:0.0:1786562610.470581:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912512 00000100:00100000:0.0:1786562610.470587:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912512 00000100:00100000:3.0:1786562610.470592:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562610.470602:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1786562610.470613:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654912384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562610.470621:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912640 00000100:00100000:0.0:1786562610.470625:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912640 00000100:00100000:3.0:1786562610.470634:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1786562610.470644:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654912512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562610.470658:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1786562610.470661:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654912384:12345-0@lo:400:kworker.0 Request processed in 50us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562610.470669:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562610.470671:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:1.0:1786562610.470704:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562610.470709:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562610.470719:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654912640:12345-0@lo:400:kworker.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562610.470726:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1786562610.470769:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654912640:0@lo:400:kworker.0 00000100:00100000:2.0:1786562610.471052:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654912384:0@lo:400:kworker.0 00000100:00100000:0.0:1786562610.471433:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654912512:12345-0@lo:400:kworker.0 Request processed in 791us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562610.471441:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1786562610.471561:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654912512:0@lo:400:kworker.0 00010000:00010000:1.0:1786562610.981349:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562612.009637:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562613.033093:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562613.625945:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843634 is committed 00000001:00080000:2.0:1786562613.625968:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843633 is committed 00000100:00100000:1.0:1786562613.660538:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562613.660621:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924160 00000100:00100000:2.0:1786562613.660633:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924160 00000100:00100000:2.0:1786562613.660721:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17279 00000100:00100000:2.0:1786562613.660745:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67667:x1873345652924160:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1786562613.660774:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562613.660807:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0301 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2f2 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.660901:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.660920:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.660938:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.660970:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.660980:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.660988:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661582:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661599:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661607:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562613.661655:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e1:0x0]: returning size 2097152 00000004:00200000:2.0:1786562613.661661:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562613.661685:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661700:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661710:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661717:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661725:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661732:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562613.661750:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661759:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661774:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562613.661779:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562613.661783:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661790:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0308 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661802:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661807:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661813:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661819:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562613.661823:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661830:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661837:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b6332d00) 00010000:00010000:2.0:1786562613.661840:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562613.661843:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661848:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a030f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661887:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0301 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2f2 expref: 15 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661905:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2f2 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.661914:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:2.0:1786562613.661916:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562613.661918:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00080000:1.0:1786562613.662090:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562613.662524:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:67667:x1873345652924160:12345-192.168.204.29@tcp:101:rm.0 Request processed in 1788us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562613.662534:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17279 00000100:00100000:3.0:1786562613.666411:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562613.666535:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924416 00000100:00100000:0.0:1786562613.666547:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924416 00000100:00100000:0.0:1786562613.666618:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17280 00000100:00100000:0.0:1786562613.666631:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:67667:x1873345652924416:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1786562613.667217:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786562613.667256:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0316 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2f2 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667277:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0228 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c8 expref: 13 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667296:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:0.0:1786562613.667310:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562613.667335:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667350:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667362:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667378:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667386:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.667393:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.668450:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.668469:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.668481:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786562613.672098:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4395, 64 off356568 00000004:00080000:2.0:1786562613.672117:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046114110178ns, next at 1047114106065ns, rc = 0 00000040:00080000:2.0:1786562613.672165:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4424, 64 off359272 00000004:00080000:2.0:1786562613.672173:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046114166929ns, next at 1047114165375ns, rc = 0 00000040:00080000:2.0:1786562613.672201:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4425, 64 off359336 00010000:00010000:2.0:1786562613.672323:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672345:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672365:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672375:0:33140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672382:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672390:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672429:0:33140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562613.672458:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672464:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672470:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672477:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562613.672483:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672492:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672507:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332300) 00010000:00010000:2.0:1786562613.672511:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786562613.672519:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672526:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a032b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672550:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672558:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672564:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672568:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562613.672571:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672577:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672587:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0x0 (ffff90e9b46ab200) 00010000:00010000:2.0:1786562613.672589:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562613.672593:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562613.672599:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a031d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562613.672611:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002559134d reply state 000000001fe04c18 transno 8589950776 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562613.672627:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562613.672763:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:67667:x1873345652924416:12345-192.168.204.29@tcp:36:rm.0 Request processed in 6130us (6359us total) trans 8589950776 rc 0/0 00000100:00100000:2.0:1786562613.672775:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17280 00010000:00010000:0.0:1786562613.673568:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562613.673578:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.673588:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562613.673592:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.673602:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.673627:0:7599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e1:0x0].0x0 (ffff90e9b6332300) 00010000:00010000:0.0:1786562613.673630:0:7599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786562613.673633:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.673640:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0332 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562613.673660:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562613.673662:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562613.673663:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562613.676816:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562613.676839:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562613.676853:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562613.676861:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562613.676867:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562613.676877:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562613.676899:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e0:0x0].0xaa02ef2c (ffff90e9b46ab000) 00010000:00010000:3.0:1786562613.676903:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562613.676908:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562613.676915:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0324 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e0:0x0].0xaa02ef2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.060113:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562614.126062:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876114 is committed 00000001:00080000:2.0:1786562614.126081:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876113 is committed 00000001:00080000:2.0:1786562614.126088:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876115 is committed 00000001:00080000:3.0:1786562614.128660:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950776 is committed 00000004:00080000:3.0:1786562614.128675:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2927 committed 00000004:00080000:3.0:1786562614.128692:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2897 committed 00000100:00100000:0.0:1786562614.129134:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786562614.129163:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654913024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786562614.129260:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562614.129348:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654913024 00000100:00100000:0.0:1786562614.129359:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654913024 00000100:00100000:0.0:1786562614.129425:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17911 00000100:00100000:0.0:1786562614.129436:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654913024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786562614.129472:0:29964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1851 count 1 00010000:00010000:0.0:1786562614.129506:0:29964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.129536:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 8 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.129547:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x73b:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1786562614.129552:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562614.129559:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.129592:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 8 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.129608:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 8 pid: 37002 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562614.129623:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654913152:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562614.129699:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3780 going to sleep for 11 seconds 00000100:00080000:1.0:1786562614.131468:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562614.131817:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654912896:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786562614.131911:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562614.132881:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654912896 00000100:00100000:0.0:1786562614.132894:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654912896 00000100:00100000:0.0:1786562614.132985:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17912 00000100:00100000:0.0:1786562614.133028:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654912896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786562614.133068:0:28862:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1822 count 1 00010000:00010000:0.0:1786562614.133101:0:28862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.133127:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 8 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.133138:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x71e:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1786562614.133143:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562614.133148:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.133201:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 8 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.133216:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 8 pid: 6658 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562614.133232:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654913280:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562614.133326:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562614.133715:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:1.0:1786562614.133753:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562614.136194:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654913152:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562614.136239:0:29964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562614.136279:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28862:1873345654913280:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562614.136294:0:28862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562614.138148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562614.138620:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924544 00000100:00100000:0.0:1786562614.138634:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924544 00010000:00010000:0.0:1786562614.138705:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 9 pid: 37002 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562614.138758:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924672 00000100:00100000:0.0:1786562614.138762:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924672 00010000:00010000:0.0:1786562614.138781:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 9 pid: 6658 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562614.138811:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8763 00000100:00100000:0.0:1786562614.138821:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652924544:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562614.138842:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562614.138848:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 9 pid: 37002 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.138864:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 9 pid: 37002 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.138893:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a021a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2c1 expref: 9 pid: 37002 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.138946:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562614.138952:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562614.138960:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.138973:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139048:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562614.139113:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652924544:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 292us (5398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562614.139123:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8763 00000100:00100000:0.0:1786562614.139144:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8764 00000100:00100000:0.0:1786562614.139152:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652924672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562614.139165:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562614.139170:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 9 pid: 6658 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139181:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 9 pid: 6658 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139197:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0205 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2b3 expref: 9 pid: 6658 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139227:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562614.139230:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562614.139235:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139242:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139262:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562614.139282:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652924672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 131us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562614.139289:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8764 00010000:00010000:0.0:1786562614.139314:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139330:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139342:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139351:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.139368:0:29964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562614.140240:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654913024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10800us (10975us total) trans 21474843635 rc 0/0 00000100:00100000:0.0:1786562614.140252:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17911 00000100:00100000:0.0:1786562614.140319:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843634 gen 2 00000004:00080000:0.0:1786562614.140327:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8dd180, transno 21474843634 00000100:00100000:0.0:1786562614.140344:0:3290:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e88c52ed80 x1873345654913024/t21474843635(21474843635) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786562630 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562614.140358:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c52ed80/2, rc 0, transno 21474843635 00000100:00100000:0.0:1786562614.140365:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654913024:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786562614.140658:0:28862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.140673:0:28862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.140688:0:28862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.140696:0:28862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.140714:0:28862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786562614.141253:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654912896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8250us (9339us total) trans 17179876116 rc 0/0 00000100:00100000:0.0:1786562614.141262:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17912 00010000:00010000:0.0:1786562614.141289:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786562614.141298:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141308:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562614.141314:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141331:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141354:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141362:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb46e21/0x5c655bf6668a0339 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141385:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562614.141389:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141395:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562614.141398:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141406:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562614.141418:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562614.141490:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786562614.141502:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562614.141508:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562614.142902:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876115 gen 2 00000004:00080000:2.0:1786562614.142916:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b11e300, transno 17179876114 00000004:00080000:2.0:1786562614.142927:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8dd500, transno 17179876115 00000100:00100000:2.0:1786562614.142952:0:3292:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9bf8dea00 x1873345654912896/t17179876116(17179876116) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786562630 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786562614.142967:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bf8dea00/2, rc 0, transno 17179876116 00000100:00100000:2.0:1786562614.142974:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654912896:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786562614.144194:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562614.144462:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562614.144466:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562614.144469:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562614.590330:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562614.590525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562614.590599:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924800 00000100:00100000:1.0:1786562614.590612:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924800 00000100:00100000:1.0:1786562614.590687:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 284 00000100:00100000:1.0:1786562614.590701:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652924800:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562614.590805:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652924800:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562614.590816:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 284 00000100:00100000:2.0:1786562614.591682:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652924928 00000100:00100000:2.0:1786562614.591694:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652924928 00000100:00100000:2.0:1786562614.591772:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 331 00000100:00100000:2.0:1786562614.591783:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652924928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562614.592650:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652924928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 863us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562614.592663:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 331 00010000:00010000:0.0:1786562615.083299:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786562615.496559:0:38364:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 204b: FLR write/stale/resync tests with self-extending primary ========================================================== 15:23:33 (1786562613) 00000100:00100000:1.0:1786562615.590782:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562615.590862:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562615.590940:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654913408 00000100:00100000:1.0:1786562615.590949:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654913408 00000100:00100000:1.0:1786562615.591038:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1786562615.591048:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654913408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562615.591087:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 521207808 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562615.591130:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562615.591139:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1786562615.591205:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654913408:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1786562615.592653:0:33139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1048034645020ns, next at 1049034642335ns, rc = 0 00000100:00100000:2.0:1786562615.592680:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654913664:0@lo:400:kworker.0 00000100:00100000:2.0:1786562615.592746:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562615.592783:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654914176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562615.592807:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562615.592829:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786562615.592834:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654913536:0@lo:400:kworker.0 00000100:00100000:2.0:1786562615.592857:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562615.592874:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654914048:0@lo:400:kworker.0 00000100:00100000:2.0:1786562615.592890:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562615.592927:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654914176 00000100:00100000:2.0:1786562615.592932:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654914176 00000100:00100000:2.0:1786562615.592981:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1786562615.592989:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654914176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562615.593038:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42795008 pending 0 free 3844079616 avail 3841982464 00000100:00100000:2.0:1786562615.593079:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654914176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562615.593086:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1786562615.593128:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654914176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562615.593850:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654913664 00000100:00100000:3.0:1786562615.593857:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654913664 00000100:00100000:3.0:1786562615.593896:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654914048 00000100:00100000:3.0:1786562615.593899:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654914048 00000100:00100000:3.0:1786562615.593919:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1786562615.593926:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654913664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562615.593988:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654913664:12345-0@lo:400:kworker.0 Request processed in 62us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562615.593994:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1786562615.594028:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1786562615.594035:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654914048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562615.594064:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654914048:12345-0@lo:400:kworker.0 Request processed in 30us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562615.594069:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1786562615.594727:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654913536 00000100:00100000:1.0:1786562615.594733:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654913536 00000100:00100000:1.0:1786562615.594767:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1786562615.594774:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654913536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562615.594817:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654913536:12345-0@lo:400:kworker.0 Request processed in 44us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562615.594824:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1786562615.594861:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654913792:0@lo:400:kworker.0 00000100:00100000:1.0:1786562615.594890:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562615.594916:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562615.594923:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654913920:0@lo:400:kworker.0 00000100:00100000:1.0:1786562615.594948:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562615.594974:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654913792 00000100:00100000:1.0:1786562615.594977:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654913792 00000100:00100000:1.0:1786562615.595018:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1786562615.595025:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654913792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562615.595060:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654913792:12345-0@lo:400:kworker.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562615.595066:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1786562615.595085:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654913920 00000100:00100000:1.0:1786562615.595088:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654913920 00000100:00100000:1.0:1786562615.595112:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1786562615.595118:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654913920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562615.595149:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654913920:12345-0@lo:400:kworker.0 Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562615.595155:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1786562615.595193:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654913920:0@lo:400:kworker.0 00000100:00100000:1.0:1786562615.595203:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654913792:0@lo:400:kworker.0 00000100:00100000:3.0:1786562615.596962:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654913536:0@lo:400:kworker.0 00000100:00100000:3.0:1786562615.596982:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654914048:0@lo:400:kworker.0 00000100:00100000:3.0:1786562615.596996:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654913664:0@lo:400:kworker.0 00000100:00080000:2.0:1786562615.598773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562615.648627:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.648716:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925184 00000100:00100000:0.0:1786562615.648726:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925184 00000100:00100000:0.0:1786562615.648805:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17281 00000100:00100000:0.0:1786562615.648816:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:67825:x1873345652925184:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:0.0:1786562615.648874:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562615.648906:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf66689ffe3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd219 expref: 11 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.648932:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332000) 00010000:00010000:0.0:1786562615.648943:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562615.649283:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.649309:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.649319:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.649332:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.649339:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.649346:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562615.649518:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1786562615.660898:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e3:0x0]: returning size 512 00010000:00010000:1.0:1786562615.660924:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.660943:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.660951:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.660957:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562615.660962:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.660970:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.660988:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abf00) 00010000:00010000:1.0:1786562615.660991:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562615.660996:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.662203:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0347 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562615.662233:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033a13246 reply state 000000003aa33ff4 transno 8589950777 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562615.662242:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562615.670079:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+12:67825:x1873345652925184:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 21247us (21443us total) trans 8589950777 rc 0/0 00000100:00100000:0.0:1786562615.670094:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17281 00010000:00010000:2.0:1786562615.676156:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.676180:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.676187:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.676197:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562615.676202:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.676208:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.676224:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebf837e7 (ffff90e9b46ab700) 00010000:00010000:2.0:1786562615.676228:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562615.676232:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.676238:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a034e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562615.712561:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562615.712626:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925312 00000100:00100000:3.0:1786562615.712643:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925312 00000100:00100000:3.0:1786562615.712751:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17282 00000100:00100000:3.0:1786562615.712766:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:67828:x1873345652925312:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562615.712801:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562615.712834:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd2f9 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.712951:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a035c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.712974:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a035c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.712989:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a035c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562615.713116:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1786562615.713121:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 40 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562615.713157:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a035c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.713408:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2f9 expref: 13 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.713503:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a035c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2f9 expref: 12 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.713515:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562615.713518:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562615.713522:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850caa00, rc 0) 00000100:00100000:3.0:1786562615.713608:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+12:67828:x1873345652925312:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 846us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562615.713616:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17282 00000100:00100000:0.0:1786562615.729311:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.729602:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925440 00000100:00100000:0.0:1786562615.729611:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925440 00000100:00100000:0.0:1786562615.729666:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17283 00000100:00100000:0.0:1786562615.729676:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:67828:x1873345652925440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562615.729710:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562615.729732:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd300 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729800:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729813:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729824:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729838:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729845:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729851:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729983:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0378 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.729993:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0378 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730001:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0378 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562615.730096:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e3:0x0]: returning size 512 00000004:00200000:0.0:1786562615.730100:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562615.730130:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0378 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730141:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730147:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730153:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730159:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.730164:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730171:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730184:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:0.0:1786562615.730187:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.730192:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730198:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a036a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730211:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730217:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730227:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730233:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.730236:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730242:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730251:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebf837e7 (ffff90e9b46abc00) 00010000:00010000:0.0:1786562615.730254:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.730257:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730263:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xebf837e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730296:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd300 expref: 14 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730319:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269e00/0x5c655bf6668a0378 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd300 expref: 13 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.730333:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.730337:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786562615.730339:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269e00, rc 0) 00000100:00100000:0.0:1786562615.730401:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+13:67828:x1873345652925440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 726us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562615.730413:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17283 00000100:00100000:3.0:1786562615.736618:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.736704:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925568 00000100:00100000:0.0:1786562615.736714:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925568 00000100:00100000:0.0:1786562615.737242:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17284 00000100:00100000:0.0:1786562615.737254:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67828:x1873345652925568:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562615.737275:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562615.737308:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a037f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd307 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740483:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740506:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740517:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740578:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740587:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740594:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740666:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740676:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740684:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740690:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.740708:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740716:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740728:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.740730:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.740734:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740739:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0386 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740750:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740757:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740762:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740766:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.740770:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740775:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740781:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46ab400) 00010000:00010000:0.0:1786562615.740783:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.740786:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740791:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a038d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740843:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a037f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd307 expref: 14 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740854:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.740857:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.740861:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a037f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd307 expref: 14 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.740872:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562615.740962:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+13:67828:x1873345652925568:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3709us (4354us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562615.740971:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17284 00000100:00100000:3.0:1786562615.747764:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562615.747807:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925696 00000100:00100000:3.0:1786562615.747817:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925696 00000100:00100000:3.0:1786562615.747873:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17285 00000100:00100000:3.0:1786562615.747885:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:67828:x1873345652925696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562615.747907:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562615.747929:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0394 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd30e expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748002:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748042:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748053:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748070:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748077:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748084:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748143:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748150:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748156:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748162:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562615.748166:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748174:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748187:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562615.748191:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562615.748196:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748202:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a039b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748214:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748221:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748227:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748232:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562615.748234:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748241:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748248:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1500) 00010000:00010000:3.0:1786562615.748250:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562615.748253:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748259:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a03a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748292:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0394 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd30e expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748303:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562615.748306:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562615.748309:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0394 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd30e expref: 14 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.748318:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb000, rc 0) 00000100:00100000:3.0:1786562615.754254:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:67828:x1873345652925696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6357us (6484us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562615.754268:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17285 00000100:00100000:3.0:1786562615.757647:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.759271:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925824 00000100:00100000:0.0:1786562615.759283:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925824 00000100:00100000:0.0:1786562615.759664:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17286 00000100:00100000:0.0:1786562615.759673:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67828:x1873345652925824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562615.759703:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562615.759721:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd315 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.759787:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a03b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.759801:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a03b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.759813:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a03b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562615.759873:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e3:0x0]: returning size 512 00000004:00200000:0.0:1786562615.759877:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562615.759900:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a03b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.759927:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd315 expref: 15 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.759943:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a03b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd315 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.759951:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.759954:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562615.759957:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269000, rc 0) 00000100:00100000:0.0:1786562615.760049:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:67828:x1873345652925824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 375us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562615.760057:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17286 00000100:00100000:3.0:1786562615.771836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.772156:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652925952 00000100:00100000:0.0:1786562615.772167:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652925952 00000100:00100000:0.0:1786562615.772451:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17287 00000100:00100000:0.0:1786562615.772463:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67828:x1873345652925952:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562615.772485:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562615.772507:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd31c expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772578:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772593:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772603:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772619:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772626:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772633:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772707:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772715:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772726:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772732:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.772737:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772745:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772756:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.772760:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.772764:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772769:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772781:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772787:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772793:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772799:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.772802:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772811:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772818:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46ab400) 00010000:00010000:0.0:1786562615.772821:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.772823:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772830:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772862:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03b7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd31c expref: 15 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772872:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.772875:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.772879:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd31c expref: 15 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.772899:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562615.773040:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67828:x1873345652925952:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 578us (1211us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562615.773049:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17287 00000100:00100000:3.0:1786562615.778618:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.778715:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652926208 00000100:00100000:0.0:1786562615.778726:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652926208 00000100:00100000:0.0:1786562615.778790:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17288 00000100:00100000:0.0:1786562615.778800:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+14:67828:x1873345652926208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562615.778825:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562615.778829:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786562615.778858:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a03b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd315 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.778876:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.778882:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562615.778907:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03cc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd323 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779079:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779092:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779103:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779118:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779125:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779132:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779717:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779732:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779740:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562615.779750:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 0 00010000:00010000:0.0:1786562615.779776:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779784:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779791:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779797:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.779802:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779809:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779818:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.779821:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.779825:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779830:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a03d3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562615.779845:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c87eb13a reply state 000000005c44e969 transno 8589950778 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562615.779854:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562615.779879:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a03cc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 16 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779891:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 15 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.779899:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46abc00) 00010000:00010000:0.0:1786562615.779901:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562615.779903:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562615.779975:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:67828:x1873345652926208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1177us (1366us total) trans 8589950778 rc 0/0 00000100:00100000:0.0:1786562615.779984:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17288 00010000:00010000:3.0:1786562615.786499:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.786518:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.786527:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.786533:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562615.786539:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.786547:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.786565:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46ab400) 00010000:00010000:3.0:1786562615.786578:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562615.786583:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.786589:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a03da lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562615.786858:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562615.786926:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652926464 00000100:00100000:2.0:1786562615.786936:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652926464 00000100:00100000:2.0:1786562615.787027:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17289 00000100:00100000:2.0:1786562615.787038:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67828:x1873345652926464:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562615.787188:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562615.787207:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a03ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd32a expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.787304:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.787318:0:36756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 16 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.787334:0:36756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.787368:0:36756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 16 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.787381:0:36756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 16 pid: 33115 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562615.787395:0:36756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654914304:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562615.787483:0:36756:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988b130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562615.795321:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345654914304:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562615.795355:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562615.799274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562615.801820:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652926592 00000100:00100000:1.0:1786562615.801834:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652926592 00010000:00010000:1.0:1786562615.801885:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 17 pid: 33115 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562615.801939:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8765 00000100:00100000:1.0:1786562615.801949:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652926592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562615.801975:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562615.801984:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 17 pid: 33115 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.801998:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 17 pid: 33115 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.802041:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a03e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd323 expref: 17 pid: 33115 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.802059:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46abc00) 00010000:00010000:1.0:1786562615.802065:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.802074:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.802083:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.802117:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562615.802181:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:2348:x1873345652926592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 233us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562615.802189:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8765 00010000:00010000:2.0:1786562615.804644:0:36756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.804661:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562615.804687:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 0 00000004:00080000:2.0:1786562615.805089:0:36756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73c:0x0], index 0: 0 00000004:00080000:2.0:1786562615.805102:0:36756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x720:0x0], index 1: 0 00010000:00010000:3.0:1786562615.805363:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805375:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805384:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805391:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562615.805395:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805402:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805422:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46abc00) 00010000:00010000:3.0:1786562615.805425:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562615.805430:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805435:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a03f6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805507:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a03ef lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd32a expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805519:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562615.805522:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562615.805527:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a03ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd32a expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.805537:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:3.0:1786562615.805625:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67828:x1873345652926464:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 18589us (18770us total) trans 8589950779 rc 301/301 00000100:00100000:3.0:1786562615.805634:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17289 00000100:00100000:3.0:1786562615.808456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.810372:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652926848 00000100:00100000:0.0:1786562615.810389:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652926848 00000100:00100000:0.0:1786562615.810462:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6327 00000100:00100000:0.0:1786562615.810473:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67828:x1873345652926848:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562615.810864:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:67828:x1873345652926848:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 391us (2415us total) trans 8589950780 rc 0/0 00000100:00100000:0.0:1786562615.810872:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6327 00000100:00100000:1.0:1786562615.816407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562615.819212:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652927104 00000100:00100000:3.0:1786562615.819228:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652927104 00000100:00100000:3.0:1786562615.819372:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6328 00000100:00100000:3.0:1786562615.819384:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:67828:x1873345652927104:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562615.819640:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:67828:x1873345652927104:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 257us (3243us total) trans 8589950781 rc 0/0 00000100:00100000:3.0:1786562615.819652:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6328 00000100:00100000:1.0:1786562615.837534:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.837618:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652927360 00000100:00100000:0.0:1786562615.837628:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652927360 00000100:00100000:0.0:1786562615.837684:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17290 00000100:00100000:0.0:1786562615.837706:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:67829:x1873345652927360:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562615.837731:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562615.837753:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0404 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd331 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.837937:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.837962:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.837975:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.837992:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.837999:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838061:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838138:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0419 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838154:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0419 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838162:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0419 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562615.838176:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 0 00010000:00010000:0.0:1786562615.838267:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838276:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838282:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838289:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.838292:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838298:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838310:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562615.838313:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.838317:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838323:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a040b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838335:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838341:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838351:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838356:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562615.838359:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838366:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838374:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46ab900) 00010000:00010000:0.0:1786562615.838376:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562615.838379:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838384:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0412 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838428:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0404 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd331 expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838442:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0419 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd331 expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.838449:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562615.838451:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562615.838453:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269200, rc 0) 00000100:00100000:0.0:1786562615.838514:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:67829:x1873345652927360:12345-192.168.204.29@tcp:101:dd.0 Request processed in 821us (990us total) trans 8589950782 rc 0/0 00000100:00100000:0.0:1786562615.838526:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17290 00000100:00100000:0.0:1786562615.848627:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562615.848715:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652927616 00000100:00100000:1.0:1786562615.848725:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652927616 00000100:00100000:1.0:1786562615.848786:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17291 00000100:00100000:1.0:1786562615.848797:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:67829:x1873345652927616:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:1.0:1786562615.848823:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562615.848826:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562615.848852:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0419 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd331 expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.848872:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562615.848883:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562615.848897:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0427 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd338 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.848959:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a042e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.848972:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a042e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.848982:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a042e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786562615.849553:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73d:0x0], index 0: 0 00000040:00080000:1.0:1786562615.849655:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4396, 88 off356656 00000004:00080000:1.0:1786562615.849665:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1048291659348ns, next at 1047114106065ns, rc = 0 00000040:00080000:1.0:1786562615.849715:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4397, 88 off356744 00000004:00080000:1.0:1786562615.849721:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1048291714839ns, next at 1047114106065ns, rc = 0 00000040:00080000:1.0:1786562615.849760:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4426, 88 off359424 00000004:00080000:1.0:1786562615.849767:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1048291760755ns, next at 1049034642335ns, rc = 0 00000001:00080000:0.0:1786562615.912043:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950782 is committed 00000001:00080000:0.0:1786562615.912067:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950783 is committed 00000004:00080000:0.0:1786562615.912072:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2929 committed 00000004:00080000:0.0:1786562615.912174:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2899 committed 00000004:00080000:0.0:1786562615.912190:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2898 committed 00000004:00080000:0.0:1786562615.912207:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2928 committed 00000100:00100000:3.0:1786562615.912325:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654914560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562615.912396:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562615.912436:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562615.912443:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654914432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562615.912466:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562615.912500:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654914560 00000100:00100000:3.0:1786562615.912508:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654914560 00000100:00100000:3.0:1786562615.912549:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654914432 00000100:00100000:3.0:1786562615.912553:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654914432 00000100:00100000:3.0:1786562615.912574:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17913 00000100:00100000:3.0:1786562615.912583:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654914560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562615.912851:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654914560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (453us total) trans 21474843636 rc 0/0 00000100:00100000:3.0:1786562615.912860:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17913 00000100:00100000:3.0:1786562615.912877:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17914 00000100:00100000:3.0:1786562615.912884:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654914432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562615.913046:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3290:x1873345654914432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (578us total) trans 21474843637 rc 0/0 00000100:00100000:3.0:1786562615.913053:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17914 00000004:00080000:3.0:1786562615.913095:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1d880/2, rc 0, transno 21474843637 00000100:00100000:3.0:1786562615.913102:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654914432:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562615.913113:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1c700/2, rc 0, transno 21474843636 00000100:00100000:3.0:1786562615.913121:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654914560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562615.913518:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654914688:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786562615.913552:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562615.913586:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562615.913592:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654914816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562615.913614:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562615.913641:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654914688 00000100:00100000:1.0:1786562615.913646:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654914688 00000100:00100000:1.0:1786562615.913671:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654914816 00000100:00100000:1.0:1786562615.913674:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654914816 00000100:00100000:1.0:1786562615.913709:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17915 00000100:00100000:1.0:1786562615.913717:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654914688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786562615.913736:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1823 count 1 00010000:00010000:1.0:1786562615.913758:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.913780:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.913790:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x71f:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1786562615.913795:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562615.913800:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.913828:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562615.913847:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 7 pid: 6660 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562615.913858:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654914944:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562615.913935:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562615.913951:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17916 00000100:00100000:1.0:1786562615.913969:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654914816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562615.914175:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3291:x1873345654914816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (558us total) trans 17179876117 rc 0/0 00000100:00100000:1.0:1786562615.914181:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17916 00000004:00080000:1.0:1786562615.914315:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f57800/2, rc 0, transno 17179876117 00000100:00100000:1.0:1786562615.914322:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654914816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562615.918541:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562615.918836:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654914944:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562615.918868:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.919195:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a042e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd338 expref: 14 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.919208:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562615.919212:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1786562615.919231:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0427 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd338 expref: 14 pid: 33113 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.919263:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a042e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd338 expref: 13 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.919303:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562615.919306:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1786562615.919308:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1000, rc 0) 00000100:00100000:0.0:1786562615.919365:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67829:x1873345652927616:12345-192.168.204.29@tcp:101:dd.0 Request processed in 70570us (70746us total) trans 8589950783 rc 0/0 00000100:00100000:0.0:1786562615.919375:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17291 00000100:00100000:3.0:1786562615.919590:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652927744 00000100:00100000:3.0:1786562615.919599:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652927744 00010000:00010000:3.0:1786562615.919627:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 8 pid: 6660 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562615.919676:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8766 00000100:00100000:3.0:1786562615.919687:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652927744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562615.919712:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562615.919719:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 8 pid: 6660 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.919733:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 8 pid: 6660 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.919754:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aba6adb0/0x5c655bf6668a020c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2ba expref: 8 pid: 6660 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.919769:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562615.919774:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562615.919780:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.919792:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.919827:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562615.919850:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652927744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 165us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562615.919861:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8766 00010000:00010000:0.0:1786562615.920159:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.920176:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.920188:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.920198:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.920216:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562615.920828:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3291:x1873345654914688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7109us (7272us total) trans 17179876118 rc 0/0 00000100:00100000:0.0:1786562615.920839:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17915 00010000:00010000:2.0:1786562615.920997:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562615.921023:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.921034:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562615.921039:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.921049:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.921064:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.921071:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a0435 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562615.921103:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562615.921106:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562615.921107:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786562615.921281:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f56d80/2, rc 0, transno 17179876118 00000100:00100000:0.0:1786562615.921288:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654914688:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786562615.931775:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562615.931863:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562615.932198:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652928000 00000100:00100000:0.0:1786562615.932208:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652928000 00000100:00100000:0.0:1786562615.932278:0:29458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652927872 00000100:00100000:0.0:1786562615.932282:0:29458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652927872 00000100:00100000:0.0:1786562615.932320:0:29458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11643 00000100:00100000:0.0:1786562615.932330:0:29458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652928000:12345-192.168.204.29@tcp:4:dd.0 00002000:00010000:0.0:1786562615.932385:0:29458:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562615.932394:0:29458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.932417:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=1048s v=(0 0) 00010000:00010000:0.0:1786562615.932422:0:29458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562615.932428:0:29458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562615.932443:0:29458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562615.933060:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11644 00000100:00100000:3.0:1786562615.933072:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652927872:12345-192.168.204.29@tcp:4:dd.0 00002000:00010000:3.0:1786562615.933100:0:29463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562615.933106:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.933115:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=1048s v=(0 0) 00010000:00010000:3.0:1786562615.933119:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562615.933123:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562615.933132:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562616.049057:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843635 is committed 00000001:00080000:2.0:1786562616.049078:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843638 is committed 00000001:00080000:2.0:1786562616.049087:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843637 is committed 00002000:00010000:3.0:1786562616.055065:0:29463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1786562616.055076:0:29463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb mtime from disk: 0 -> 1786562615 00002000:00010000:3.0:1786562616.055079:0:29463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb ctime from disk: 0 -> 1786562615 00002000:00010000:3.0:1786562616.055081:0:29463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1786562616.055099:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.055112:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.055121:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.055129:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cac00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562616.055134:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.055142:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.055163:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.055170:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aba6adb0/0x5c655bf6668a0443 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562616.055279:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652927872:12345-192.168.204.29@tcp:4:dd.0 Request processed in 122206us (123411us total) trans 21474843638 rc 0/0 00000100:00100000:3.0:1786562616.055289:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11644 00000001:00080000:1.0:1786562616.092785:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843639 is committed 00002000:00010000:1.0:1786562616.092862:0:29458:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1786562616.092866:0:29458:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb mtime from disk: 0 -> 1786562615 00002000:00010000:1.0:1786562616.092869:0:29458:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb ctime from disk: 0 -> 1786562615 00002000:00010000:1.0:1786562616.092871:0:29458:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1786562616.092897:0:29458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.092912:0:29458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.092923:0:29458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.092931:0:29458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562616.092936:0:29458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.092944:0:29458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.092965:0:29458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.092972:0:29458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a043c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562616.093123:0:29458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652928000:12345-192.168.204.29@tcp:4:dd.0 Request processed in 160791us (161354us total) trans 21474843639 rc 0/0 00000100:00100000:1.0:1786562616.093133:0:29458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11643 00010000:00010000:0.0:1786562616.101445:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562616.101505:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.101601:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652928256 00000100:00100000:3.0:1786562616.101613:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652928256 00000100:00100000:3.0:1786562616.101677:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6329 00000100:00100000:3.0:1786562616.101698:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+13:67829:x1873345652928256:12345-192.168.204.29@tcp:35:dd.0 00000100:00100000:3.0:1786562616.102387:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:67829:x1873345652928256:12345-192.168.204.29@tcp:35:dd.0 Request processed in 696us (1393us total) trans 8589950784 rc 0/0 00000100:00100000:3.0:1786562616.102397:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6329 00000100:00100000:1.0:1786562616.135401:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.135475:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652928512 00000100:00100000:3.0:1786562616.135488:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652928512 00000100:00100000:3.0:1786562616.135557:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17292 00000100:00100000:3.0:1786562616.135568:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:67830:x1873345652928512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.135595:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.135619:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a044a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd33f expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.135934:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.135949:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.135969:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.135984:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.135990:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.135997:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136461:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136472:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136479:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136486:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.136490:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136498:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136513:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562616.136516:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.136521:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136527:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0451 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136541:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136548:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136553:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136558:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.136561:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136566:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136578:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1500) 00010000:00010000:3.0:1786562616.136580:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.136583:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136590:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0458 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136633:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a044a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd33f expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136645:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562616.136648:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562616.136651:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a044a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd33f expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.136661:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cac00, rc 0) 00000100:00100000:3.0:1786562616.137424:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:67830:x1873345652928512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1851us (2028us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562616.137436:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17292 00000100:00100000:2.0:1786562616.145085:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.145537:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652928768 00000100:00100000:3.0:1786562616.145549:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652928768 00000100:00100000:3.0:1786562616.145621:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17293 00000100:00100000:3.0:1786562616.145632:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+14:67830:x1873345652928768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.145655:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.145676:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a045f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd346 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562616.146026:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e3:0x0]: returning size 7680 00010000:00010000:3.0:1786562616.146210:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a045f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd346 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.146227:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562616.146230:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562616.146235:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a045f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd346 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.146250:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cac00, rc 0) 00000100:00100000:3.0:1786562616.146319:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67830:x1873345652928768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 689us (1246us total) trans 8589950785 rc 301/301 00000100:00100000:3.0:1786562616.146327:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17293 00000100:00100000:2.0:1786562616.153395:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.153497:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652928896 00000100:00100000:3.0:1786562616.153508:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652928896 00000100:00100000:3.0:1786562616.153566:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17294 00000100:00100000:3.0:1786562616.153578:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67830:x1873345652928896:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562616.153666:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.153698:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.153711:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.153736:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.153843:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.153853:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154580:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154592:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154601:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562616.154636:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:2.0:1786562616.154641:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562616.154652:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154666:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154673:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154680:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154698:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562616.154702:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154709:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154721:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562616.154724:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562616.154728:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154734:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a046d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154826:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154833:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154839:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154844:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562616.154847:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154853:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154860:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1500) 00010000:00010000:2.0:1786562616.154863:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562616.154865:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154871:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0474 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154941:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154955:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154962:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154967:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562616.154970:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154976:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154983:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562616.154985:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562616.154988:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.154994:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a047b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562616.155104:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67830:x1873345652928896:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1526us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562616.155113:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17294 00000100:00100000:1.0:1786562616.166609:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562616.166778:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652929152 00000100:00100000:2.0:1786562616.166789:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652929152 00000100:00100000:2.0:1786562616.166865:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6330 00000100:00100000:2.0:1786562616.166875:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67830:x1873345652929152:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562616.167377:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:67830:x1873345652929152:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 501us (778us total) trans 8589950786 rc 0/0 00000100:00100000:2.0:1786562616.167386:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6330 00000100:00100000:3.0:1786562616.224834:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.224938:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652929408 00000100:00100000:0.0:1786562616.224959:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652929408 00000100:00100000:0.0:1786562616.225073:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17295 00000100:00100000:0.0:1786562616.225084:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:67834:x1873345652929408:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562616.225111:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562616.225136:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0482 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd34d expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225281:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225297:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225314:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225331:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225338:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225345:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225761:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225773:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225779:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225785:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.225790:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225799:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225814:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.225818:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.225822:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225828:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0489 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225859:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225865:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225871:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225876:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.225878:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225884:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225892:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562616.225895:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.225898:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225903:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0490 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225956:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0482 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd34d expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225974:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.225976:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562616.225980:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0482 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd34d expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.225991:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268600, rc 0) 00000100:00100000:1.0:1786562616.226118:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:67834:x1873345652929408:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1035us (1294us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562616.226127:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17295 00000100:00100000:0.0:1786562616.237701:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.237874:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652929664 00000100:00100000:3.0:1786562616.238097:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652929664 00000100:00100000:3.0:1786562616.238214:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17296 00000100:00100000:3.0:1786562616.238227:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:67834:x1873345652929664:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.238252:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.238277:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd354 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.238596:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a049e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.238625:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a049e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.238638:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a049e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562616.238650:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e3:0x0]: returning size 7680 00010000:00010000:3.0:1786562616.239201:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd354 expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.239221:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cac00/0x5c655bf6668a049e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd354 expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.239230:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562616.239233:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562616.239237:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cac00, rc 0) 00000100:00100000:3.0:1786562616.239432:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:67834:x1873345652929664:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1208us (1752us total) trans 8589950787 rc 0/0 00000100:00100000:3.0:1786562616.239442:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17296 00000100:00100000:2.0:1786562616.243128:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.243207:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652929792 00000100:00100000:3.0:1786562616.243218:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652929792 00000100:00100000:3.0:1786562616.243279:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17297 00000100:00100000:3.0:1786562616.243299:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:67834:x1873345652929792:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562616.243377:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243395:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243408:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243425:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243432:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243438:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243919:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243930:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.243938:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562616.244121:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:3.0:1786562616.244127:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562616.244141:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244154:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244161:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244167:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244173:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.244177:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244184:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244197:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562616.244201:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.244206:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244212:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a04ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244226:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244232:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244238:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244243:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.244246:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244252:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244259:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1400) 00010000:00010000:3.0:1786562616.244261:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.244264:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244269:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a04b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244507:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244516:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244522:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244527:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cba00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.244530:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244537:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244546:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562616.244548:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.244551:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.244557:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a04ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562616.244893:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:67834:x1873345652929792:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1584us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562616.244904:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17297 00000100:00100000:2.0:1786562616.295063:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.295188:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652930048 00000100:00100000:1.0:1786562616.295200:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652930048 00000100:00100000:1.0:1786562616.295267:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17298 00000100:00100000:1.0:1786562616.295278:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:67842:x1873345652930048:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562616.295302:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562616.295326:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd35b expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295405:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295422:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295434:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295452:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295460:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295468:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295879:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295890:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295897:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295904:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.295909:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295918:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295933:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.295936:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.295942:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295949:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295977:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295985:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295992:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.295997:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.296001:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.296068:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.296076:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562616.296079:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.296082:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.296088:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.296133:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04c1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd35b expref: 19 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.296145:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.296148:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562616.296152:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd35b expref: 19 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.296181:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1600, rc 0) 00000100:00100000:1.0:1786562616.296264:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:67842:x1873345652930048:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 987us (1272us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562616.296274:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17298 00000100:00100000:2.0:1786562616.304893:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.305286:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652930176 00000100:00100000:1.0:1786562616.305298:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652930176 00000100:00100000:1.0:1786562616.305374:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17299 00000100:00100000:1.0:1786562616.305387:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:67842:x1873345652930176:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562616.305481:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305499:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305512:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305528:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305536:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305543:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305944:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305959:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.305967:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562616.306042:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:1.0:1786562616.306048:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562616.306062:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306077:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306084:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306092:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306099:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.306104:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306112:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306126:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.306130:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.306135:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306146:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a04d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306166:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306174:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306180:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306185:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.306188:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306195:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306203:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562616.306206:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.306209:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306215:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a04dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306234:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306241:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306247:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306253:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.306256:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306262:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306269:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562616.306272:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.306275:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.306282:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a04e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562616.306375:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:67842:x1873345652930176:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 988us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.306387:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17299 00000100:00100000:3.0:1786562616.344365:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.344474:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652930432 00000100:00100000:0.0:1786562616.344498:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652930432 00000100:00100000:0.0:1786562616.344569:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17300 00000100:00100000:0.0:1786562616.344581:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:67850:x1873345652930432:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562616.344607:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562616.344646:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a04eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd362 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.344763:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.344780:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.344792:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.344807:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.344813:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.344819:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345218:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345227:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345235:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345241:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562616.345246:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345259:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345271:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562616.345275:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562616.345280:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345286:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a04f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345299:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345305:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345310:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345314:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562616.345317:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345323:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345330:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46aba00) 00010000:00010000:0.0:1786562616.345332:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562616.345335:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345341:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a04f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345395:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a04eb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd362 expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345407:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562616.345409:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562616.345413:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a04eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd362 expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.345423:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:0.0:1786562616.345510:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:67850:x1873345652930432:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 932us (1158us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562616.345520:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17300 00000100:00100000:2.0:1786562616.353869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.353972:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652930560 00000100:00100000:3.0:1786562616.353982:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652930560 00000100:00100000:3.0:1786562616.354096:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17301 00000100:00100000:3.0:1786562616.354106:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:67850:x1873345652930560:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562616.354200:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354221:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354235:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354253:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354261:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354268:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354629:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354640:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354648:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562616.354701:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:3.0:1786562616.354706:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562616.354720:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354735:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354742:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354753:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354759:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cba00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.354764:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354772:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354786:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562616.354789:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.354794:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354800:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0500 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354816:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354822:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354827:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354832:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.354835:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354844:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354851:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1400) 00010000:00010000:3.0:1786562616.354854:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.354857:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354863:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0507 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354877:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354883:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354888:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354894:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562616.354896:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354901:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354908:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562616.354910:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562616.354912:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.354919:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a050e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562616.355049:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:67850:x1873345652930560:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 903us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562616.355060:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17301 00000100:00100000:2.0:1786562616.398149:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.398487:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652930816 00000100:00100000:0.0:1786562616.398499:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652930816 00000100:00100000:0.0:1786562616.398566:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17302 00000100:00100000:0.0:1786562616.398577:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:67857:x1873345652930816:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562616.398601:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562616.398625:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0515 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd369 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.398713:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.398728:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.398739:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.398753:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.398761:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.398767:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399305:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399314:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399321:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399327:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562616.399331:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399339:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399351:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562616.399355:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562616.399359:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399366:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a051c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399377:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399383:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399388:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399393:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562616.399396:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399401:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399409:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46aba00) 00010000:00010000:0.0:1786562616.399411:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562616.399414:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399420:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0523 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399456:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0515 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd369 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399471:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562616.399473:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562616.399476:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0515 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd369 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.399484:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:0.0:1786562616.399552:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:67857:x1873345652930816:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 977us (1414us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562616.399561:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17302 00000100:00100000:2.0:1786562616.404313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.404407:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652930944 00000100:00100000:1.0:1786562616.404419:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652930944 00000100:00100000:1.0:1786562616.404489:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17303 00000100:00100000:1.0:1786562616.404500:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:67857:x1873345652930944:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562616.404580:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.404598:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.404610:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.404626:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.404634:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.404653:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405074:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405085:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405093:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562616.405276:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:1.0:1786562616.405282:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562616.405296:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405309:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405315:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405326:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405333:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.405337:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405345:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405357:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.405360:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.405365:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405371:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a052a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405400:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405406:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405412:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405417:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.405420:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405429:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405437:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562616.405439:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.405442:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405448:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0531 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405464:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405470:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405475:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405480:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.405483:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405488:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405495:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562616.405497:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.405500:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.405507:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0538 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562616.405597:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:67857:x1873345652930944:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1096us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.405607:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17303 00000100:00100000:2.0:1786562616.445100:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.445209:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652931072 00000100:00100000:1.0:1786562616.445219:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652931072 00000100:00100000:1.0:1786562616.445281:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17304 00000100:00100000:1.0:1786562616.445293:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:67859:x1873345652931072:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562616.445314:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562616.445335:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a053f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd370 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445403:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445418:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445429:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445458:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445467:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445478:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445843:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445852:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445860:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562616.445890:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:1.0:1786562616.445894:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562616.445911:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445922:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445929:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445936:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445942:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445948:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.445952:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445959:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445971:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562616.445975:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.445980:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.445986:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0546 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446055:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446062:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446068:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446073:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562616.446076:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446081:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446088:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562616.446091:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562616.446093:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446099:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a054d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446129:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a053f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd370 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446154:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd370 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.446160:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562616.446162:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562616.446164:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:1.0:1786562616.447735:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:67859:x1873345652931072:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2434us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.447749:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17304 00000100:00100000:2.0:1786562616.468185:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562616.468251:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.471835:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652931200 00000100:00100000:3.0:1786562616.471851:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652931200 00000100:00080000:1.0:1786562616.472333:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562616.472964:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652931328 00000100:00100000:3.0:1786562616.472973:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652931328 00000100:00100000:3.0:1786562616.473038:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17917 00000100:00100000:3.0:1786562616.473048:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652931200:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.473067:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.473090:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd377 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562616.473118:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73c:0x0] initial LVB size: 1048576, mtime: 0x6a7cc837, atime: 0x0, ctime: 0x6a7cc837, blocks: 0x803 00010000:00010000:3.0:1786562616.473262:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=1048s v=(0 0) 00010000:00010000:3.0:1786562616.473267:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.473279:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.473297:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.473311:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb400, rc 0) 00000100:00100000:3.0:1786562616.473378:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652931200:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 332us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562616.473385:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17917 00000100:00100000:3.0:1786562616.473405:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17918 00000100:00100000:3.0:1786562616.473412:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652931328:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.473420:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.473429:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd37e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562616.473442:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc837, atime: 0x0, ctime: 0x6a7cc837, blocks: 0x807 00010000:00010000:3.0:1786562616.473452:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=1048s v=(0 0) 00010000:00010000:3.0:1786562616.473455:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.473460:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.473472:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.473481:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca000, rc 0) 00000100:00100000:3.0:1786562616.473502:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652931328:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 91us (5252us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562616.473508:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17918 00000100:00100000:2.0:1786562616.480202:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.480557:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652931584 00000100:00100000:3.0:1786562616.480568:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652931584 00000100:00100000:3.0:1786562616.480643:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17305 00000100:00100000:3.0:1786562616.480653:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:67859:x1873345652931584:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.480689:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.480712:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0569 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd385 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.480823:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0570 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.480839:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0570 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.480852:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0570 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562616.480863:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00010000:00010000:3.0:1786562616.481066:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0569 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd385 expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.481087:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0570 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd385 expref: 21 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.481095:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562616.481098:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562616.481102:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850ca200, rc 0) 00000100:00100000:3.0:1786562616.482392:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:67859:x1873345652931584:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1732us (2194us total) trans 8589950788 rc 0/0 00000100:00100000:3.0:1786562616.482403:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17305 00000100:00100000:3.0:1786562616.493096:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.493142:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.495153:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652931968 00000100:00100000:1.0:1786562616.495171:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652931968 00000100:00100000:1.0:1786562616.495262:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 993 00000100:00100000:1.0:1786562616.495273:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:2350:x1873345652931968:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562616.495291:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562616.495322:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0570 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd385 expref: 21 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.495349:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562616.495355:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562616.495481:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:2350:x1873345652931968:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 209us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.495490:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 993 00000100:00100000:0.0:1786562616.497482:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652931840 00000100:00100000:0.0:1786562616.497496:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652931840 00000100:00100000:0.0:1786562616.497605:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17306 00000100:00100000:0.0:1786562616.497616:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:67859:x1873345652931840:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562616.497642:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562616.497663:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a057e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd38c expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.497780:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0585 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.497795:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0585 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.497807:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0585 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562616.497820:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00010000:00010000:0.0:1786562616.497960:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a057e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd38c expref: 23 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.497981:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0585 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd38c expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.497990:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562616.497993:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562616.497996:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269c00, rc 0) 00000100:00100000:0.0:1786562616.501881:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:67859:x1873345652931840:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4251us (8779us total) trans 8589950789 rc 0/0 00000100:00100000:0.0:1786562616.501894:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17306 00000100:00100000:2.0:1786562616.509929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.510056:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932096 00000100:00100000:1.0:1786562616.510067:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932096 00000100:00100000:1.0:1786562616.510133:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17919 00000100:00100000:1.0:1786562616.510144:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652932096:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562616.510190:0:12119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.510212:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.510221:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562616.510226:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562616.510232:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.510269:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 10 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.510284:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 10 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562616.510301:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654915072:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562616.510403:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562616.514189:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654915072:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562616.514219:0:12119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562616.519312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562616.519364:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.519456:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932352 00000100:00100000:1.0:1786562616.519466:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932352 00010000:00010000:1.0:1786562616.519510:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 11 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562616.519561:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8767 00000100:00100000:1.0:1786562616.519571:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652932352:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562616.519586:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562616.519611:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 11 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.519625:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 11 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.519649:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001519b0fc/0x5c655bf6668a055b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd377 expref: 11 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.519668:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562616.519672:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562616.519690:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.519707:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.519735:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562616.519790:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652932352:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 220us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.519799:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8767 00010000:00010000:0.0:1786562616.520087:0:12119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520097:0:12119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520246:0:12119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520256:0:12119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520263:0:12119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520275:0:12119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562616.520279:0:12119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520288:0:12119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520302:0:12119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520309:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a0593 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562616.520384:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652932096:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 10242us (10464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562616.520392:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17919 00000100:00100000:0.0:1786562616.520408:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932224 00000100:00100000:0.0:1786562616.520413:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932224 00000100:00100000:0.0:1786562616.520442:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17920 00000100:00100000:0.0:1786562616.520448:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652932224:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562616.520480:0:12119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520494:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520506:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562616.520510:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562616.520514:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520543:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.520556:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 9 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562616.520569:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654915200:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562616.520621:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1786562616.530396:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.530510:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654915200:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562616.530541:0:12119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562616.532226:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932480 00000100:00100000:3.0:1786562616.532240:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932480 00010000:00010000:2.0:1786562616.532493:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 10 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562616.532552:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8768 00000100:00100000:2.0:1786562616.532563:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652932480:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562616.532579:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562616.532604:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 10 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.532624:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 10 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.532647:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001444848c/0x5c655bf6668a0562 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd37e expref: 10 pid: 6659 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.532891:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562616.532896:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562616.532903:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.532915:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.532948:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562616.532984:0:12119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.532998:0:12119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533046:0:12119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533058:0:12119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533067:0:12119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533074:0:12119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562616.533078:0:12119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533088:0:12119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533101:0:12119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.533110:0:12119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a059a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562616.533283:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652932480:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 720us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562616.533425:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8768 00000100:00100000:0.0:1786562616.533674:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652932224:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 13224us (14308us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562616.533695:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17920 00000100:00100000:2.0:1786562616.538315:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.538467:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932736 00000100:00100000:0.0:1786562616.538480:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932736 00000100:00100000:0.0:1786562616.538549:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17307 00000100:00100000:0.0:1786562616.538560:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:67859:x1873345652932736:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562616.538617:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786562616.538647:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a0554 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd370 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.538697:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a042e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd338 expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.538710:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562616.538715:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562616.538748:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.538762:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.538773:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786562616.540236:0:33114:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x721:0x0], index 1: 0 00000040:00080000:0.0:1786562616.540369:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4398, 88 off356832 00000004:00080000:0.0:1786562616.540380:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1048982373614ns, next at 1047114106065ns, rc = 0 00000040:00080000:0.0:1786562616.540419:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4399, 88 off356920 00000004:00080000:0.0:1786562616.540424:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1048982418421ns, next at 1047114106065ns, rc = 0 00000040:00080000:0.0:1786562616.540470:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4427, 88 off359512 00000004:00080000:0.0:1786562616.540476:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1048982470610ns, next at 1049034642335ns, rc = 0 00000040:00080000:0.0:1786562616.540511:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4428, 88 off359600 00000004:00080000:0.0:1786562616.540516:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1048982510064ns, next at 1049034642335ns, rc = 0 00000001:00080000:2.0:1786562616.567288:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950790 is committed 00000004:00080000:2.0:1786562616.567304:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2931 committed 00000004:00080000:2.0:1786562616.567322:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2930 committed 00000004:00080000:2.0:1786562616.567325:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2901 committed 00000004:00080000:2.0:1786562616.567338:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2900 committed 00000100:00100000:0.0:1786562616.567563:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654915328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562616.567655:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562616.567748:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654915328 00000100:00100000:2.0:1786562616.567767:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654915328 00000100:00100000:2.0:1786562616.567830:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17921 00000100:00100000:2.0:1786562616.567840:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654915328:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1786562616.568749:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562616.568762:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562616.568776:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654915584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562616.568810:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562616.568842:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654915584 00000100:00100000:1.0:1786562616.568847:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654915584 00000100:00100000:1.0:1786562616.569121:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17922 00000100:00100000:1.0:1786562616.569132:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3292:x1873345654915584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562616.569296:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3292:x1873345654915584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (484us total) trans 17179876120 rc 0/0 00000100:00100000:1.0:1786562616.569303:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17922 00000004:00080000:1.0:1786562616.569349:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88313e300/2, rc 0, transno 17179876120 00000100:00100000:1.0:1786562616.569355:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654915584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562616.569851:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3289:x1873345654915328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2011us (2195us total) trans 17179876119 rc 0/0 00000100:00100000:2.0:1786562616.569859:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17921 00000004:00080000:0.0:1786562616.570146:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88bd1aa00/2, rc 0, transno 17179876119 00000100:00100000:0.0:1786562616.570152:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654915328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562616.570160:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562616.570168:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654915456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562616.570204:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562616.570288:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654915456 00000100:00100000:1.0:1786562616.570294:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654915456 00000100:00100000:1.0:1786562616.570340:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17923 00000100:00100000:1.0:1786562616.570347:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654915456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562616.570778:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654915456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 431us (572us total) trans 21474843640 rc 0/0 00000100:00100000:1.0:1786562616.570786:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17923 00000004:00010000:2.0:1786562616.570865:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040c52ffc reply state 0000000034fc662e transno 8589950790 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562616.571037:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786562616.571125:0:33114:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1786562616.571140:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67859:x1873345652932736:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 32580us (32835us total) trans 8589950790 rc 0/0 00000100:00100000:2.0:1786562616.571147:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17307 00010000:00010000:2.0:1786562616.571171:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.571180:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.571187:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.571193:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562616.571197:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.571205:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.571222:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562616.571226:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562616.571231:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562616.571237:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a05a1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562616.572354:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562616.572402:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843637 gen 2 00000004:00080000:0.0:1786562616.572409:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c52ed80, transno 21474843635 00000004:00080000:0.0:1786562616.572414:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1c700, transno 21474843636 00000004:00080000:0.0:1786562616.572417:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1d880, transno 21474843637 00000100:00100000:0.0:1786562616.572425:0:3289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e886c1c000 x1873345654915456/t21474843640(21474843640) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562632 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562616.572436:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1c000/2, rc 0, transno 21474843640 00000100:00100000:0.0:1786562616.572441:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654915456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562616.573328:0:33135:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 1 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1786562616.573570:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562616.573586:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654915712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562616.573809:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562616.574100:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654915712 00000100:00100000:3.0:1786562616.574108:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654915712 00000100:00100000:3.0:1786562616.574161:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17924 00000100:00100000:3.0:1786562616.574171:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654915712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562616.574424:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654915712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (615us total) trans 21474843641 rc 0/0 00000100:00100000:3.0:1786562616.574431:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17924 00000004:00080000:2.0:1786562616.577026:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1c700/2, rc 0, transno 21474843641 00000100:00100000:2.0:1786562616.577040:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654915712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562616.578079:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.578310:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932864 00000100:00100000:1.0:1786562616.578320:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932864 00000100:00100000:1.0:1786562616.578369:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17308 00000100:00100000:1.0:1786562616.578378:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+14:67859:x1873345652932864:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562616.578400:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562616.578420:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd393 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.578491:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 15 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.578507:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 15 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562616.578525:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562616.578529:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562616.578533:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1a00, rc 0) 00000100:00100000:1.0:1786562616.578586:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67859:x1873345652932864:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 210us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.578594:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17308 00000100:00100000:1.0:1786562616.583167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.583265:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652932992 00000100:00100000:3.0:1786562616.583284:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652932992 00000100:00100000:3.0:1786562616.583652:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17309 00000100:00100000:3.0:1786562616.583696:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67859:x1873345652932992:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.583738:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.583769:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a05af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd39a expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.584267:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a05b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.584287:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a05b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.584301:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a05b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562616.584539:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097153 00000004:00200000:3.0:1786562616.584545:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562616.584574:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a05b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.584615:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a05af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd39a expref: 17 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.584642:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a05b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd39a expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.584653:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562616.584656:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562616.584661:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cba00, rc 0) 00000100:00100000:3.0:1786562616.585215:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:67859:x1873345652932992:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1547us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562616.590551:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17309 00000100:00100000:2.0:1786562616.590640:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.590779:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933248 00000100:00100000:0.0:1786562616.590792:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933248 00000100:00100000:2.0:1786562616.590798:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562616.590931:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933120 00000100:00100000:0.0:1786562616.590936:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933120 00000100:00100000:3.0:1786562616.590952:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17925 00000100:00100000:3.0:1786562616.590965:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652933248:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562616.590992:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562616.591047:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3a8 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562616.591084:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73d:0x0] initial LVB size: 2097152, mtime: 0x6a7cc837, atime: 0x0, ctime: 0x6a7cc837, blocks: 0x807 00010000:00010000:3.0:1786562616.591111:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:3.0:1786562616.591118:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.591131:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 10 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.591154:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 10 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.591172:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb800, rc 0) 00000100:00100000:0.0:1786562616.591246:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17926 00000100:00100000:0.0:1786562616.591257:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652933120:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562616.591266:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562616.591282:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3a1 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562616.591303:0:37002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73c:0x0] initial LVB size: 1048576, mtime: 0x6a7cc837, atime: 0x0, ctime: 0x6a7cc837, blocks: 0x803 00010000:00010000:0.0:1786562616.591315:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:0.0:1786562616.591319:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562616.591326:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 11 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562616.591329:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652933248:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 366us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562616.591337:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17925 00010000:00010000:0.0:1786562616.591339:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 11 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.591347:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:0.0:1786562616.591369:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652933120:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 115us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562616.591375:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17926 00000100:00100000:2.0:1786562616.665956:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562616.666077:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.666200:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933504 00000100:00100000:3.0:1786562616.666212:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933504 00000100:00100000:3.0:1786562616.666281:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933376 00000100:00100000:3.0:1786562616.666284:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933376 00000100:00100000:3.0:1786562616.666307:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17927 00000100:00100000:3.0:1786562616.666318:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+11:2350:x1873345652933504:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:0.0:1786562616.666508:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17928 00000100:00100000:0.0:1786562616.666519:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:2350:x1873345652933376:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:1.0:1786562616.746172:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843640 is committed 00000001:00080000:1.0:1786562616.746204:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843641 is committed 00000100:00100000:3.0:1786562616.757150:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:2350:x1873345652933376:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 90621us (91060us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562616.757168:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17928 00000100:00100000:1.0:1786562616.759235:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652933504:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 92908us (93291us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.759254:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17927 00000100:00100000:2.0:1786562616.762047:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562616.762177:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.762778:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933632 00000100:00100000:1.0:1786562616.762789:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933632 00000100:00100000:1.0:1786562616.762844:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933760 00000100:00100000:1.0:1786562616.762847:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933760 00000100:00100000:1.0:1786562616.762886:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17929 00000100:00100000:1.0:1786562616.762896:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652933632:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:1.0:1786562616.763039:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652933632:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 144us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.763047:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17929 00000100:00100000:1.0:1786562616.763068:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17930 00000100:00100000:1.0:1786562616.763076:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652933760:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:1.0:1786562616.763116:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652933760:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 41us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562616.763123:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17930 00000100:00100000:1.0:1786562616.768338:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.768381:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.768457:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934016 00000100:00100000:3.0:1786562616.768467:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934016 00000100:00100000:3.0:1786562616.768601:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652933888 00000100:00100000:3.0:1786562616.768606:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652933888 00000100:00100000:3.0:1786562616.768638:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11645 00000100:00100000:3.0:1786562616.768648:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+11:2350:x1873345652934016:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562616.768699:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.768717:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.768722:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.768729:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.768745:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562616.769368:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11646 00000100:00100000:3.0:1786562616.769378:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2350:x1873345652933888:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562616.769399:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.769410:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.769414:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.769418:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.769428:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795441:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795462:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795472:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795670:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562616.795692:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795700:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795731:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.795739:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7f97e8/0x5c655bf6668a05cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562616.796405:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+12:2350:x1873345652934016:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 27752us (28070us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562616.796418:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11645 00010000:00010000:0.0:1786562616.808192:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.808214:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.808223:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.808235:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cbe00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562616.808239:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.808248:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.808270:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562616.808278:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f91a3d47/0x5c655bf6668a05d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562616.808413:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652933888:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 39031us (40026us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562616.808424:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11646 00000100:00100000:1.0:1786562616.821979:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562616.822055:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562616.822221:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934144 00000100:00100000:3.0:1786562616.822232:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934144 00000100:00100000:3.0:1786562616.822300:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934272 00000100:00100000:3.0:1786562616.822304:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934272 00000100:00100000:3.0:1786562616.822332:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11647 00000100:00100000:3.0:1786562616.822343:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652934144:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:3.0:1786562616.822392:0:29462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562616.822401:0:29462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.822424:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:3.0:1786562616.822428:0:29462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.822436:0:29462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.822452:0:29462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562616.823318:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562616.823850:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11648 00000100:00100000:3.0:1786562616.823865:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652934272:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:3.0:1786562616.823970:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.823986:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.823990:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562616.823996:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562616.824027:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562617.007071:0:29462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1786562617.007081:0:29462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb mtime from disk: 0 -> 1786562616 00002000:00010000:2.0:1786562617.007084:0:29462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb ctime from disk: 0 -> 1786562616 00002000:00010000:2.0:1786562617.007086:0:29462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1786562617.007103:0:29462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.007116:0:29462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.007130:0:29462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.007138:0:29462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562617.007143:0:29462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.007153:0:29462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.007175:0:29462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.007184:0:29462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce5bb92/0x5c655bf6668a05d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562617.007303:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+13:2351:x1873345652934144:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 184957us (185331us total) trans 17179876121 rc 0/0 00000100:00100000:2.0:1786562617.007315:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11647 00000001:00080000:2.0:1786562617.007357:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876121 is committed 00000001:00080000:2.0:1786562617.007370:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876118 is committed 00000001:00080000:2.0:1786562617.007380:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876120 is committed 00010000:00010000:0.0:1786562617.128763:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562617.134303:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876122 is committed 00002000:00010000:2.0:1786562617.134690:0:16203:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1786562617.134708:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.134800:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.134810:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.134818:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562617.134824:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.134833:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.134854:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.134862:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000513d8008/0x5c655bf6668a05e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562617.135576:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652934272:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 311709us (313513us total) trans 17179876122 rc 0/0 00000100:00100000:2.0:1786562617.135588:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11648 00000100:00100000:1.0:1786562617.173652:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562617.173769:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934528 00000100:00100000:0.0:1786562617.173782:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934528 00000100:00100000:0.0:1786562617.173863:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17310 00000100:00100000:0.0:1786562617.173874:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:67859:x1873345652934528:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562617.173948:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562617.173980:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a05b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd39a expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562617.174217:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562617.174265:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:0.0:1786562617.174271:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562617.174626:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.174643:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.174655:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562617.174733:0:33140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950791 00000004:00010000:3.0:1786562617.174761:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000922be355 reply state 000000003767eb52 transno 8589950792 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562617.174771:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562617.174877:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:67859:x1873345652934528:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1004us (1236us total) trans 8589950792 rc 0/0 00000100:00100000:3.0:1786562617.174886:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17310 00000020:00080000:3.0:1786562617.174892:0:33140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786562617.185768:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1786562617.185862:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.185875:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.185884:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.185890:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.185895:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.185903:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.185920:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562617.185923:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.185940:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.185953:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a05e7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562617.187097:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934656 00000100:00100000:3.0:1786562617.187111:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934656 00000100:00100000:3.0:1786562617.187177:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17931 00000100:00100000:3.0:1786562617.187188:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:67859:x1873345652934656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562617.187206:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562617.187228:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3af expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562617.187258:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x720:0x0] initial LVB size: 2097152, mtime: 0x6a7cc838, atime: 0x0, ctime: 0x6a7cc838, blocks: 0x1007 00010000:00010000:3.0:1786562617.187281:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:3.0:1786562617.187286:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562617.187295:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.187309:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.187322:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2e00, rc 0) 00000100:00100000:3.0:1786562617.187389:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:67859:x1873345652934656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 203us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562617.187397:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17931 00000100:00100000:2.0:1786562617.199160:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.199260:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934784 00000100:00100000:1.0:1786562617.199270:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934784 00000100:00100000:1.0:1786562617.199342:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17932 00000100:00100000:1.0:1786562617.199353:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:67859:x1873345652934784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562617.199374:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562617.199395:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3b6 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562617.199425:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562617.199449:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x721:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:1.0:1786562617.199454:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.199463:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 9 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.199481:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 9 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.199496:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0800, rc 0) 00000100:00100000:1.0:1786562617.199558:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+9:67859:x1873345652934784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 207us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.199566:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17932 00000100:00100000:3.0:1786562617.202871:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.205480:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652934912 00000100:00100000:1.0:1786562617.205500:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652934912 00002000:00010000:1.0:1786562617.205549:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1824 (2097152->18446744073709551615) 00002000:00100000:1.0:1786562617.205554:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e886c1d880 with x1873345652934912 ext(2097152->18446744073709551615) 00002000:00010000:1.0:1786562617.205567:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e886c1d880. 00000100:00100000:1.0:1786562617.205615:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11649 00000100:00100000:1.0:1786562617.205626:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652934912:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:1.0:1786562617.206440:0:29459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562617.206448:0:29459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb mtime from disk: 1786562616 -> 1786562616 00002000:00010000:1.0:1786562617.206451:0:29459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562617.206453:0:29459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb ctime from disk: 1786562616 -> 1786562616 00002000:00010000:1.0:1786562617.206456:0:29459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562617.207436:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652934912:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 1804us (4576us total) trans 17179876123 rc 0/0 00000100:00100000:1.0:1786562617.207449:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11649 00002000:00010000:1.0:1786562617.207455:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1824 (2097152->18446744073709551615) 00002000:00100000:1.0:1786562617.207458:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e886c1d880 with x1873345652934912 ext(2097152->18446744073709551615) 00002000:00010000:1.0:1786562617.207468:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e886c1d880. 00000100:00100000:0.0:1786562617.215028:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.215211:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935040 00000100:00100000:1.0:1786562617.215222:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935040 00002000:00010000:1.0:1786562617.215263:0:29461:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1825 (0->18446744073709551615) 00002000:00100000:1.0:1786562617.215269:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa3100 with x1873345652935040 ext(0->18446744073709551615) 00002000:00010000:1.0:1786562617.215282:0:29461:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bbfa3100. 00000100:00100000:1.0:1786562617.215309:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11650 00000100:00100000:1.0:1786562617.215328:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652935040:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:1.0:1786562617.215630:0:29461:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562617.215635:0:29461:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb mtime from disk: 0 -> 1786562616 00002000:00010000:1.0:1786562617.215637:0:29461:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562617.215639:0:29461:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb ctime from disk: 0 -> 1786562616 00002000:00010000:1.0:1786562617.215642:0:29461:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562617.215724:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652935040:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 405us (726us total) trans 17179876124 rc 0/0 00000100:00100000:1.0:1786562617.215732:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11650 00002000:00010000:1.0:1786562617.215736:0:29461:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1825 (0->18446744073709551615) 00002000:00100000:1.0:1786562617.215740:0:29461:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa3100 with x1873345652935040 ext(0->18446744073709551615) 00002000:00010000:1.0:1786562617.215745:0:29461:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bbfa3100. 00000100:00100000:3.0:1786562617.223448:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562617.223613:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935296 00000100:00100000:2.0:1786562617.223626:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935296 00000100:00100000:2.0:1786562617.223698:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17311 00000100:00100000:2.0:1786562617.223709:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:67859:x1873345652935296:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562617.223827:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.223849:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.223862:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562617.224156:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca5f5cd2 reply state 00000000de0af34c transno 8589950793 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562617.224166:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562617.224661:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:67859:x1873345652935296:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 951us (1221us total) trans 8589950793 rc 0/0 00000100:00100000:2.0:1786562617.224681:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17311 00000100:00100000:3.0:1786562617.239896:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1786562617.239996:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.240042:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.240051:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.240058:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.240064:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.240072:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.240089:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562617.240092:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.240096:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.240102:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a05fc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562617.240213:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935424 00000100:00100000:0.0:1786562617.240222:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935424 00000100:00100000:0.0:1786562617.240279:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17933 00000100:00100000:0.0:1786562617.240288:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+10:67859:x1873345652935424:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562617.240305:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562617.240421:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3bd expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.240452:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 11 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.240462:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562617.240467:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562617.240472:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 11 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.240509:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 11 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.240524:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 11 pid: 37002 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562617.240543:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654915840:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562617.240644:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baedd540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562617.247151:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.247230:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935552 00000100:00100000:1.0:1786562617.247241:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935552 00010000:00010000:1.0:1786562617.247289:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 12 pid: 37002 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.247343:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8769 00000100:00100000:1.0:1786562617.247355:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652935552:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562617.247371:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562617.247396:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 12 pid: 37002 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.247411:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 12 pid: 37002 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.247436:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.247441:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.247449:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.247459:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.247501:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 12 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.247521:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654915968:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562617.247608:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1786562617.249961:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007592f0fb/0x5c655bf6668a05c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a1 expref: 12 pid: 37002 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562617.249988:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654915840:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562617.250072:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 11 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.250086:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269000, rc 0) 00000100:00100000:3.0:1786562617.250154:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+11:67859:x1873345652935424:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 9867us (10267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562617.250163:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17933 00000100:00100000:3.0:1786562617.251146:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654915968:192.168.204.29@tcp:105: 00010000:00010000:3.0:1786562617.251164:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562617.251207:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652935552:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3855us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562617.251218:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8769 00000100:00100000:2.0:1786562617.259573:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.259885:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935680 00000100:00100000:1.0:1786562617.259896:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935680 00000100:00100000:1.0:1786562617.259966:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17934 00000100:00100000:1.0:1786562617.259976:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:67859:x1873345652935680:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562617.259995:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562617.260607:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3c4 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.260643:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.260653:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.260658:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.260675:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->68157439] (req 1048576->68157439) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.260713:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.260729:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.260752:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654916096:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562617.260844:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96f240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562617.265343:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8368:1873345654916096:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562617.265384:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [1048576->68157439] (req 1048576->68157439) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 11 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.265406:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0e00, rc 0) 00000100:00100000:1.0:1786562617.265471:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:67859:x1873345652935680:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5495us (5905us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.265482:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17934 00000100:00100000:0.0:1786562617.270697:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.285583:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935808 00000100:00100000:1.0:1786562617.285602:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935808 00010000:00010000:1.0:1786562617.285672:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.285718:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8770 00000100:00100000:1.0:1786562617.285728:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652935808:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562617.285747:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562617.285771:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.285786:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.285816:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c0a421/0x5c655bf6668a05bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3a8 expref: 11 pid: 29964 timeout: 1149 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.285833:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.285837:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562617.285844:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 10 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.285854:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 10 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.285903:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 10 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.285917:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654916224:192.168.204.29@tcp:105: 00000100:00100000:1.0:1786562617.286441:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96f240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562617.289631:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654916224:192.168.204.29@tcp:105: 00010000:00010000:1.0:1786562617.289659:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562617.289722:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652935808:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3994us (19036us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.289735:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8770 00000100:00100000:3.0:1786562617.290751:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562617.291228:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652935936 00000100:00100000:0.0:1786562617.291238:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652935936 00000100:00100000:0.0:1786562617.291284:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17935 00000100:00100000:0.0:1786562617.291294:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652935936:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:0.0:1786562617.291565:0:12119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1786562617.291570:0:12119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb mtime from disk: 1786562615 -> 1786562615 00002000:00010000:0.0:1786562617.291572:0:12119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb atime from disk: 0 -> 1786562615 00002000:00010000:0.0:1786562617.291575:0:12119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb ctime from disk: 1786562615 -> 1786562616 00002000:00010000:0.0:1786562617.291577:0:12119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:0.0:1786562617.291729:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652935936:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 435us (981us total) trans 21474843642 rc 0/0 00000100:00100000:0.0:1786562617.291738:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17935 00000100:00100000:0.0:1786562617.293720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.294056:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652936064 00000100:00100000:1.0:1786562617.294065:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652936064 00000100:00100000:1.0:1786562617.294114:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17936 00000100:00100000:1.0:1786562617.294124:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652936064:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562617.294452:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562617.294456:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb mtime from disk: 1786562615 -> 1786562615 00002000:00010000:1.0:1786562617.294458:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb atime from disk: 0 -> 1786562615 00002000:00010000:1.0:1786562617.294460:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb ctime from disk: 1786562615 -> 1786562616 00002000:00010000:1.0:1786562617.294462:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562617.294524:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652936064:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 400us (814us total) trans 21474843643 rc 0/0 00000100:00100000:1.0:1786562617.294532:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17936 00000100:00100000:2.0:1786562617.297808:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562617.297924:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652936320 00000100:00100000:0.0:1786562617.297945:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652936320 00000100:00100000:0.0:1786562617.298073:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6331 00000100:00100000:0.0:1786562617.298085:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881db6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:67859:x1873345652936320:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:0.0:1786562617.298164:0:35899:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4e4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0585 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd38c expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.298220:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.298234:0:35899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.298242:0:35899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.298278:0:35899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.298290:0:35899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 18 pid: 33115 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562617.298303:0:35899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9922d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654916352:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562617.298523:0:35899:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baedd540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562617.303364:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562617.303574:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652936448 00000100:00100000:2.0:1786562617.303583:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652936448 00010000:00010000:2.0:1786562617.303626:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 19 pid: 33115 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562617.303684:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8771 00000100:00100000:2.0:1786562617.303694:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652936448:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562617.303710:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562617.303717:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 19 pid: 33115 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.303731:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 19 pid: 33115 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.303754:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:2.0:1786562617.303760:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.303770:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.303778:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.303797:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562617.303857:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652936448:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 165us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562617.303875:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8771 00010000:00010000:0.0:1786562617.304756:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a05a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd393 expref: 18 pid: 33115 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562617.304790:0:35899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9922d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654916352:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562617.304814:0:35899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.304822:0:35899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.304831:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562617.305796:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4400, 88 off357008 00000004:00080000:0.0:1786562617.305810:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049747803761ns, next at 1047114106065ns, rc = 0 00000040:00080000:0.0:1786562617.305844:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4401, 88 off357096 00000004:00080000:0.0:1786562617.305849:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049747842838ns, next at 1047114106065ns, rc = 0 00000040:00080000:0.0:1786562617.307189:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4429, 88 off359688 00000004:00080000:0.0:1786562617.307207:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049749200980ns, next at 1049034642335ns, rc = 0 00000040:00080000:0.0:1786562617.307284:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4430, 88 off359776 00000004:00080000:0.0:1786562617.307290:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049749284435ns, next at 1049034642335ns, rc = 0 00000004:00010000:1.0:1786562617.371497:0:35899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1d73213 reply state 0000000067455661 transno 8589950794 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.371518:0:35899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786562617.371531:0:35899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562617.371535:0:35899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562617.371545:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0585 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd38c expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.371794:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881db6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:67859:x1873345652936320:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 73711us (73995us total) trans 8589950794 rc 0/0 00000100:00100000:1.0:1786562617.371805:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6331 00000001:00080000:2.0:1786562617.372085:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950794 is committed 00000004:00080000:2.0:1786562617.372093:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2933 committed 00000004:00080000:2.0:1786562617.372104:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2932 committed 00000004:00080000:2.0:1786562617.372107:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2903 committed 00000004:00080000:2.0:1786562617.372115:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2902 committed 00000100:00100000:2.0:1786562617.372223:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654916480:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1786562617.372282:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.372292:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.372299:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.372305:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.372309:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562617.372657:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562617.372715:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562617.372721:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654916608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562617.372745:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562617.372777:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654916480 00000100:00100000:2.0:1786562617.372785:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654916480 00000100:00100000:2.0:1786562617.372821:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654916608 00000100:00100000:2.0:1786562617.372823:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654916608 00000100:00100000:2.0:1786562617.372843:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17937 00000100:00100000:2.0:1786562617.372851:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654916480:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1786562617.373074:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.373091:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9bc2a2200) 00010000:00010000:3.0:1786562617.373094:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562617.373098:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.373106:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0611 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.373184:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17938 00000100:00100000:1.0:1786562617.373193:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654916608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562617.373492:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562617.373496:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb mtime from disk: 1786562616 -> 1786562616 00002000:00010000:1.0:1786562617.373500:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562617.373503:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb ctime from disk: 1786562616 -> 1786562616 00002000:00010000:1.0:1786562617.373505:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x721:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562617.373558:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654916608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 366us (811us total) trans 17179876125 rc 0/0 00000100:00100000:1.0:1786562617.373566:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17938 00002000:00010000:2.0:1786562617.373723:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562617.373727:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb mtime from disk: 1786562616 -> 1786562616 00002000:00010000:2.0:1786562617.373729:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562617.373731:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb ctime from disk: 1786562616 -> 1786562616 00002000:00010000:2.0:1786562617.373733:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x720:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562617.373760:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654916480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 910us (1103us total) trans 17179876126 rc 0/0 00000100:00100000:2.0:1786562617.373767:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17937 00000100:00100000:2.0:1786562617.373922:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654916864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562617.374767:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562617.374796:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562617.374804:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654916736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562617.374826:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562617.376581:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654916864 00000100:00100000:2.0:1786562617.376593:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654916864 00000100:00100000:2.0:1786562617.376643:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654916736 00000100:00100000:2.0:1786562617.376647:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654916736 00000100:00100000:2.0:1786562617.376687:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17939 00000100:00100000:2.0:1786562617.376697:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654916864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562617.376954:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562617.376958:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb mtime from disk: 1786562615 -> 1786562615 00002000:00010000:2.0:1786562617.376961:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb atime from disk: 1786562615 -> 1786562615 00002000:00010000:2.0:1786562617.376963:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb ctime from disk: 1786562616 -> 1786562616 00002000:00010000:2.0:1786562617.376966:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73d:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:2.0:1786562617.377047:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654916864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 351us (2280us total) trans 21474843644 rc 0/0 00000100:00100000:2.0:1786562617.377055:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17939 00000100:00100000:2.0:1786562617.377073:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17940 00000100:00100000:2.0:1786562617.377079:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654916736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562617.377168:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1786562617.377171:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb mtime from disk: 1786562615 -> 1786562615 00002000:00010000:2.0:1786562617.377174:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb atime from disk: 1786562615 -> 1786562615 00002000:00010000:2.0:1786562617.377176:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb ctime from disk: 1786562616 -> 1786562616 00002000:00010000:2.0:1786562617.377178:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73c:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:2.0:1786562617.377203:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654916736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (2376us total) trans 21474843645 rc 0/0 00000100:00100000:2.0:1786562617.377210:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17940 00000100:00100000:2.0:1786562617.377255:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843641 gen 2 00000004:00080000:2.0:1786562617.377261:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1c000, transno 21474843640 00000004:00080000:2.0:1786562617.377269:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1c700, transno 21474843641 00000100:00100000:2.0:1786562617.377276:0:3292:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e883178380 x1873345654916736/t21474843645(21474843645) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562633 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786562617.377287:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883178380/2, rc 0, transno 21474843645 00000100:00100000:2.0:1786562617.377292:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654916736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1786562617.377303:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88317b800/2, rc 0, transno 21474843644 00000100:00100000:2.0:1786562617.377306:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654916864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562617.378534:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876120 gen 2 00000004:00080000:3.0:1786562617.378543:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8dea00, transno 17179876116 00000004:00080000:3.0:1786562617.378554:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f57800, transno 17179876117 00000004:00080000:3.0:1786562617.378557:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f56d80, transno 17179876118 00000004:00080000:3.0:1786562617.378560:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88bd1aa00, transno 17179876119 00000004:00080000:3.0:1786562617.378562:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88313e300, transno 17179876120 00000100:00100000:3.0:1786562617.378569:0:3289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e883179f80 x1873345654916608/t17179876125(17179876125) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562633 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786562617.378578:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883179f80/2, rc 0, transno 17179876125 00000100:00100000:3.0:1786562617.378583:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654916608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562617.378594:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88317b100/2, rc 0, transno 17179876126 00000100:00100000:3.0:1786562617.378598:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654916480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562617.378757:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.379788:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652936576 00000100:00100000:3.0:1786562617.379798:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652936576 00000100:00100000:3.0:1786562617.379860:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17312 00000100:00100000:3.0:1786562617.379879:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+13:67859:x1873345652936576:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562617.379900:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562617.379922:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf6668a0618 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3cb expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.380022:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf6668a0618 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3cb expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.380040:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf6668a0618 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3cb expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.380060:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:3.0:1786562617.380063:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562617.380066:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a2c00, rc 0) 00000100:00100000:3.0:1786562617.380121:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+14:67859:x1873345652936576:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 244us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562617.380129:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17312 00000004:00080000:3.0:1786562617.381595:0:33137:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 5 done 00000100:00100000:0.0:1786562617.388279:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562617.388642:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652936832 00000100:00100000:2.0:1786562617.388652:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652936832 00000100:00100000:2.0:1786562617.388800:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6332 00000100:00100000:2.0:1786562617.388812:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+14:67859:x1873345652936832:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562617.389159:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67859:x1873345652936832:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 350us (890us total) trans 8589950795 rc 0/0 00000100:00100000:2.0:1786562617.389168:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6332 00000100:00100000:0.0:1786562617.417583:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.417682:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652937088 00000100:00100000:3.0:1786562617.417692:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652937088 00000100:00100000:3.0:1786562617.417754:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17313 00000100:00100000:3.0:1786562617.417764:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67860:x1873345652937088:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562617.417791:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562617.417813:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf6668a061f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3d2 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.417898:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.417912:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.417922:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.417947:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.417955:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.417962:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418346:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418356:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418364:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418371:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.418375:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418382:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418394:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.418398:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.418402:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418409:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2000/0x5c655bf6668a0626 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418423:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418429:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418435:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418441:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a3400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.418443:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418453:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418461:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1e00) 00010000:00010000:3.0:1786562617.418463:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.418466:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418472:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3400/0x5c655bf6668a062d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418511:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf6668a061f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3d2 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418521:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.418523:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562617.418526:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a3800/0x5c655bf6668a061f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3d2 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.418534:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9813a3800, rc 0) 00000100:00100000:3.0:1786562617.418586:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67860:x1873345652937088:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 824us (1014us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562617.418594:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17313 00000100:00100000:1.0:1786562617.424101:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.424239:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652937216 00000100:00100000:3.0:1786562617.424250:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652937216 00000100:00100000:3.0:1786562617.424321:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17314 00000100:00100000:3.0:1786562617.424332:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67860:x1873345652937216:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562617.424417:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424433:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424446:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424462:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424469:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424476:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424848:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424869:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424877:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562617.424915:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:3.0:1786562617.424920:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562617.424940:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424953:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424960:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424967:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424973:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.424977:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424984:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.424997:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.425000:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.425035:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425041:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2a00/0x5c655bf6668a0634 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425056:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425063:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425069:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425074:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9813a2400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.425077:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425083:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425090:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1300) 00010000:00010000:3.0:1786562617.425093:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.425096:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425103:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2400/0x5c655bf6668a063b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425117:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425124:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425130:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425135:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.425138:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425144:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425152:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:3.0:1786562617.425154:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.425158:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.425164:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0642 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562617.425237:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67860:x1873345652937216:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 905us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562617.425247:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17314 00000100:00100000:0.0:1786562617.468266:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562617.468425:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652937472 00000100:00100000:2.0:1786562617.468436:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652937472 00000100:00100000:2.0:1786562617.468500:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17315 00000100:00100000:2.0:1786562617.468511:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67866:x1873345652937472:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562617.468535:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562617.468559:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0649 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3d9 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.468643:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.468670:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.468682:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.468699:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.468706:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.468713:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469126:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469135:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469142:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469148:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.469153:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469165:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469177:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562617.469180:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.469184:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469190:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0650 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469202:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469209:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469214:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469220:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.469223:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469229:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469236:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b6332800) 00010000:00010000:2.0:1786562617.469239:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.469241:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469247:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0657 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469283:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0649 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3d9 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469293:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562617.469295:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562617.469299:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0649 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3d9 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.469309:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc600, rc 0) 00000100:00100000:2.0:1786562617.469559:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67866:x1873345652937472:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1049us (1303us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562617.469568:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17315 00000100:00100000:0.0:1786562617.477572:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.477730:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652937600 00000100:00100000:1.0:1786562617.477741:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652937600 00000100:00100000:1.0:1786562617.477802:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17316 00000100:00100000:1.0:1786562617.477813:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67866:x1873345652937600:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562617.477903:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.477921:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.477944:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.477963:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.477971:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.477978:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.478648:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479424:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479439:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562617.479487:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:1.0:1786562617.479493:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562617.479510:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479526:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479533:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479540:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479546:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.479550:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479556:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479569:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.479572:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.479576:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479586:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a065e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479614:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479620:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479626:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479632:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.479635:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479640:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479647:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562617.479649:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.479652:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479672:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0665 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479698:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479705:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479711:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479716:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.479719:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479724:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479731:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:1.0:1786562617.479733:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.479736:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.479742:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a066c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.479995:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67866:x1873345652937600:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2177us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.480180:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17316 00000100:00100000:1.0:1786562617.520319:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562617.520466:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652937856 00000100:00100000:2.0:1786562617.520477:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652937856 00000100:00100000:2.0:1786562617.520542:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17317 00000100:00100000:2.0:1786562617.520552:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67874:x1873345652937856:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562617.520575:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562617.520599:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0673 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3e0 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.520690:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.520706:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.520719:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.520735:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.520743:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.520749:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521161:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521169:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521175:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521181:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.521184:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521191:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521203:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562617.521206:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.521211:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521218:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a067a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521231:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521236:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521242:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521247:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.521249:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521255:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521261:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b6332800) 00010000:00010000:2.0:1786562617.521263:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.521266:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521272:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0681 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521446:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0673 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3e0 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521466:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562617.521469:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562617.521473:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0673 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3e0 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.521483:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc600, rc 0) 00000100:00100000:2.0:1786562617.521543:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67874:x1873345652937856:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 992us (1245us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562617.521552:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17317 00000100:00100000:0.0:1786562617.527809:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.531177:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652937984 00000100:00100000:1.0:1786562617.531193:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652937984 00000100:00100000:1.0:1786562617.531368:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17318 00000100:00100000:1.0:1786562617.531379:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67874:x1873345652937984:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562617.531460:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531482:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531495:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531511:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531519:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531526:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531906:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531916:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531924:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562617.531959:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:1.0:1786562617.531963:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562617.531976:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.531989:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532000:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532040:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532047:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.532051:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532059:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532072:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.532075:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.532080:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532085:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0688 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532112:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532117:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532124:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532128:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.532131:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532136:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532142:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562617.532144:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.532147:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532152:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a068f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532177:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532183:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532188:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532193:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.532197:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532203:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532210:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:1.0:1786562617.532212:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.532216:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.532221:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0696 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.532311:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67874:x1873345652937984:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 932us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.532320:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17318 00000100:00100000:0.0:1786562617.567894:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.568045:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652938240 00000100:00100000:3.0:1786562617.568059:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652938240 00000100:00100000:3.0:1786562617.568114:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17319 00000100:00100000:3.0:1786562617.568123:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67879:x1873345652938240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562617.568143:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562617.568165:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a069d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3e7 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568245:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568262:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568276:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568291:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568299:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568310:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568646:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.568654:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569311:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569318:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.569323:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569331:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569344:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.569347:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.569351:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569358:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569372:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569378:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569385:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569391:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.569394:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569399:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569405:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1300) 00010000:00010000:3.0:1786562617.569408:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.569410:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569416:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569456:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a069d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3e7 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569466:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.569469:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562617.569472:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a069d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3e7 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.569481:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266000, rc 0) 00000100:00100000:2.0:1786562617.573295:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67879:x1873345652938240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5158us (5397us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562617.573309:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17319 00000100:00100000:2.0:1786562617.584150:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.586584:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652938368 00000100:00100000:1.0:1786562617.586600:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652938368 00000100:00100000:1.0:1786562617.586837:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17320 00000100:00100000:1.0:1786562617.586859:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67879:x1873345652938368:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562617.586969:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.586987:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.586999:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587032:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587040:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587047:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587376:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587386:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587394:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562617.587429:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:1.0:1786562617.587434:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562617.587446:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587459:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587466:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587473:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587479:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.587484:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587491:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587502:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.587505:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.587509:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587520:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587547:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587553:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587559:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587565:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.587567:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587573:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587579:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562617.587581:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.587584:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587589:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587613:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587620:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587626:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587632:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.587634:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587640:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587646:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:1.0:1786562617.587648:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.587650:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.587669:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06c0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.587762:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67879:x1873345652938368:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 913us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.587772:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17320 00000100:00100000:1.0:1786562617.637704:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.640388:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652938624 00000100:00100000:3.0:1786562617.640402:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652938624 00000100:00100000:3.0:1786562617.640508:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17321 00000100:00100000:3.0:1786562617.640519:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67885:x1873345652938624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562617.640539:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562617.640559:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a06c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3ee expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.640634:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.640648:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.640670:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.640686:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.640694:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.640701:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641056:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641065:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641071:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641079:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.641084:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641091:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641103:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.641106:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.641110:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641116:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a06ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641129:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641135:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641140:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641146:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.641149:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641154:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641165:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1300) 00010000:00010000:3.0:1786562617.641168:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.641171:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641178:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a06d5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641209:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a06c7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3ee expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641219:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.641221:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562617.641224:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a06c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3ee expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.641232:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266000, rc 0) 00000100:00100000:3.0:1786562617.641305:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67885:x1873345652938624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 788us (3613us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562617.641314:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17321 00000100:00100000:0.0:1786562617.648432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.648515:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652938752 00000100:00100000:1.0:1786562617.648526:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652938752 00000100:00100000:1.0:1786562617.648581:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17322 00000100:00100000:1.0:1786562617.648591:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67885:x1873345652938752:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562617.648685:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.648709:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.648721:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.648737:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.648744:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.648751:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649159:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649169:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649177:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562617.649210:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:1.0:1786562617.649214:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562617.649226:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649240:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649251:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649259:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649265:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.649270:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649277:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649289:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.649292:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.649297:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649303:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a06dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649329:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649335:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649342:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649346:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.649350:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649356:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649363:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562617.649365:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.649367:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649373:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a06e3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649396:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649402:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649408:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649413:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.649416:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649422:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649428:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:1.0:1786562617.649430:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.649433:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.649439:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a06ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.649523:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:67885:x1873345652938752:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 932us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.649533:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17322 00000100:00100000:2.0:1786562617.686965:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562617.691977:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652939008 00000100:00100000:0.0:1786562617.691997:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652939008 00000100:00100000:2.0:1786562617.692302:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17323 00000100:00100000:2.0:1786562617.692313:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67892:x1873345652939008:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562617.692334:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562617.692355:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a06f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3f5 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692429:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692443:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692459:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692473:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692481:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692487:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692835:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.692844:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693090:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693098:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.693103:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693110:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693125:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562617.693129:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.693132:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693140:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a06f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693154:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693161:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693166:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693171:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562617.693174:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693180:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693187:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b6332800) 00010000:00010000:2.0:1786562617.693190:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562617.693193:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693199:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a06ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693240:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a06f1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3f5 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693256:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562617.693258:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562617.693261:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a06f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3f5 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562617.693271:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfda00, rc 0) 00000100:00100000:2.0:1786562617.693350:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:67892:x1873345652939008:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1038us (6398us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562617.693359:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17323 00000100:00100000:2.0:1786562617.701703:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.701802:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652939136 00000100:00100000:1.0:1786562617.701813:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652939136 00000100:00100000:1.0:1786562617.701882:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17324 00000100:00100000:1.0:1786562617.701893:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67892:x1873345652939136:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562617.701984:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702002:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702049:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702066:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702074:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702082:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702413:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702424:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702432:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562617.702465:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:1.0:1786562617.702470:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562617.702481:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702494:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702501:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702508:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702514:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.702518:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702525:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702537:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.702540:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.702544:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702555:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0706 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702582:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702588:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702594:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702599:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.702602:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702607:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702613:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562617.702616:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.702618:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702624:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a070d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702647:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702667:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702674:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702679:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.702681:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702687:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702694:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:1.0:1786562617.702696:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.702699:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.702706:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0714 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562617.702778:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:67892:x1873345652939136:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 885us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562617.702787:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17324 00000100:00100000:0.0:1786562617.751755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.751846:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652939392 00000100:00100000:3.0:1786562617.751863:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652939392 00000100:00100000:3.0:1786562617.752064:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17325 00000100:00100000:3.0:1786562617.752076:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67900:x1873345652939392:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562617.752098:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562617.752119:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a071b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd3fc expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752199:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752212:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752223:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752237:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752244:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752251:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752559:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752568:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752575:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752581:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.752585:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752597:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752610:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.752613:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.752617:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752624:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0722 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752636:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752642:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752648:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752667:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.752669:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752675:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752681:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1300) 00010000:00010000:3.0:1786562617.752683:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.752686:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752692:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0729 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752723:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a071b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3fc expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752734:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.752736:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562617.752739:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a071b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3fc expref: 16 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.752748:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266000, rc 0) 00000100:00100000:3.0:1786562617.752815:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:67900:x1873345652939392:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 742us (1070us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562617.755723:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17325 00000100:00100000:2.0:1786562617.764777:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562617.764998:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652939520 00000100:00100000:0.0:1786562617.765045:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652939520 00000100:00100000:0.0:1786562617.765133:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17326 00000100:00100000:0.0:1786562617.765145:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67900:x1873345652939520:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562617.765219:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765236:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765247:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765262:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765269:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765276:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765591:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765600:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765608:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562617.765640:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:0.0:1786562617.765644:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562617.765677:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765690:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765701:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765707:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765714:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562617.765718:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765725:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765736:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:0.0:1786562617.765739:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562617.765743:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765749:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0730 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765760:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765765:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765770:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765776:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562617.765779:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765785:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765792:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b46abc00) 00010000:00010000:0.0:1786562617.765794:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562617.765797:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765802:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0737 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765816:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765821:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765826:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765830:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562617.765833:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765839:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765846:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:0.0:1786562617.765848:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562617.765864:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562617.765869:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a073e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562617.765956:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:67900:x1873345652939520:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 812us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562617.765964:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17326 00000100:00100000:2.0:1786562617.811284:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562617.811357:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652939776 00000100:00100000:1.0:1786562617.811368:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652939776 00000100:00100000:1.0:1786562617.811429:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17327 00000100:00100000:1.0:1786562617.811439:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67903:x1873345652939776:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562617.811460:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562617.811480:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0745 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd403 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811560:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811575:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811586:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811600:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811607:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811614:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.811991:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812001:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812032:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812039:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.812044:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812057:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812070:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.812074:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.812078:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812085:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a074c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812110:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812116:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812123:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812128:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562617.812130:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812136:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812143:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562617.812145:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562617.812148:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812154:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0753 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812187:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0745 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd403 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812197:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:1.0:1786562617.812200:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562617.812203:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0745 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd403 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562617.812223:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1200, rc 0) 00000100:00100000:1.0:1786562617.812292:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:67903:x1873345652939776:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 855us (1020us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562617.812299:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17327 00000100:00100000:1.0:1786562617.814742:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562617.814821:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652939904 00000100:00100000:3.0:1786562617.814830:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652939904 00000100:00100000:3.0:1786562617.814893:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17328 00000100:00100000:3.0:1786562617.814902:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:67903:x1873345652939904:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562617.814984:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815000:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815047:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815068:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815075:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815082:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815386:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815395:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815403:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562617.815436:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:3.0:1786562617.815440:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562617.815452:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815465:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815472:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815479:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815490:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.815496:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815503:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815513:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562617.815516:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.815519:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815526:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a075a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815537:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815544:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815550:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815555:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.815558:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815564:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815575:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e999bb1300) 00010000:00010000:3.0:1786562617.815577:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.815580:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815585:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0761 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815597:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815603:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815608:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815613:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562617.815616:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815622:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815628:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:3.0:1786562617.815630:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562617.815633:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562617.815639:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a0768 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562617.815729:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:67903:x1873345652939904:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 827us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562617.815737:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17328 00010000:00010000:2.0:1786562618.149731:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562619.173344:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562619.712079:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562619.712124:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562619.712162:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562619.712186:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562619.712272:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940160 00000100:00100000:3.0:1786562619.712273:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940288 00000100:00100000:3.0:1786562619.712283:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940288 00000100:00100000:0.0:1786562619.712284:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940160 00000100:00100000:1.0:1786562619.712347:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940032 00000100:00100000:1.0:1786562619.712352:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940032 00000100:00100000:1.0:1786562619.712398:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 286 00000100:00100000:3.0:1786562619.712408:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940416 00000100:00100000:1.0:1786562619.712411:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652940032:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562619.712414:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940416 00000100:00100000:1.0:1786562619.712635:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652940032:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 227us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562619.712644:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 286 00000100:00100000:1.0:1786562619.712684:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 484 00000100:00100000:1.0:1786562619.712692:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652940288:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562619.712724:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652940288:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562619.712731:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 484 00000100:00100000:0.0:1786562619.714746:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 335 00000100:00100000:0.0:1786562619.714765:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652940160:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562619.714849:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652940160:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562619.714857:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 335 00000100:00100000:3.0:1786562619.719034:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 485 00000100:00100000:3.0:1786562619.719053:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652940416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562619.719161:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652940416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 113us (6974us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562619.719169:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 485 00000100:00080000:2.0:1786562619.720682:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562619.720692:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562619.720695:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562620.198330:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562620.712213:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654916992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562620.712323:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562620.712475:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654916992 00000100:00100000:0.0:1786562620.712487:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654916992 00000100:00080000:1.0:1786562620.712538:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562620.712585:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1786562620.712605:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654916992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562620.712657:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 519897088 pending 0 free 3835691008 avail 3833593856 00000100:00100000:0.0:1786562620.712713:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654916992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562620.712721:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1786562620.712733:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654917248:0@lo:400:kworker.0 00000100:00100000:2.0:1786562620.712773:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562620.712806:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562620.712812:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654917376:0@lo:400:kworker.0 00000100:00100000:2.0:1786562620.712847:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562620.712881:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654917248 00000100:00100000:2.0:1786562620.712881:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654917120:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.712885:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654917248 00000100:00100000:2.0:1786562620.712916:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562620.712920:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654917376 00000100:00100000:3.0:1786562620.712923:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654917376 00000100:00100000:2.0:1786562620.712940:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654917632:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.712943:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1786562620.712950:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654917248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562620.712962:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562620.712983:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562620.712988:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654917504:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.712989:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654917248:12345-0@lo:400:kworker.0 Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562620.712996:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1786562620.713036:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654917632 00000100:00100000:3.0:1786562620.713040:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654917632 00000100:00100000:2.0:1786562620.713047:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562620.713060:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1786562620.713066:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654917376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562620.713075:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654917120 00000100:00100000:2.0:1786562620.713078:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654917120 00000100:00100000:3.0:1786562620.713098:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654917376:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562620.713105:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1786562620.713105:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1786562620.713111:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654917120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.713115:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1786562620.713119:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654917632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562620.713144:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654917120:12345-0@lo:400:kworker.0 Request processed in 33us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562620.713151:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1786562620.713198:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654917504 00000100:00100000:2.0:1786562620.713202:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654917504 00000100:00100000:2.0:1786562620.713243:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1786562620.713251:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654917504:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786562620.713357:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562620.713362:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562620.713960:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562620.713974:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654917760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562620.714039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562620.714130:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654917760 00000100:00100000:1.0:1786562620.714136:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654917760 00000100:00100000:1.0:1786562620.714193:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1786562620.714202:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3292:x1873345654917760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562620.714235:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 46202880 pending 0 free 3844079616 avail 3841982464 00000100:00100000:1.0:1786562620.714285:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3292:x1873345654917760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562620.714292:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1786562620.714345:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654917760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562620.716695:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654916992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562620.721998:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654917632:12345-0@lo:400:kworker.0 Request processed in 8863us (9019us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562620.722032:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1786562620.723172:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654917376:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.723195:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654917248:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.724217:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654917504:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.724236:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654917120:0@lo:400:kworker.0 00000100:00100000:3.0:1786562620.724251:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654917632:0@lo:400:kworker.0 00000100:00100000:2.0:1786562620.724407:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654917504:12345-0@lo:400:kworker.0 Request processed in 11153us (11356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562620.724424:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00010000:00010000:0.0:1786562621.223092:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562622.250712:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562622.325733:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843642 is committed 00000001:00080000:1.0:1786562622.325775:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843643 is committed 00000001:00080000:1.0:1786562622.325792:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843645 is committed 00000001:00080000:2.0:1786562622.336401:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876125 is committed 00000001:00080000:2.0:1786562622.336417:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876124 is committed 00000001:00080000:2.0:1786562622.336438:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876126 is committed 00000001:00080000:2.0:1786562622.799673:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950795 is committed 00000100:00100000:1.0:1786562622.911939:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562622.912061:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940544 00000100:00100000:2.0:1786562622.912072:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940544 00000100:00100000:2.0:1786562622.912138:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17329 00000100:00100000:2.0:1786562622.912149:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:68321:x1873345652940544:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1786562622.912171:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562622.912202:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a076f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd40a expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912266:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912282:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912294:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912308:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912316:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912322:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912895:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912906:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912913:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562622.912952:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e4:0x0]: returning size 2097152 00000004:00200000:2.0:1786562622.912956:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562622.912975:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912988:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.912996:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562622.913112:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562622.913254:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913263:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913270:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562622.913274:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913281:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913294:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:2.0:1786562622.913298:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562622.913302:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913310:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0776 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913329:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913336:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913512:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913519:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562622.913522:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913528:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913537:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b6332e00) 00010000:00010000:2.0:1786562622.913539:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562622.913542:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913548:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a077d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913596:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a076f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd40a expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913610:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd40a expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.913622:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:2.0:1786562622.913624:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562622.913627:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfda00, rc 0) 00000100:00100000:0.0:1786562622.913766:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:68321:x1873345652940544:12345-192.168.204.29@tcp:101:rm.0 Request processed in 1613us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562622.913776:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17329 00000100:00100000:1.0:1786562622.917341:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562622.917437:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940800 00000100:00100000:2.0:1786562622.917456:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940800 00000100:00100000:2.0:1786562622.917573:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17330 00000100:00100000:2.0:1786562622.917587:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:68321:x1873345652940800:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:2.0:1786562622.917664:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786562622.917699:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0784 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd40a expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917727:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9813a2c00/0x5c655bf6668a0618 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3cb expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917743:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:2.0:1786562622.917755:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562622.917785:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917800:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917811:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917831:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917856:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.917863:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562622.922240:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562622.922267:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562622.922280:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562622.935689:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4402, 64 off357160 00000004:00080000:3.0:1786562622.935714:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1055377707440ns, next at 1056377701757ns, rc = 0 00000040:00080000:3.0:1786562622.935741:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4403, 64 off357224 00000040:00080000:3.0:1786562622.936200:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4431, 64 off359840 00000004:00080000:3.0:1786562622.936215:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1055378208565ns, next at 1056378205628ns, rc = 0 00000040:00080000:3.0:1786562622.936243:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4432, 64 off359904 00010000:00010000:3.0:1786562622.936406:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936429:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936446:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936457:0:33115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936465:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936472:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936506:0:33115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786562622.936544:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936561:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562622.936566:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936582:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936586:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936591:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562622.936602:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936618:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562622.936624:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936627:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936657:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46abc00) 00010000:00010000:2.0:1786562622.936658:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936669:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786562622.936681:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936691:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0799 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936699:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e4:0x0].0x0 (ffff90e9b46abc00) 00010000:00010000:2.0:1786562622.936706:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786562622.936714:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936722:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a07a0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936727:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.936738:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562622.936757:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562622.936761:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562622.936763:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562622.936992:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.937216:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562622.937222:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.937230:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.937243:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0x0 (ffff90e9b46ab800) 00010000:00010000:3.0:1786562622.937246:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562622.937249:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.937255:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a078b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562622.937273:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a892e8aa reply state 00000000ded85784 transno 8589950796 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562622.937289:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562622.937516:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:68321:x1873345652940800:12345-192.168.204.29@tcp:36:rm.0 Request processed in 19925us (20185us total) trans 8589950796 rc 0/0 00000100:00100000:3.0:1786562622.937527:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17330 00010000:00010000:3.0:1786562622.944583:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.944603:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.944611:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.944617:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562622.944622:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.944630:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.944652:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e3:0x0].0xe563034c (ffff90e9b6332d00) 00010000:00010000:3.0:1786562622.944656:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562622.944661:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562622.944667:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0792 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e3:0x0].0xe563034c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562623.269319:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562624.295462:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786562624.796856:0:38564:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 204c: FLR write/stale/resync test with component removal ========================================================== 15:23:42 (1786562622) 00000100:00100000:1.0:1786562624.833486:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562624.833546:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562624.833626:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562624.833658:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562624.833700:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941056 00000100:00100000:3.0:1786562624.833711:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941056 00000100:00100000:3.0:1786562624.833781:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 339 00000100:00100000:3.0:1786562624.833794:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:2350:x1873345652941056:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562624.833878:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:2350:x1873345652941056:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 87us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562624.833887:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 339 00000100:00100000:1.0:1786562624.834115:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652940928 00000100:00100000:1.0:1786562624.834120:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652940928 00000100:00100000:1.0:1786562624.834152:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 288 00000100:00100000:1.0:1786562624.834160:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652940928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562624.834212:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652940928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 54us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562624.834219:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 288 00000100:00080000:1.0:1786562624.834247:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562624.834642:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941312 00000100:00100000:0.0:1786562624.834648:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941312 00000100:00100000:0.0:1786562624.834689:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941184 00000100:00100000:0.0:1786562624.834693:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941184 00000100:00100000:0.0:1786562624.834718:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 487 00000100:00100000:0.0:1786562624.834726:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652941312:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562624.834766:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652941312:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 41us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562624.834772:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 487 00000100:00100000:0.0:1786562624.834789:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 488 00000100:00100000:0.0:1786562624.834797:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652941184:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562624.834825:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652941184:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562624.834835:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 488 00000100:00080000:1.0:1786562624.834895:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562624.834899:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562625.117304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562625.118550:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941568 00000100:00100000:3.0:1786562625.118569:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941568 00000100:00100000:3.0:1786562625.118662:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17331 00000100:00100000:3.0:1786562625.118674:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:68483:x1873345652941568:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:3.0:1786562625.118758:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562625.118971:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850caa00/0x5c655bf6668a035c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd2f9 expref: 14 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.119045:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562625.119178:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562625.119743:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.122124:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.122168:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.122211:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.122226:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.122234:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562625.146446:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e6:0x0]: returning size 512 00010000:00010000:2.0:1786562625.146476:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.146491:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.146500:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.146517:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.146522:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.146531:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.146553:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1300) 00010000:00010000:2.0:1786562625.146557:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.146564:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.146571:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a07a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562625.146601:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d1de28d reply state 000000007b4d5f69 transno 8589950797 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562625.146612:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562625.147445:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:68483:x1873345652941568:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 28764us (34671us total) trans 8589950797 rc 0/0 00000100:00100000:2.0:1786562625.147458:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17331 00010000:00010000:2.0:1786562625.151858:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.151899:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.151908:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.151915:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.151922:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.151931:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.151953:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4fb8ef17 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562625.151957:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.151962:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.151968:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a07ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562625.183411:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562625.183836:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941696 00000100:00100000:0.0:1786562625.183851:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941696 00000100:00100000:0.0:1786562625.184289:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17332 00000100:00100000:0.0:1786562625.184304:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+14:68487:x1873345652941696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562625.184345:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562625.184387:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a07b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd411 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.184487:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a07bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.184516:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a07bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.184532:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a07bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562625.184630:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562625.184634:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 41 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562625.184665:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a07bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.184697:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a07b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd411 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.184738:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a07bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd411 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.184755:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:0.0:1786562625.184758:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562625.184763:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268a00, rc 0) 00000100:00100000:0.0:1786562625.184867:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:68487:x1873345652941696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 568us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562625.184876:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17332 00000100:00100000:1.0:1786562625.187246:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562625.187345:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941824 00000100:00100000:3.0:1786562625.187357:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941824 00000100:00100000:3.0:1786562625.187435:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17333 00000100:00100000:3.0:1786562625.187449:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:68487:x1873345652941824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562625.187479:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562625.187517:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a07c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd418 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.187929:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.187947:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.187962:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.187981:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.187988:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.187996:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188390:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a07d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188400:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a07d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188409:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a07d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562625.188450:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e6:0x0]: returning size 512 00000004:00200000:2.0:1786562625.188455:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562625.188485:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a07d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188502:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188519:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188527:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188533:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.188538:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188546:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188561:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:2.0:1786562625.188565:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.188571:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188646:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a07ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188838:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188847:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188858:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188864:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.188867:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188874:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188882:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4fb8ef17 (ffff90e999bb1d00) 00010000:00010000:2.0:1786562625.188885:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.188888:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188894:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a07d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4fb8ef17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188939:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a07c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd418 expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188956:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd800/0x5c655bf6668a07d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd418 expref: 16 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.188964:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562625.188966:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786562625.188968:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd800, rc 0) 00000100:00100000:2.0:1786562625.189227:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:68487:x1873345652941824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1779us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562625.189240:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17333 00000100:00100000:2.0:1786562625.196411:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562625.196555:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652941952 00000100:00100000:3.0:1786562625.196569:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652941952 00000100:00100000:3.0:1786562625.196916:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17334 00000100:00100000:3.0:1786562625.196930:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:68487:x1873345652941952:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562625.196960:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562625.196990:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a07df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd41f expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197120:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197140:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197165:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197184:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197192:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197200:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197294:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197301:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197309:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197315:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562625.197320:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197327:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197342:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562625.197345:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562625.197351:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197358:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a07e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197375:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197381:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197387:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197393:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562625.197396:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197402:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197415:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e999bb1c00) 00010000:00010000:3.0:1786562625.197417:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562625.197420:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197426:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a07ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197464:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a07df lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd41f expref: 17 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197476:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562625.197478:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562625.197482:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a07df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd41f expref: 17 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.197494:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267800, rc 0) 00000100:00100000:3.0:1786562625.197602:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+16:68487:x1873345652941952:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 674us (1205us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562625.197611:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17334 00000100:00100000:1.0:1786562625.202390:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562625.202561:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652942080 00000100:00100000:2.0:1786562625.203156:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652942080 00000100:00100000:2.0:1786562625.203278:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17335 00000100:00100000:2.0:1786562625.203294:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:68487:x1873345652942080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562625.203325:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562625.203352:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a07f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd426 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203446:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203464:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203478:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203496:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203513:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203520:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203620:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203629:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203637:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203644:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.203649:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203656:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203672:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562625.203675:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.203681:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203688:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a07fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203913:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203922:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203928:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203934:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.203938:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203945:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203954:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332800) 00010000:00010000:2.0:1786562625.203957:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.203961:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.203967:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0802 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.204122:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a07f4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd426 expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.204135:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562625.204138:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.204141:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a07f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd426 expref: 17 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.204154:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562625.204288:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:68487:x1873345652942080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 999us (1912us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562625.204297:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17335 00000100:00100000:1.0:1786562625.210380:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562625.210491:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652942208 00000100:00100000:0.0:1786562625.210516:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652942208 00000100:00100000:0.0:1786562625.210599:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17336 00000100:00100000:0.0:1786562625.210613:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:68487:x1873345652942208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562625.210645:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562625.210680:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd42d expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.210965:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0810 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.210984:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0810 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.210998:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0810 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562625.211129:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e6:0x0]: returning size 512 00000004:00200000:0.0:1786562625.211134:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562625.211162:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0810 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.211202:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd42d expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.211227:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0810 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd42d expref: 17 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.211237:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562625.211241:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562625.211245:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562625.211323:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68487:x1873345652942208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 713us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562625.211331:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17336 00000100:00100000:3.0:1786562625.216059:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562625.216270:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652942336 00000100:00100000:2.0:1786562625.216288:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652942336 00000100:00100000:2.0:1786562625.216371:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17337 00000100:00100000:2.0:1786562625.216384:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:68487:x1873345652942336:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562625.216415:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562625.216444:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0817 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd434 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216553:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216570:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216584:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216600:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216608:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216615:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216704:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216713:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216721:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216728:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.216734:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216744:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216759:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562625.216763:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.216768:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216775:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a081e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216788:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216795:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216801:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216806:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.216809:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216815:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216822:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332800) 00010000:00010000:2.0:1786562625.216825:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.216828:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216835:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0825 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216882:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0817 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd434 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216905:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562625.216908:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562625.216912:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0817 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd434 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.216923:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562625.217054:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:68487:x1873345652942336:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 672us (1007us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562625.217063:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17337 00000100:00100000:1.0:1786562625.221436:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562625.222784:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652942592 00000100:00100000:3.0:1786562625.222803:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652942592 00000100:00100000:3.0:1786562625.222884:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17338 00000100:00100000:3.0:1786562625.222895:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:68487:x1873345652942592:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562625.222919:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562625.222922:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562625.222953:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0810 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd42d expref: 17 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.222977:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562625.222983:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562625.222998:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a082c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd43b expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.223463:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.223489:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.223514:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.223535:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.223543:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.223550:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227399:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227424:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227439:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562625.227454:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 0 00010000:00010000:0.0:1786562625.227491:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227499:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227519:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227526:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562625.227532:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227540:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227556:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562625.227559:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562625.227565:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227587:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0833 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562625.227605:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff7d1f81 reply state 000000003db89dd5 transno 8589950798 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562625.227616:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562625.227666:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a082c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227687:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 18 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.227695:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:0.0:1786562625.227697:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562625.227712:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269200, rc 0) 00000100:00100000:0.0:1786562625.227828:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:68487:x1873345652942592:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4933us (6412us total) trans 8589950798 rc 0/0 00000100:00100000:0.0:1786562625.227839:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17338 00000100:00100000:1.0:1786562625.234638:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562625.234854:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652942848 00000100:00100000:0.0:1786562625.234871:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652942848 00000100:00100000:0.0:1786562625.234972:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17339 00000100:00100000:0.0:1786562625.234985:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:68487:x1873345652942848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562625.235053:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562625.235083:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a084f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd442 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.235252:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.235271:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235276:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.235281:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235286:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235293:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235300:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.235305:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235317:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562625.235325:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235335:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b46abf00) 00010000:00010000:2.0:1786562625.235339:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562625.235340:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 1157 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235344:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.235350:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a083a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562625.235356:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654917888:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562625.235493:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce3840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562625.251545:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562625.251676:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652942976 00000100:00100000:3.0:1786562625.251698:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652942976 00010000:00010000:3.0:1786562625.251778:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 1157 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562625.251838:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8772 00000100:00100000:3.0:1786562625.251850:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345652942976:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562625.251870:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562625.251879:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 1157 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.251894:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 1157 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562625.252036:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654917888:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562625.252048:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0841 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd43b expref: 20 pid: 34450 timeout: 1157 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.252071:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:3.0:1786562625.252078:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.252091:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.252832:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.256807:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.256870:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562625.256875:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562625.256879:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562625.256905:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 0 00000100:00100000:3.0:1786562625.257034:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652942976:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5146us (5462us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562625.257052:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8772 00000004:00080000:2.0:1786562625.259321:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73e:0x0], index 0: 0 00000004:00080000:2.0:1786562625.259340:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x722:0x0], index 1: 0 00010000:00010000:2.0:1786562625.260323:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260340:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260353:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260360:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562625.260365:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260373:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260390:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:2.0:1786562625.260394:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562625.260398:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260405:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0856 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260858:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a084f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd442 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260872:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562625.260875:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562625.260880:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a084f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd442 expref: 19 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562625.260892:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:2.0:1786562625.260984:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:68487:x1873345652942848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 26001us (26354us total) trans 8589950799 rc 301/301 00000100:00100000:2.0:1786562625.260999:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17339 00000100:00100000:0.0:1786562625.264284:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562625.264414:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652943232 00000100:00100000:1.0:1786562625.264423:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652943232 00000100:00100000:1.0:1786562625.264491:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6333 00000100:00100000:1.0:1786562625.264501:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:68487:x1873345652943232:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562625.264987:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:68487:x1873345652943232:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 487us (713us total) trans 8589950800 rc 0/0 00000100:00100000:1.0:1786562625.264997:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6333 00000100:00100000:3.0:1786562625.273545:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562625.273681:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652943488 00000100:00100000:2.0:1786562625.273698:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652943488 00000100:00100000:2.0:1786562625.273782:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6334 00000100:00100000:2.0:1786562625.273793:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:68487:x1873345652943488:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562625.274069:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:68487:x1873345652943488:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 277us (3135us total) trans 8589950801 rc 0/0 00000100:00100000:2.0:1786562625.274077:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6334 00010000:00010000:0.0:1786562625.317189:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786562625.829155:0:33136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1058271146378ns, next at 1059271143808ns, rc = 0 00000100:00100000:1.0:1786562625.829179:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654918016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562625.829257:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562625.829307:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918016 00000100:00100000:0.0:1786562625.829316:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918016 00000004:00080000:1.0:1786562625.829368:0:33139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1058271362280ns, next at 1059271361432ns, rc = 0 00000100:00100000:0.0:1786562625.829373:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1786562625.829380:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786562625.829382:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654918016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562625.829388:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654918144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562625.829415:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1786562625.829415:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 519897088 pending 0 free 3835691008 avail 3833593856 00000100:00100000:0.0:1786562625.829472:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654918016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562625.829479:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1786562625.829505:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918144 00000100:00100000:0.0:1786562625.829509:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918144 00000100:00100000:0.0:1786562625.829527:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1786562625.829532:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654918144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562625.829552:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 46202880 pending 0 free 3844079616 avail 3841982464 00000100:00100000:0.0:1786562625.829586:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654918144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562625.829592:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:0.0:1786562625.829609:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562625.829612:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562625.829643:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876126 gen 2 00000004:00080000:0.0:1786562625.829648:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179f80, transno 17179876125 00000004:00080000:0.0:1786562625.829658:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88317b100, transno 17179876126 00000100:00100000:0.0:1786562625.829668:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654918144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562625.830195:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843645 gen 2 00000004:00080000:1.0:1786562625.830298:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88317b800, transno 21474843644 00000004:00080000:1.0:1786562625.830316:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883178380, transno 21474843645 00000100:00100000:1.0:1786562625.830325:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654918016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562625.830517:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654918272:0@lo:400:kworker.0 00000100:00100000:2.0:1786562625.830563:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562625.830797:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654918656:0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.830828:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562625.830858:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654918528:0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.830879:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562625.830907:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562625.830913:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654918400:0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.830933:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562625.831312:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918656 00000100:00100000:1.0:1786562625.831318:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918656 00000100:00100000:1.0:1786562625.831352:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918528 00000100:00100000:1.0:1786562625.831355:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918528 00000100:00100000:1.0:1786562625.831375:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918400 00000100:00100000:1.0:1786562625.831377:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918400 00000100:00100000:1.0:1786562625.831397:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1786562625.831404:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.831448:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654918656:12345-0@lo:400:kworker.0 Request processed in 44us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562625.831455:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1786562625.831473:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1786562625.831479:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.831523:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654918528:12345-0@lo:400:kworker.0 Request processed in 44us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562625.831529:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1786562625.831540:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1786562625.831545:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654918400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.831567:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654918400:12345-0@lo:400:kworker.0 Request processed in 22us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562625.831573:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1786562625.831592:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918272 00000100:00100000:1.0:1786562625.831595:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918272 00000100:00100000:1.0:1786562625.831627:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1786562625.831634:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654918272:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786562625.832101:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562625.834547:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654918656:0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.834934:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654918272:12345-0@lo:400:kworker.0 Request processed in 3295us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562625.834946:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1786562625.835039:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654918400:0@lo:400:kworker.0 00000100:00100000:1.0:1786562625.835053:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654918528:0@lo:400:kworker.0 00000100:00100000:2.0:1786562625.837394:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654918272:0@lo:400:kworker.0 00010000:00010000:0.0:1786562626.344213:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562627.366421:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786562627.936474:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2905 committed 00000001:00080000:1.0:1786562627.936507:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950798 is committed 00000004:00080000:1.0:1786562627.936517:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2935 committed 00000001:00080000:1.0:1786562627.936533:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950800 is committed 00000001:00080000:1.0:1786562627.936539:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950801 is committed 00000004:00080000:1.0:1786562627.936549:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2934 committed 00000004:00080000:1.0:1786562627.936552:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2904 committed 00000100:00100000:1.0:1786562627.936626:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654918912:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786562627.936701:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562627.936776:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562627.936784:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654919040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562627.936811:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562627.936878:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918912 00000100:00100000:3.0:1786562627.936887:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918912 00000100:00100000:1.0:1786562627.936911:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654919040 00000100:00100000:1.0:1786562627.936916:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654919040 00000100:00100000:1.0:1786562627.936970:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17941 00000100:00080000:0.0:1786562627.936977:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562627.936981:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654918912:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1786562627.936983:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562627.937045:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17942 00002000:00080000:1.0:1786562627.937046:0:37002:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1824 count 1 00000100:00100000:3.0:1786562627.937055:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654919040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786562627.937068:0:29966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1853 count 1 00010000:00010000:3.0:1786562627.937094:0:29966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.937116:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 9 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.937125:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x73d:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562627.937130:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.937135:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.937169:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 9 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562627.937180:0:37002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.937186:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 9 pid: 8368 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562627.937209:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562627.937210:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654919296:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562627.937223:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x720:0x0].0x0 since=11s v=(0 0) 00010000:00010000:1.0:1786562627.937227:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1786562627.937270:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786562627.937424:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562627.937464:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562627.937476:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 8 pid: 6659 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562627.937490:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654919424:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562627.937533:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e883396cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562627.938256:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654918784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786562627.938295:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562627.938328:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562627.938335:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654919168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786562627.938356:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562627.938385:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654918784 00000100:00100000:3.0:1786562627.938392:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654918784 00000100:00100000:3.0:1786562627.938422:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654919168 00000100:00100000:3.0:1786562627.938425:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654919168 00000100:00100000:3.0:1786562627.938442:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17943 00000100:00100000:3.0:1786562627.938460:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654918784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786562627.938482:0:12119:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1852 count 1 00010000:00010000:3.0:1786562627.938500:0:12119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938516:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 9 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938529:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x73c:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562627.938533:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.938537:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938561:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 9 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938571:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 9 pid: 29964 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562627.938582:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654919552:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562627.938624:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562627.938641:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17944 00000100:00100000:3.0:1786562627.938663:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654919168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786562627.938685:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1825 count 1 00010000:00010000:3.0:1786562627.938700:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938712:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 8 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938828:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x721:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1786562627.938832:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x721:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.938837:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938860:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 8 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.938870:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 8 pid: 29966 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562627.938881:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654919680:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562627.938905:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1786562627.944730:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562627.944960:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:37002:1873345654919424:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562627.944988:0:37002:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562627.945072:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654919552:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562627.945086:0:12119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562627.947489:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:29966:1873345654919296:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562627.947521:0:29966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562627.948052:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562627.948132:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562627.948249:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562627.948444:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652943616 00000100:00100000:2.0:1786562627.948466:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652943616 00000100:00100000:1.0:1786562627.948486:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652943872 00000100:00100000:1.0:1786562627.948493:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652943872 00010000:00010000:2.0:1786562627.948527:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 11 pid: 8368 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562627.948527:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 11 pid: 29964 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562627.948578:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652943744 00000100:00100000:2.0:1786562627.948582:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652943744 00010000:00010000:2.0:1786562627.948600:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 9 pid: 6659 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562627.948688:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8773 00000100:00100000:2.0:1786562627.948699:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652943616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562627.948714:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562627.948720:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 11 pid: 8368 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.948733:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 11 pid: 8368 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.948760:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c3b01d6/0x5c655bf6668a060a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->68157439) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3c4 expref: 11 pid: 8368 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.948791:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562627.948796:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562627.948803:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.948812:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.948853:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562627.948903:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652943616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 206us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562627.948911:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8773 00000100:00100000:3.0:1786562627.949201:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944000 00000100:00100000:3.0:1786562627.949207:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944000 00010000:00010000:3.0:1786562627.949226:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 10 pid: 29966 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562627.949295:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8774 00000100:00100000:3.0:1786562627.949302:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652943872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562627.949311:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562627.949316:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 9 pid: 29964 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949330:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 9 pid: 29964 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949345:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3bd expref: 9 pid: 29964 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949356:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.949359:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.949364:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949371:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949401:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562627.949430:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652943872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 129us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562627.949437:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8774 00000100:00100000:3.0:1786562627.949466:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8775 00000100:00100000:3.0:1786562627.949473:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345652943744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562627.949482:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562627.949488:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 10 pid: 6659 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949504:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 10 pid: 6659 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949519:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a9d3cc/0x5c655bf6668a05ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3af expref: 10 pid: 6659 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949530:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.949533:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x720:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.949537:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949545:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949564:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562627.949583:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652943744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 112us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562627.949590:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8775 00000100:00100000:3.0:1786562627.949603:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8776 00000100:00100000:3.0:1786562627.949609:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652944000:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562627.949617:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562627.949622:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 8 pid: 29966 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949638:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 8 pid: 29966 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949650:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x721:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.949653:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x721:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562627.949657:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949664:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.949673:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562627.949688:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652944000:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 80us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562627.949695:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8776 00010000:00010000:3.0:1786562627.949795:0:29662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b951fb/0x5c655bf6668a05f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd3b6 expref: 7 pid: 29966 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.949992:0:12119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.950022:0:12119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.950035:0:12119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.950043:0:12119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.950061:0:12119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562627.950661:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654918784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12210us (12363us total) trans 21474843646 rc 0/0 00000100:00100000:0.0:1786562627.950712:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17943 00000100:00080000:2.0:1786562627.950963:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562627.950968:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562627.951058:0:29966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951069:0:29966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951078:0:29966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951084:0:29966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951100:0:29966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786562627.951502:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654919040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14448us (14688us total) trans 21474843647 rc 0/0 00000100:00100000:2.0:1786562627.951510:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17942 00010000:00010000:2.0:1786562627.951532:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786562627.951538:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951546:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562627.951550:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951560:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951578:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951585:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a0872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.951605:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1786562627.951916:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:29662:1873345654919680:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562627.951938:0:29662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.951947:0:29662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.951960:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.951969:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.951976:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562627.951997:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562627.952000:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952027:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562627.952033:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952040:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562627.952044:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952051:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952063:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952070:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015488f3a/0x5c655bf6668a0879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952084:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562627.952086:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562627.952087:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562627.952234:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562627.952238:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952246:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952256:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952263:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059cba359/0x5c655bf6668a0864 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952276:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562627.952277:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562627.952280:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562627.952291:0:37002:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952299:0:37002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952307:0:37002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952314:0:37002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562627.952363:0:37002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786562627.952563:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562627.952569:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952577:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562627.952580:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952588:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952599:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952605:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a086b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562627.952629:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562627.952630:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562627.952632:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562627.953429:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654918912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16448us (16725us total) trans 17179876127 rc 0/0 00000100:00100000:2.0:1786562627.953440:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17941 00000100:00100000:3.0:1786562627.953915:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654919168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15266us (15556us total) trans 17179876128 rc 0/0 00000100:00100000:3.0:1786562627.953924:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17944 00000004:00080000:3.0:1786562627.953971:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e884115f80/2, rc 0, transno 17179876128 00000100:00100000:3.0:1786562627.953977:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654919168:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786562627.953990:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa17100/2, rc 0, transno 21474843646 00000100:00100000:3.0:1786562627.953994:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654918784:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1786562627.954071:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9baa15c00/2, rc 0, transno 21474843647 00000100:00100000:2.0:1786562627.954076:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654919040:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1786562627.954085:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e884115180/2, rc 0, transno 17179876127 00000100:00100000:2.0:1786562627.954088:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654918912:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786562627.955409:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562628.389188:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562629.413234:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562629.949847:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562629.949895:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562629.949929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562629.949967:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562629.950047:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944128 00000100:00100000:1.0:1786562629.950060:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944128 00000100:00100000:1.0:1786562629.950127:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 290 00000100:00100000:1.0:1786562629.950139:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652944128:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562629.950232:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652944128:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 94us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562629.950241:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 290 00000100:00100000:2.0:1786562629.950372:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944256 00000100:00100000:2.0:1786562629.950377:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944256 00000100:00100000:2.0:1786562629.950444:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 343 00000100:00100000:2.0:1786562629.950452:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:2349:x1873345652944256:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562629.950474:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944512 00000100:00100000:3.0:1786562629.950479:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944512 00000100:00100000:2.0:1786562629.950496:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+14:2349:x1873345652944256:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 46us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562629.950503:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 343 00000100:00100000:3.0:1786562629.950509:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944384 00000100:00100000:3.0:1786562629.950511:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944384 00000100:00100000:2.0:1786562629.950526:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 489 00000100:00100000:3.0:1786562629.950532:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 490 00000100:00100000:2.0:1786562629.950533:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652944512:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562629.950538:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652944384:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562629.950563:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652944512:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562629.950566:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652944384:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562629.950570:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 489 00000100:00100000:3.0:1786562629.950573:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 490 00000100:00080000:0.0:1786562629.951502:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562629.951511:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562629.951514:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562630.437637:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562630.949375:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562630.949426:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654919808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562630.949459:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562630.949485:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654919936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562630.949538:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562630.949581:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654919808 00000100:00100000:0.0:1786562630.949590:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654919808 00000100:00100000:0.0:1786562630.949666:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1786562630.949677:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654919808:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786562630.949704:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1786562630.949728:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 46202880 pending 0 free 3844079616 avail 3841982464 00000100:00100000:0.0:1786562630.949790:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654919808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562630.949798:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1786562630.949829:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562630.949881:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654919808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562630.950069:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654920320:0@lo:400:kworker.0 00000100:00100000:3.0:1786562630.950126:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654920192:0@lo:400:kworker.0 00000100:00100000:1.0:1786562630.950189:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654920448:0@lo:400:kworker.0 00000100:00100000:0.0:1786562630.953502:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654920064:0@lo:400:kworker.0 00000100:00100000:0.0:1786562630.953570:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562630.953608:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654920576:0@lo:400:kworker.0 00000100:00100000:0.0:1786562630.953636:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562630.953679:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654919936 00000100:00100000:0.0:1786562630.953686:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654919936 00000100:00100000:0.0:1786562630.953744:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1786562630.953754:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654919936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562630.953792:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 519897088 pending 0 free 3835691008 avail 3833593856 00000100:00080000:2.0:1786562630.953814:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562630.953852:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654919936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (4021us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562630.953861:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1786562630.953895:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920576 00000100:00100000:2.0:1786562630.953896:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562630.953903:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920576 00000100:00100000:0.0:1786562630.953939:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920320 00000100:00100000:0.0:1786562630.953942:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920320 00000100:00100000:0.0:1786562630.953974:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1786562630.953981:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654920576:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786562630.954146:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562630.954169:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1786562630.954184:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654920320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562630.955531:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654920320:12345-0@lo:400:kworker.0 Request processed in 1346us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562630.955545:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1786562630.955874:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654920320:0@lo:400:kworker.0 00000100:00100000:2.0:1786562630.956116:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654919936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562630.956164:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920064 00000100:00100000:2.0:1786562630.956172:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920064 00000100:00100000:2.0:1786562630.956215:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1786562630.956223:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654920064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562630.956281:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654920064:12345-0@lo:400:kworker.0 Request processed in 58us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562630.956287:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1786562630.956323:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654920064:0@lo:400:kworker.0 00000100:00100000:3.0:1786562630.959270:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562630.959461:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920192 00000100:00100000:2.0:1786562630.959472:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920192 00000100:00100000:2.0:1786562630.959906:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1786562630.959919:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654920192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562630.960038:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654920576:12345-0@lo:400:kworker.0 Request processed in 6012us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562630.960062:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:3.0:1786562630.960097:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562630.960153:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654920576:0@lo:400:kworker.0 00000100:00100000:2.0:1786562630.960295:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654920192:12345-0@lo:400:kworker.0 Request processed in 377us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562630.960304:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1786562630.960368:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654920192:0@lo:400:kworker.0 00000100:00100000:1.0:1786562630.960457:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562630.964466:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920448 00000100:00100000:0.0:1786562630.964481:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920448 00000100:00100000:0.0:1786562630.964550:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1786562630.964560:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654920448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562630.964659:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654920448:12345-0@lo:400:kworker.0 Request processed in 100us (4203us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562630.964667:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1786562630.965172:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654920448:0@lo:400:kworker.0 00010000:00010000:0.0:1786562631.462699:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562632.485258:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562632.566229:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843646 is committed 00000001:00080000:1.0:1786562632.566257:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843647 is committed 00000001:00080000:2.0:1786562632.581936:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876127 is committed 00000001:00080000:2.0:1786562632.581954:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876128 is committed 00010000:00010000:3.0:1786562633.509165:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562634.534608:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562635.066703:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562635.067946:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562635.067992:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562635.068061:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562635.068112:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652945024 00000100:00100000:3.0:1786562635.068123:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652945024 00000100:00100000:3.0:1786562635.068179:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944896 00000100:00100000:3.0:1786562635.068182:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944896 00000100:00100000:3.0:1786562635.068205:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 492 00000100:00100000:3.0:1786562635.068215:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652945024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562635.068288:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652945024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562635.068296:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 492 00000100:00100000:3.0:1786562635.068331:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 493 00000100:00100000:3.0:1786562635.068339:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652944896:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562635.068368:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652944896:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562635.068378:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 493 00000100:00080000:3.0:1786562635.068392:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562635.068396:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562635.069102:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944768 00000100:00100000:1.0:1786562635.069109:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944768 00000100:00100000:0.0:1786562635.069151:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652944640 00000100:00100000:0.0:1786562635.069157:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652944640 00000100:00100000:0.0:1786562635.069209:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 292 00000100:00100000:1.0:1786562635.069219:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 347 00000100:00100000:0.0:1786562635.069221:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652944640:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562635.069233:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:2351:x1873345652944768:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562635.069268:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652944640:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 50us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562635.069277:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:2351:x1873345652944768:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 47us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562635.069278:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 292 00000100:00100000:1.0:1786562635.069290:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 347 00000100:00080000:3.0:1786562635.069413:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562635.561954:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562636.069210:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654920704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562636.069278:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654920832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562636.069284:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562636.069392:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920704 00000100:00100000:0.0:1786562636.069400:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920704 00000100:00100000:0.0:1786562636.069459:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1786562636.069468:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654920704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562636.069515:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 519897088 pending 0 free 3837788160 avail 3835691008 00000100:00080000:3.0:1786562636.069521:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562636.069550:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654921088:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070240:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562636.070307:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654921344:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070340:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562636.070359:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562636.070365:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654921216:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070389:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562636.070418:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654920960:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070449:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562636.070471:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88be23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654921472:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070616:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562636.070650:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921216 00000100:00100000:1.0:1786562636.070656:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921216 00000100:00100000:1.0:1786562636.070695:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921472 00000100:00100000:1.0:1786562636.070698:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921472 00000100:00100000:1.0:1786562636.070784:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1786562636.070794:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654921216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070841:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654921216:12345-0@lo:400:kworker.0 Request processed in 47us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562636.070848:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1786562636.070867:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1786562636.070874:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654921472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070908:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654921472:12345-0@lo:400:kworker.0 Request processed in 34us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562636.070914:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1786562636.070932:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920960 00000100:00100000:1.0:1786562636.070935:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920960 00000100:00100000:1.0:1786562636.070957:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1786562636.070963:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654920960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.070991:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654920960:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562636.070998:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1786562636.071049:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562636.071072:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654920960:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.071085:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88be23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654921472:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.071112:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654921216:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.071825:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921344 00000100:00100000:1.0:1786562636.071832:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921344 00000100:00100000:1.0:1786562636.071881:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1786562636.071889:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654921344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.071939:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654921344:12345-0@lo:400:kworker.0 Request processed in 50us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562636.071945:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:1.0:1786562636.071961:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562636.071979:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876128 gen 2 00000004:00080000:1.0:1786562636.071984:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e884115180, transno 17179876127 00000004:00080000:1.0:1786562636.071994:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e884115f80, transno 17179876128 00000100:00100000:1.0:1786562636.071999:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654921344:0@lo:400:kworker.0 00000100:00100000:1.0:1786562636.072964:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654920832 00000100:00100000:1.0:1786562636.072973:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654920832 00000100:00100000:1.0:1786562636.072999:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1786562636.073030:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654920832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562636.073057:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 46202880 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562636.073109:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654920832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562636.073115:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1786562636.073165:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654920832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562636.091143:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654920704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 21667us (21849us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562636.091158:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1786562636.091303:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843647 gen 2 00000004:00080000:2.0:1786562636.091309:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa17100, transno 21474843646 00000004:00080000:2.0:1786562636.091326:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9baa15c00, transno 21474843647 00000100:00100000:2.0:1786562636.091343:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654920704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562636.093262:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562636.093366:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921088 00000100:00100000:2.0:1786562636.093375:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921088 00000100:00100000:2.0:1786562636.093451:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1786562636.093463:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654921088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562636.093540:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654921088:12345-0@lo:400:kworker.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562636.093548:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1786562636.093637:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654921088:0@lo:400:kworker.0 00000100:00080000:1.0:1786562636.093669:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562636.581437:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562637.323817:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562637.324170:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652945280 00000100:00100000:1.0:1786562637.324182:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652945280 00000100:00100000:1.0:1786562637.324278:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17340 00000100:00100000:1.0:1786562637.324291:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+14:68510:x1873345652945280:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:1.0:1786562637.324313:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562637.324335:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1800/0x5c655bf6668a0880 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd449 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.324776:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.324793:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.324804:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.324825:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.324833:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.324840:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325336:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0895 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325347:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0895 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325355:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0895 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562637.325365:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 0 00000100:00080000:2.0:1786562637.325491:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562637.325803:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325812:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325818:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325825:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562637.325829:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325843:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325856:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562637.325859:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562637.325864:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325870:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0887 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325896:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325902:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325908:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325914:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562637.325917:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325924:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325931:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562637.325934:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562637.325937:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.325943:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a088e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.326695:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1800/0x5c655bf6668a0880 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd449 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.326713:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0895 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd449 expref: 16 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.326720:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562637.326722:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562637.326725:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1000, rc 0) 00000100:00100000:1.0:1786562637.326802:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:68510:x1873345652945280:12345-192.168.204.29@tcp:101:dd.0 Request processed in 2513us (2994us total) trans 8589950802 rc 0/0 00000100:00100000:1.0:1786562637.326811:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17340 00000100:00100000:0.0:1786562637.351410:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562637.351531:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652945536 00000100:00100000:1.0:1786562637.351542:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652945536 00000100:00100000:1.0:1786562637.351606:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17341 00000100:00100000:1.0:1786562637.351617:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:68510:x1873345652945536:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:1.0:1786562637.351642:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562637.351647:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562637.351676:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0895 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd449 expref: 16 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.351711:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562637.351722:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562637.351737:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1800/0x5c655bf6668a08a3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd450 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.351788:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a08aa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.351802:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a08aa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.351812:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a08aa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786562637.352601:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4404, 88 off357312 00000004:00080000:1.0:1786562637.352614:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1069794607466ns, next at 1059271143808ns, rc = 0 00000040:00080000:1.0:1786562637.352669:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4433, 88 off359992 00000004:00080000:1.0:1786562637.352676:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1069794669866ns, next at 1059271361432ns, rc = 0 00000001:00080000:0.0:1786562637.393054:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950803 is committed 00000004:00080000:0.0:1786562637.393069:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2936 committed 00000004:00080000:0.0:1786562637.393084:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2906 committed 00000100:00100000:0.0:1786562637.393196:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654921600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562637.393274:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562637.393358:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921600 00000100:00100000:0.0:1786562637.393365:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921600 00000100:00100000:0.0:1786562637.393412:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17945 00000100:00100000:0.0:1786562637.393421:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654921600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562637.394444:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654921728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562637.394503:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562637.395037:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654921600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1615us (1761us total) trans 21474843648 rc 0/0 00000100:00100000:0.0:1786562637.395048:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17945 00000100:00100000:0.0:1786562637.395067:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921728 00000100:00100000:0.0:1786562637.395073:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921728 00000100:00100000:0.0:1786562637.395171:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17946 00000100:00100000:0.0:1786562637.395193:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654921728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562637.395440:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654921728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (935us total) trans 17179876129 rc 0/0 00000100:00100000:0.0:1786562637.395446:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17946 00010000:00010000:1.0:1786562637.395836:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a08aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd450 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.395849:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562637.395852:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1786562637.395880:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1800/0x5c655bf6668a08a3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd450 expref: 16 pid: 35929 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.395911:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a08aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd450 expref: 15 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.395945:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562637.395948:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1786562637.395950:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:1.0:1786562637.396040:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:68510:x1873345652945536:12345-192.168.204.29@tcp:101:dd.0 Request processed in 44425us (44641us total) trans 8589950803 rc 0/0 00000100:00100000:1.0:1786562637.396058:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17341 00000004:00080000:1.0:1786562637.396114:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88317aa00/2, rc 0, transno 21474843648 00000100:00100000:1.0:1786562637.396120:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654921600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562637.399191:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bfb5f800/2, rc 0, transno 17179876129 00000100:00100000:0.0:1786562637.399207:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654921728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562637.409424:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562637.409613:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652945664 00000100:00100000:1.0:1786562637.409624:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652945664 00000100:00100000:1.0:1786562637.409738:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11651 00000100:00100000:1.0:1786562637.409750:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652945664:12345-192.168.204.29@tcp:4:dd.0 00000100:00080000:2.0:1786562637.410022:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1786562637.410122:0:6665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562637.410133:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.410151:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=1069s v=(0 0) 00010000:00010000:1.0:1786562637.410156:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562637.410163:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.410179:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562637.412570:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562637.412878:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652945792 00000100:00100000:3.0:1786562637.412888:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652945792 00000100:00100000:3.0:1786562637.412969:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11652 00000100:00100000:3.0:1786562637.412979:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652945792:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1786562637.413028:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562637.413047:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562637.413051:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562637.413058:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562637.413071:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562637.484178:0:29463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1786562637.484189:0:29463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb mtime from disk: 0 -> 1786562636 00002000:00010000:1.0:1786562637.484192:0:29463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb ctime from disk: 0 -> 1786562636 00002000:00010000:1.0:1786562637.484195:0:29463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1786562637.484210:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.484225:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.484236:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.484243:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562637.484249:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.484267:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.484291:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562637.484300:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a013daa0/0x5c655bf6668a08b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562637.484397:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+14:2351:x1873345652945792:12345-192.168.204.29@tcp:4:dd.0 Request processed in 71415us (71833us total) trans 21474843649 rc 0/0 00000100:00100000:1.0:1786562637.484411:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11652 00000001:00080000:1.0:1786562637.484447:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843648 is committed 00000001:00080000:1.0:1786562637.484469:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843650 is committed 00010000:00010000:0.0:1786562637.486787:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562637.486806:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562637.486813:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562637.486819:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562637.486824:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562637.486831:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562637.486850:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562637.486862:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bc7b713/0x5c655bf6668a08b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562637.487033:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652945664:12345-192.168.204.29@tcp:4:dd.0 Request processed in 77280us (77614us total) trans 21474843650 rc 0/0 00000100:00100000:0.0:1786562637.487043:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11651 00000100:00100000:3.0:1786562637.494954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562637.495835:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946048 00000100:00100000:0.0:1786562637.495848:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946048 00000100:00100000:2.0:1786562637.496053:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6335 00000100:00100000:2.0:1786562637.496065:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:68510:x1873345652946048:12345-192.168.204.29@tcp:35:dd.0 00000001:00080000:2.0:1786562637.496419:0:35899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950804 00000100:00100000:2.0:1786562637.496657:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68510:x1873345652946048:12345-192.168.204.29@tcp:35:dd.0 Request processed in 592us (1711us total) trans 8589950805 rc 0/0 00000100:00100000:2.0:1786562637.496666:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6335 00000020:00080000:2.0:1786562637.496671:0:35899:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786562637.605777:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562637.696332:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876129 is committed 00010000:00010000:3.0:1786562638.629303:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562639.653249:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562640.187076:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562640.187121:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562640.187156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562640.187182:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562640.187222:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946304 00000100:00100000:2.0:1786562640.187231:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946304 00000100:00100000:2.0:1786562640.187291:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 351 00000100:00100000:2.0:1786562640.187302:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652946304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562640.187381:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652946304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562640.187404:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 351 00000100:00100000:2.0:1786562640.187437:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946432 00000100:00100000:2.0:1786562640.187441:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946432 00000100:00100000:2.0:1786562640.187467:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946560 00000100:00100000:2.0:1786562640.187470:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946560 00000100:00100000:2.0:1786562640.187491:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 495 00000100:00100000:2.0:1786562640.187497:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652946432:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562640.187528:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652946432:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562640.187535:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 495 00000100:00100000:2.0:1786562640.187546:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 496 00000100:00100000:2.0:1786562640.187552:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652946560:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562640.187577:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652946560:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562640.187583:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 496 00000100:00080000:2.0:1786562640.187599:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562640.187604:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562640.187606:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562640.187744:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946176 00000100:00100000:1.0:1786562640.187749:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946176 00000100:00100000:1.0:1786562640.187785:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 294 00000100:00100000:1.0:1786562640.187792:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652946176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562640.187819:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652946176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562640.187825:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 294 00010000:00010000:2.0:1786562640.677319:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562641.189312:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562641.189335:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654921856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562641.189596:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654922112:0@lo:400:kworker.0 00000100:00100000:3.0:1786562641.189664:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562641.189666:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562641.189733:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654921984:0@lo:400:kworker.0 00000100:00100000:2.0:1786562641.189824:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654922368:0@lo:400:kworker.0 00000100:00100000:0.0:1786562641.191315:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654922240:0@lo:400:kworker.0 00000100:00100000:0.0:1786562641.191537:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562641.191563:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654922624:0@lo:400:kworker.0 00000100:00100000:0.0:1786562641.191591:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922112 00000100:00100000:3.0:1786562641.191599:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562641.191599:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922112 00000100:00100000:0.0:1786562641.191672:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922240 00000100:00100000:0.0:1786562641.191676:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922240 00000100:00100000:0.0:1786562641.191702:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922624 00000100:00100000:0.0:1786562641.191704:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922624 00000100:00100000:0.0:1786562641.191723:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1786562641.191732:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654922112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786562641.191768:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562641.191801:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1786562641.191810:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654922240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562641.191995:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562641.192050:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654922496:0@lo:400:kworker.0 00000100:00100000:1.0:1786562641.192080:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562641.192111:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562641.192144:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562641.192151:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654922752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562641.192177:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562641.192218:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654922112:12345-0@lo:400:kworker.0 Request processed in 485us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562641.192227:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1786562641.192239:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654922240:12345-0@lo:400:kworker.0 Request processed in 428us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562641.192250:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1786562641.192258:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654922624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562641.192291:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654922624:12345-0@lo:400:kworker.0 Request processed in 34us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562641.192298:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1786562641.192319:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1786562641.192406:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654922240:0@lo:400:kworker.0 00000100:00100000:0.0:1786562641.192444:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654922112:0@lo:400:kworker.0 00000100:00100000:0.0:1786562641.192458:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654922624:0@lo:400:kworker.0 00000100:00100000:2.0:1786562641.192469:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922496 00000100:00100000:2.0:1786562641.192476:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922496 00000100:00100000:1.0:1786562641.192489:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921856 00000100:00100000:1.0:1786562641.192495:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921856 00000100:00100000:2.0:1786562641.192516:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922368 00000100:00100000:2.0:1786562641.192525:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922368 00000100:00100000:1.0:1786562641.192530:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922752 00000100:00100000:1.0:1786562641.192535:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922752 00000100:00100000:1.0:1786562641.192553:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1786562641.192559:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654921856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562641.192590:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 46202880 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562641.192630:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654921856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562641.192637:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1786562641.192653:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1786562641.192659:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654922752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562641.192679:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520683520 pending 0 free 3835691008 avail 3833593856 00000100:00100000:2.0:1786562641.192691:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1786562641.192700:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654922496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562641.192717:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654922752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562641.192724:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1786562641.192748:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654922496:12345-0@lo:400:kworker.0 Request processed in 48us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562641.192755:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654921984 00000100:00100000:1.0:1786562641.192759:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654921984 00000100:00100000:1.0:1786562641.192785:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1786562641.192792:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654921984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562641.192825:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654921984:12345-0@lo:400:kworker.0 Request processed in 34us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562641.192833:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1786562641.192865:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1786562641.192872:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654922368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562641.192908:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1786562641.192942:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843648 gen 2 00000004:00080000:2.0:1786562641.192948:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88317aa00, transno 21474843648 00000100:00100000:2.0:1786562641.192965:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654922752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562641.192975:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654922368:0@lo:400:kworker.0 00000100:00080000:3.0:1786562641.193066:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562641.193070:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562641.194160:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876129 gen 2 00000004:00080000:0.0:1786562641.194171:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bfb5f800, transno 17179876129 00000100:00100000:0.0:1786562641.194210:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654921856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562641.194480:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654921984:0@lo:400:kworker.0 00000100:00100000:2.0:1786562641.194500:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654922496:0@lo:400:kworker.0 00000100:00100000:1.0:1786562641.194838:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654922368:12345-0@lo:400:kworker.0 Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562641.194852:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00010000:00010000:0.0:1786562641.701943:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562642.725204:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562642.795881:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950805 is committed 00010000:00010000:3.0:1786562643.749207:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562644.777609:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562645.307222:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562645.307432:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946816 00000100:00100000:2.0:1786562645.307446:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946816 00000100:00100000:2.0:1786562645.307560:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 355 00000100:00100000:2.0:1786562645.307575:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652946816:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1786562645.307730:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562645.313440:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652946816:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 5847us (6220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562645.313473:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 355 00000100:00100000:1.0:1786562645.315244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562645.315356:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562645.315403:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562645.315474:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946688 00000100:00100000:2.0:1786562645.315495:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946688 00000100:00100000:2.0:1786562645.315569:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 296 00000100:00100000:2.0:1786562645.315581:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652946688:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562645.315678:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652946688:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 99us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562645.315686:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 296 00000100:00100000:0.0:1786562645.316739:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652947072 00000100:00100000:0.0:1786562645.316748:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652947072 00000100:00100000:0.0:1786562645.316853:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652946944 00000100:00100000:0.0:1786562645.316858:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652946944 00000100:00100000:1.0:1786562645.316912:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 499 00000100:00100000:1.0:1786562645.316925:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652947072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562645.316989:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652947072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 68us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562645.317002:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 499 00000100:00080000:3.0:1786562645.317420:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562645.317426:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562645.317732:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 500 00000100:00100000:0.0:1786562645.317745:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652946944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562645.317801:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652946944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 60us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562645.317809:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 500 00010000:00010000:2.0:1786562645.797628:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562646.309600:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654922880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562646.309725:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562646.309873:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654923264:0@lo:400:kworker.0 00000100:00100000:2.0:1786562646.309891:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654923392:0@lo:400:kworker.0 00000100:00100000:0.0:1786562646.309924:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562646.309932:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562646.309981:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654923136:0@lo:400:kworker.0 00000100:00100000:2.0:1786562646.309986:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654923008:0@lo:400:kworker.0 00000100:00100000:0.0:1786562646.310036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562646.310081:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923264 00000100:00100000:0.0:1786562646.310081:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654923648:0@lo:400:kworker.0 00000100:00100000:1.0:1786562646.310106:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923264 00000100:00100000:0.0:1786562646.310130:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562646.310191:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923392 00000100:00100000:0.0:1786562646.310199:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923392 00000100:00100000:1.0:1786562646.310200:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923136 00000100:00100000:1.0:1786562646.310207:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923136 00000100:00100000:1.0:1786562646.310249:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923648 00000100:00100000:1.0:1786562646.310254:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923648 00000100:00100000:0.0:1786562646.310270:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1786562646.310284:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654923392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562646.310293:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1786562646.310310:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654923264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562646.310364:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654923392:12345-0@lo:400:kworker.0 Request processed in 82us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562646.310374:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1786562646.310416:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1786562646.310423:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654923264:12345-0@lo:400:kworker.0 Request processed in 114us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562646.310433:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654923136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562646.310442:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1786562646.310477:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1786562646.310490:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654923648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562646.310500:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654923136:12345-0@lo:400:kworker.0 Request processed in 67us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562646.310511:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1786562646.310551:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654923648:12345-0@lo:400:kworker.0 Request processed in 61us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562646.310562:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1786562646.310805:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654923776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562646.310848:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562646.313756:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654923136:0@lo:400:kworker.0 00000100:00100000:1.0:1786562646.313777:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654923648:0@lo:400:kworker.0 00000100:00100000:2.0:1786562646.314396:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562646.314468:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654923520:0@lo:400:kworker.0 00000100:00100000:2.0:1786562646.314511:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562646.314627:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923520 00000100:00100000:2.0:1786562646.314637:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923520 00000100:00100000:2.0:1786562646.314706:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1786562646.314717:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654923520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562646.314784:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654923520:12345-0@lo:400:kworker.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562646.314792:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1786562646.314841:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654923392:0@lo:400:kworker.0 00000100:00100000:2.0:1786562646.314868:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654923520:0@lo:400:kworker.0 00000100:00080000:2.0:1786562646.314916:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562646.314921:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562646.314926:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562646.314947:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654923264:0@lo:400:kworker.0 00000100:00100000:1.0:1786562646.315248:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923008 00000100:00100000:1.0:1786562646.315261:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923008 00000100:00100000:1.0:1786562646.315329:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1786562646.315339:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654923008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562646.315553:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654923008:12345-0@lo:400:kworker.0 Request processed in 214us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562646.315566:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1786562646.316240:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654923008:0@lo:400:kworker.0 00000100:00100000:3.0:1786562646.317913:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654922880 00000100:00100000:3.0:1786562646.317933:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654922880 00000100:00100000:3.0:1786562646.318141:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654923776 00000100:00100000:3.0:1786562646.318200:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654923776 00000100:00100000:3.0:1786562646.318232:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1786562646.318244:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654922880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562646.318313:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520683520 pending 0 free 3835691008 avail 3833593856 00000100:00100000:3.0:1786562646.318441:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654922880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (8715us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562646.318453:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1786562646.318489:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1786562646.318496:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654923776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562646.318521:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 46202880 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562646.318584:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654923776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562646.318591:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1786562646.319116:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654922880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562646.319325:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654923776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786562646.822653:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562647.845423:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562648.869162:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562649.845313:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562649.845421:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652947328 00000100:00100000:2.0:1786562649.845432:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652947328 00000100:00100000:2.0:1786562649.845515:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17342 00000100:00100000:2.0:1786562649.845527:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:68533:x1873345652947328:12345-192.168.204.29@tcp:101:lfs.0 00000100:00080000:3.0:1786562649.845548:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562649.845551:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562649.845578:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a08bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd457 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.845656:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.845670:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.845683:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.845762:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.845772:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.845779:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846182:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846195:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846203:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846209:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562649.846214:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846222:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846234:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562649.846238:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562649.846242:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846248:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a08c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846260:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846265:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846271:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846277:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562649.846280:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846286:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846293:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332100) 00010000:00010000:2.0:1786562649.846296:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562649.846299:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846305:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a08cd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846341:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a08bf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd457 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846351:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562649.846354:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562649.846358:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a08bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd457 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.846367:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562649.846435:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:68533:x1873345652947328:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 910us (1132us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562649.846444:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17342 00000100:00100000:2.0:1786562649.856590:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562649.856767:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652947584 00000100:00100000:0.0:1786562649.856777:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652947584 00000100:00100000:0.0:1786562649.856882:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17343 00000100:00100000:0.0:1786562649.856894:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:68533:x1873345652947584:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562649.856918:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562649.856940:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a08d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd45e expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562649.857810:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e6:0x0]: returning size 7680 00010000:00010000:0.0:1786562649.858453:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a08d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd45e expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.858471:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:0.0:1786562649.858474:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562649.858479:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a08d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd45e expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.858494:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562649.858565:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:68533:x1873345652947584:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1673us (1985us total) trans 8589950806 rc 301/301 00000100:00100000:0.0:1786562649.858574:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17343 00000100:00100000:3.0:1786562649.862598:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562649.862793:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652947712 00000100:00100000:1.0:1786562649.862804:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652947712 00000100:00100000:1.0:1786562649.862936:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17344 00000100:00100000:1.0:1786562649.862958:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:68533:x1873345652947712:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562649.863094:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863113:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863126:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863143:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863150:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863156:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863529:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863539:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863547:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562649.863581:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00000004:00200000:1.0:1786562649.863585:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562649.863599:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863614:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863621:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863629:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863635:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562649.863652:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863660:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863674:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562649.863677:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562649.863682:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863688:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a08e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863714:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863726:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863731:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863735:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562649.863738:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863744:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863751:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562649.863753:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562649.863756:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863761:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a08e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863789:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863795:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863801:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863806:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562649.863810:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863815:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863822:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562649.863825:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562649.863828:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.863834:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a08f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562649.863923:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:68533:x1873345652947712:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 976us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562649.863933:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17344 00000100:00100000:1.0:1786562649.866746:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562649.866886:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652947968 00000100:00100000:3.0:1786562649.866905:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652947968 00000100:00100000:3.0:1786562649.866986:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6336 00000100:00100000:3.0:1786562649.867001:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:68533:x1873345652947968:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562649.867937:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68533:x1873345652947968:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 936us (1198us total) trans 8589950807 rc 0/0 00000100:00100000:3.0:1786562649.867950:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6336 00010000:00010000:1.0:1786562649.893693:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562649.904083:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562649.904400:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652948224 00000100:00100000:3.0:1786562649.904415:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652948224 00000100:00100000:3.0:1786562649.904496:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17345 00000100:00100000:3.0:1786562649.904509:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:68537:x1873345652948224:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562649.904546:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562649.904578:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a08f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd465 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.904699:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.904718:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.904733:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.904751:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.904758:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.904764:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905505:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905517:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905526:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905533:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562649.905538:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905553:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905570:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562649.905574:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562649.905580:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905586:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a08fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905602:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905609:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905615:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905621:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562649.905624:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905631:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905639:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e999bb1000) 00010000:00010000:3.0:1786562649.905642:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562649.905645:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905653:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0905 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905701:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a08f7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd465 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905714:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562649.905717:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562649.905721:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a08f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd465 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.905732:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267600, rc 0) 00000100:00100000:3.0:1786562649.905832:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:68537:x1873345652948224:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1324us (1823us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562649.905844:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17345 00000100:00100000:2.0:1786562649.915192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562649.915623:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652948480 00000100:00100000:3.0:1786562649.915638:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652948480 00000100:00100000:3.0:1786562649.915704:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17346 00000100:00100000:3.0:1786562649.915716:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68537:x1873345652948480:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562649.915737:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562649.915759:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a090c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd46c expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.916049:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0913 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.916064:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0913 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.916077:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0913 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562649.916089:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e6:0x0]: returning size 7680 00010000:00010000:3.0:1786562649.918785:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a090c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd46c expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.918817:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266000/0x5c655bf6668a0913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd46c expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562649.918828:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562649.918831:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562649.918836:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266000, rc 0) 00000100:00100000:3.0:1786562649.919929:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:68537:x1873345652948480:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4208us (4745us total) trans 8589950808 rc 0/0 00000100:00100000:3.0:1786562649.919940:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17346 00000100:00100000:1.0:1786562649.933322:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562649.933623:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652948608 00000100:00100000:0.0:1786562649.933638:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652948608 00000100:00100000:0.0:1786562649.933726:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17347 00000100:00100000:0.0:1786562649.933739:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:68537:x1873345652948608:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562649.933856:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.933879:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.933895:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.933916:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.933924:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.933932:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934748:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934763:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934772:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562649.934817:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00000004:00200000:0.0:1786562649.934822:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562649.934836:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934852:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934860:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934867:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934874:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562649.934878:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934887:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934902:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562649.934905:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562649.934910:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934916:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0921 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934930:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934937:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934943:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934949:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562649.934952:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934959:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934966:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b46ab600) 00010000:00010000:0.0:1786562649.934969:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562649.934972:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934979:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0928 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.934995:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.935001:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.935135:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.935140:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562649.935143:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.935149:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.935156:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562649.935159:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562649.935162:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562649.935168:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a092f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562649.935289:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:68537:x1873345652948608:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1544us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562649.935301:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17347 00000100:00100000:2.0:1786562649.968941:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562649.969111:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652948864 00000100:00100000:1.0:1786562649.969125:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652948864 00000100:00100000:1.0:1786562649.969482:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17348 00000100:00100000:1.0:1786562649.969498:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:68545:x1873345652948864:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562649.969527:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562649.969556:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0936 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd473 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.969666:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.969689:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.969702:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.969719:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.969726:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.969733:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970255:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970266:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970273:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970279:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562649.970555:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970566:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970583:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562649.970588:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562649.970594:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970601:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a093d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970636:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970643:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970649:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970654:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562649.970657:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970663:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970671:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562649.970673:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562649.970675:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970681:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0944 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970731:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0936 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd473 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970743:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562649.970745:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562649.970749:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0936 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd473 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562649.970775:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0000, rc 0) 00000100:00100000:1.0:1786562649.971131:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:68545:x1873345652948864:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1634us (2204us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562649.975301:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17348 00000100:00100000:3.0:1786562649.979136:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562649.979725:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652948992 00000100:00100000:2.0:1786562649.979750:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652948992 00000100:00100000:2.0:1786562649.979841:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17349 00000100:00100000:2.0:1786562649.979853:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:68545:x1873345652948992:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562649.979963:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.979985:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.979999:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980072:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980081:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980088:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980691:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980703:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980711:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562649.980774:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00000004:00200000:2.0:1786562649.980780:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562649.980796:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980812:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980819:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980826:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980833:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562649.980838:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980846:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980860:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562649.980864:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562649.980869:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980875:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a094b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980888:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980898:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980903:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980909:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562649.980912:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980919:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980926:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332100) 00010000:00010000:2.0:1786562649.980929:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562649.980932:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.980938:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0952 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982344:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982363:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982372:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982379:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562649.982387:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982395:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982416:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562649.982420:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562649.982425:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562649.982432:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0959 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562649.982707:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:68545:x1873345652948992:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2851us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562649.982719:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17349 00000100:00100000:2.0:1786562650.025488:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.025765:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652949248 00000100:00100000:3.0:1786562650.025837:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652949248 00000100:00100000:3.0:1786562650.025897:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17350 00000100:00100000:3.0:1786562650.025907:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:68549:x1873345652949248:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562650.025929:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562650.025951:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0960 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd47a expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.026929:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.026949:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.026960:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.027549:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.027562:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.027570:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028551:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028563:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028571:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028578:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562650.028583:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028591:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028605:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562650.028609:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562650.028614:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028620:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0967 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028632:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028638:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028644:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028649:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562650.028651:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.028657:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.029462:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e999bb1000) 00010000:00010000:3.0:1786562650.029466:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562650.029471:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.029479:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a096e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.029535:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0960 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd47a expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.029545:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562650.029548:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562650.029552:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0960 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd47a expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.029561:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267600, rc 0) 00000100:00100000:3.0:1786562650.029830:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:68549:x1873345652949248:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3733us (4162us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562650.029843:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17350 00000100:00100000:3.0:1786562650.033697:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.034443:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652949376 00000100:00100000:0.0:1786562650.034454:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652949376 00000100:00100000:0.0:1786562650.034520:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17351 00000100:00100000:0.0:1786562650.034532:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:68549:x1873345652949376:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562650.034607:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.034624:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.034635:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.034651:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.034667:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.034674:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.036650:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.036855:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.036869:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562650.036912:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00000004:00200000:0.0:1786562650.036918:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562650.036933:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.036947:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.036954:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.036962:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037411:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.037416:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037424:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037438:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562650.037441:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.037446:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037453:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0975 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037467:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037474:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037484:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037490:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.037493:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037499:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037507:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b46ab600) 00010000:00010000:0.0:1786562650.037510:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.037513:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037519:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a097c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037536:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037542:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037549:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037554:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.037557:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037569:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037576:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562650.037579:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.037582:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.037588:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0983 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.037927:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:68549:x1873345652949376:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3391us (4234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.037938:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17351 00000100:00100000:0.0:1786562650.071343:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.071540:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652949504 00000100:00100000:1.0:1786562650.071550:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652949504 00000100:00100000:1.0:1786562650.071619:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17352 00000100:00100000:1.0:1786562650.071630:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:68552:x1873345652949504:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562650.071652:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562650.071674:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a098a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd481 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.072343:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.072360:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.072372:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.072399:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.072407:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.072413:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074360:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074384:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074396:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562650.074441:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00000004:00200000:1.0:1786562650.074446:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562650.074466:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074478:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074488:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074494:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074501:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074510:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562650.074515:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074522:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074534:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562650.074537:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562650.074542:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074547:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0991 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074575:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074582:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074588:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074593:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562650.074597:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074603:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074615:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562650.074618:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562650.074621:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074627:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0998 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074667:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a098a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd481 expref: 21 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074695:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd481 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.074703:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562650.074705:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562650.075077:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0c00, rc 0) 00000100:00100000:1.0:1786562650.075161:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+20:68552:x1873345652949504:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3531us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562650.075171:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17352 00000100:00100000:2.0:1786562650.081431:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.082378:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652949632 00000100:00100000:3.0:1786562650.082391:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652949632 00000100:00100000:3.0:1786562650.082583:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17947 00000100:00100000:3.0:1786562650.082594:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652949632:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562650.082613:0:29967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562650.082633:0:29967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd488 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562650.082657:0:29967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73e:0x0] initial LVB size: 2097152, mtime: 0x6a7cc84c, atime: 0x0, ctime: 0x6a7cc84c, blocks: 0x1007 00010000:00010000:3.0:1786562650.082676:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=1082s v=(0 0) 00010000:00010000:3.0:1786562650.082681:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562650.082692:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.082719:0:29967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.082732:0:29967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267600, rc 0) 00000100:00100000:3.0:1786562650.082802:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652949632:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 210us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562650.082809:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17947 00000100:00100000:3.0:1786562650.087112:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.087168:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652949888 00000100:00100000:3.0:1786562650.087177:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652949888 00000100:00100000:3.0:1786562650.087237:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17353 00000100:00100000:3.0:1786562650.087247:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:68552:x1873345652949888:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562650.087268:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562650.087289:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd48f expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.087395:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.087409:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.087421:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562650.087432:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00010000:00010000:3.0:1786562650.087582:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd48f expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.087598:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd48f expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.087607:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562650.087610:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562650.087613:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562650.087670:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+22:68552:x1873345652949888:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 424us (565us total) trans 8589950809 rc 0/0 00000100:00100000:3.0:1786562650.087678:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17353 00000100:00080000:2.0:1786562650.090663:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562650.102957:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.103159:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652950016 00000100:00100000:3.0:1786562650.103169:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652950016 00000100:00100000:3.0:1786562650.103657:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 994 00000100:00100000:3.0:1786562650.103669:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:2351:x1873345652950016:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562650.103685:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562650.103710:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd48f expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.103726:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562650.103731:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562650.103789:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:2351:x1873345652950016:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 123us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562650.103797:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 994 00000100:00100000:2.0:1786562650.105036:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.105141:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652950272 00000100:00100000:2.0:1786562650.105148:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652950272 00000100:00100000:2.0:1786562650.105185:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17354 00000100:00100000:2.0:1786562650.105193:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:68552:x1873345652950272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562650.105213:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562650.105230:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a09c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd496 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.105329:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a09c9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.105344:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a09c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.105354:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a09c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562650.105366:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00010000:00010000:2.0:1786562650.105733:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a09c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd496 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.105748:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a09c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd496 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.105756:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562650.105759:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562650.105762:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562650.105806:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:68552:x1873345652950272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 614us (806us total) trans 8589950810 rc 0/0 00000100:00100000:2.0:1786562650.105813:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17354 00000100:00100000:1.0:1786562650.114177:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.114450:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652950400 00000100:00100000:1.0:1786562650.114462:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652950400 00000100:00100000:1.0:1786562650.114516:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17948 00000100:00100000:1.0:1786562650.114527:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652950400:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562650.114575:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.114598:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.114608:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562650.114613:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562650.114618:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.114680:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 9 pid: 29967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.114695:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 9 pid: 29967 timeout: 1182 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562650.114711:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654923904:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562650.114807:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88118fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562650.122703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.122736:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652950528 00000100:00100000:2.0:1786562650.122744:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652950528 00010000:00010000:2.0:1786562650.122786:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 10 pid: 29967 timeout: 1182 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.122829:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8777 00000100:00100000:2.0:1786562650.122838:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652950528:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562650.122852:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562650.122875:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 10 pid: 29967 timeout: 1182 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.122889:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 10 pid: 29967 timeout: 1182 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.122915:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562650.122920:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562650.122927:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.122937:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.122960:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562650.123040:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652950528:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 202us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562650.123048:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8777 00010000:00010000:2.0:1786562650.126944:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a09a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd488 expref: 9 pid: 29967 timeout: 1182 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.126968:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654923904:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562650.126994:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127047:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127056:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127089:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127098:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127106:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127114:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562650.127117:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127125:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127144:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.127156:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea4932d/0x5c655bf6668a09d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.127254:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652950400:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 12728us (13087us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562650.127264:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17948 00000100:00100000:3.0:1786562650.151797:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.151831:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652950784 00000100:00100000:3.0:1786562650.151841:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652950784 00000100:00100000:3.0:1786562650.151892:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17355 00000100:00100000:3.0:1786562650.151903:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:68552:x1873345652950784:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562650.151957:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786562650.151983:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a099f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd481 expref: 23 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.152041:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a08aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd450 expref: 22 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.152063:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562650.152067:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562650.152097:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.152110:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.152120:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786562650.154115:0:33113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x723:0x0], index 1: 0 00000040:00080000:3.0:1786562650.155188:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4405, 88 off357400 00000004:00080000:3.0:1786562650.156707:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1082598698385ns, next at 1059271143808ns, rc = 0 00000040:00080000:3.0:1786562650.156892:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4434, 88 off360080 00000004:00080000:3.0:1786562650.156904:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1082598897652ns, next at 1059271361432ns, rc = 0 00000040:00080000:3.0:1786562650.157001:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4435, 88 off360168 00000004:00080000:3.0:1786562650.157036:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1082599029565ns, next at 1059271361432ns, rc = 0 00000001:00080000:0.0:1786562650.227676:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950806 is committed 00000001:00080000:0.0:1786562650.227699:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950810 is committed 00000001:00080000:0.0:1786562650.227716:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950811 is committed 00000004:00080000:0.0:1786562650.227721:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2938 committed 00000004:00080000:0.0:1786562650.227732:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2937 committed 00000004:00080000:0.0:1786562650.227736:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2907 committed 00000100:00100000:1.0:1786562650.227843:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562650.227864:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654924160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562650.227914:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654924032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562650.227939:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562650.227970:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654924160 00000100:00100000:0.0:1786562650.227977:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654924160 00000100:00100000:1.0:1786562650.227998:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654924288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562650.228058:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562650.229361:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654924288 00000100:00100000:0.0:1786562650.229370:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654924288 00000100:00100000:0.0:1786562650.229425:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17949 00000100:00100000:0.0:1786562650.229436:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654924160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562650.229553:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17950 00000100:00100000:1.0:1786562650.229566:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654924288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562650.229856:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654924160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 420us (1915us total) trans 21474843651 rc 0/0 00000100:00100000:1.0:1786562650.229860:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654924288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (1798us total) trans 17179876130 rc 0/0 00000100:00100000:0.0:1786562650.229869:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17949 00000100:00080000:0.0:1786562650.230387:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562650.230392:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1786562650.230493:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1d180/2, rc 0, transno 17179876130 00000100:00100000:0.0:1786562650.230500:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654924288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1786562650.230514:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9916f8000/2, rc 0, transno 21474843651 00000100:00100000:0.0:1786562650.230519:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654924160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562650.230543:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562650.230591:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654924032 00000100:00100000:0.0:1786562650.230597:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654924032 00000100:00100000:1.0:1786562650.232036:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17950 00000100:00100000:0.0:1786562650.232372:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17951 00000100:00100000:0.0:1786562650.232386:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654924032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562650.232685:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654924032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 302us (2139us total) trans 17179876131 rc 0/0 00000100:00100000:0.0:1786562650.232694:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17951 00000004:00010000:0.0:1786562650.232775:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006009a04f reply state 000000006284a662 transno 8589950811 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.232789:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1786562650.232869:0:33113:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1786562650.232882:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:68552:x1873345652950784:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 80980us (81092us total) trans 8589950811 rc 0/0 00000100:00100000:0.0:1786562650.232889:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17355 00000004:00080000:1.0:1786562650.233538:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9920380/2, rc 0, transno 17179876131 00000100:00100000:1.0:1786562650.233548:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654924032:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1786562650.234086:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.234100:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.234113:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.234121:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562650.234126:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.234135:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.234152:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562650.234156:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562650.234162:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.234169:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a09de lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562650.237759:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.238045:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652950912 00000100:00100000:1.0:1786562650.238056:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652950912 00000100:00100000:3.0:1786562650.238168:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17356 00000100:00100000:3.0:1786562650.238185:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:68552:x1873345652950912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562650.238406:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562650.238428:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd49d expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.238488:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.238505:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.238524:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:3.0:1786562650.238528:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562650.238531:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267400, rc 0) 00000100:00100000:3.0:1786562650.238949:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:68552:x1873345652950912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 768us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562650.238959:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17356 00000100:00100000:0.0:1786562650.249916:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.250051:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951040 00000100:00100000:2.0:1786562650.250062:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951040 00000100:00100000:2.0:1786562650.250129:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17357 00000100:00100000:2.0:1786562650.250143:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:68552:x1873345652951040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562650.250166:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562650.250187:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a09ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4a4 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.250300:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a09f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.250316:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a09f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.250329:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a09f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562650.250359:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097153 00000004:00200000:2.0:1786562650.250364:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562650.250382:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a09f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.250420:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a09ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4a4 expref: 19 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.250441:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a09f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4a4 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.250450:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562650.250454:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562650.250459:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd400, rc 0) 00000100:00100000:2.0:1786562650.250529:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:68552:x1873345652951040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 389us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562650.250540:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17357 00000100:00100000:0.0:1786562650.256461:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.257048:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951168 00000100:00100000:3.0:1786562650.257060:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951168 00000100:00100000:3.0:1786562650.257120:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17952 00000100:00100000:3.0:1786562650.257133:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652951168:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562650.257153:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562650.257175:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4ab expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562650.257268:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73e:0x0] initial LVB size: 2097152, mtime: 0x6a7cc84c, atime: 0x0, ctime: 0x6a7cc84c, blocks: 0x1007 00010000:00010000:3.0:1786562650.257294:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=1082s v=(0 0) 00010000:00010000:3.0:1786562650.257299:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562650.257312:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.257331:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562650.257346:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562650.257408:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652951168:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 278us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562650.257417:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17952 00000100:00100000:2.0:1786562650.342661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.342706:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951296 00000100:00100000:2.0:1786562650.342718:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951296 00000100:00100000:2.0:1786562650.342778:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17953 00000100:00100000:2.0:1786562650.342791:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652951296:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:0.0:1786562650.416883:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843651 is committed 00000100:00100000:0.0:1786562650.421860:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652951296:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 79062us (79201us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.421878:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17953 00000100:00100000:0.0:1786562650.434224:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.434279:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.434323:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.434356:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951552 00000100:00100000:0.0:1786562650.434366:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951552 00000100:00100000:0.0:1786562650.434424:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951680 00000100:00100000:0.0:1786562650.434427:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951680 00000100:00100000:0.0:1786562650.434451:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 503 00000100:00100000:0.0:1786562650.434461:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652951552:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562650.434538:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652951552:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.434545:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 503 00000100:00100000:0.0:1786562650.434563:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17954 00000100:00100000:0.0:1786562650.434570:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652951680:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:0.0:1786562650.434644:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652951680:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.434650:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17954 00000100:00080000:0.0:1786562650.434667:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562650.434689:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951424 00000100:00100000:1.0:1786562650.434695:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951424 00000100:00100000:1.0:1786562650.434733:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 298 00000100:00100000:1.0:1786562650.434742:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652951424:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562650.434777:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652951424:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562650.434785:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 298 00000100:00100000:2.0:1786562650.456081:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.456121:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.456233:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951808 00000100:00100000:1.0:1786562650.456245:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951808 00000100:00100000:1.0:1786562650.456335:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652951936 00000100:00100000:1.0:1786562650.456339:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652951936 00000100:00100000:1.0:1786562650.456374:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11653 00000100:00100000:1.0:1786562650.456384:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652951808:12345-192.168.204.29@tcp:3:lfs.0 00000100:00100000:2.0:1786562650.456415:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11654 00000100:00100000:2.0:1786562650.456429:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652951936:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562650.456429:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.456453:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562650.456456:0:14017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.456459:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562650.456471:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.456492:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.459532:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562650.459544:0:14017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562650.459554:0:14017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.459575:0:14017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482687:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482708:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482724:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482731:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562650.482736:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482746:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482766:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.482774:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec48cb82/0x5c655bf6668a0a01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.482873:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+11:2350:x1873345652951808:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 26486us (26798us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562650.482883:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11653 00010000:00010000:1.0:1786562650.508074:0:14017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.508097:0:14017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.508107:0:14017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.508114:0:14017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562650.508120:0:14017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.508129:0:14017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.508151:0:14017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.508159:0:14017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff35358/0x5c655bf6668a0a08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562650.508639:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652951936:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 52208us (52510us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562650.508651:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11654 00000100:00100000:2.0:1786562650.522666:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.523101:0:13965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652952064 00000100:00100000:0.0:1786562650.523112:0:13965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652952064 00000100:00100000:0.0:1786562650.523206:0:13965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11655 00000100:00100000:0.0:1786562650.523217:0:13965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652952064:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:0.0:1786562650.523548:0:13965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562650.523561:0:13965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.523581:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=1082s v=(0 0) 00010000:00010000:0.0:1786562650.523586:0:13965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562650.523594:0:13965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.523609:0:13965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562650.606782:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876131 is committed 00000001:00080000:0.0:1786562650.606806:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876132 is committed 00002000:00010000:2.0:1786562650.606957:0:13965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1786562650.606962:0:13965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb mtime from disk: 0 -> 1786562649 00002000:00010000:2.0:1786562650.606965:0:13965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb ctime from disk: 0 -> 1786562649 00002000:00010000:2.0:1786562650.606968:0:13965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1786562650.606982:0:13965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.607042:0:13965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.607054:0:13965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.607061:0:13965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562650.607067:0:13965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.607077:0:13965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.607108:0:13965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.607115:0:13965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007592f0fb/0x5c655bf6668a0a0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.607274:0:13965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652952064:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 84054us (84614us total) trans 17179876132 rc 0/0 00000100:00100000:2.0:1786562650.607287:0:13965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11655 00000100:00100000:2.0:1786562650.621663:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.621759:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652952192 00000100:00100000:1.0:1786562650.621771:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652952192 00000100:00100000:1.0:1786562650.621846:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11656 00000100:00100000:1.0:1786562650.621855:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652952192:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:1.0:1786562650.621905:0:16203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562650.621914:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.621931:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=1083s v=(0 0) 00010000:00010000:1.0:1786562650.621936:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562650.621943:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.621957:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562650.716982:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876133 is committed 00002000:00010000:2.0:1786562650.717261:0:16203:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1786562650.717267:0:16203:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb mtime from disk: 0 -> 1786562649 00002000:00010000:2.0:1786562650.717269:0:16203:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb ctime from disk: 0 -> 1786562649 00002000:00010000:2.0:1786562650.717271:0:16203:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1786562650.717288:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.717302:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.717312:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.717320:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562650.717326:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.717337:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.717359:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.717502:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0a16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.717633:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652952192:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 95772us (95972us total) trans 17179876133 rc 0/0 00000100:00100000:2.0:1786562650.717645:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11656 00000100:00100000:2.0:1786562650.762403:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.762515:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652952448 00000100:00100000:0.0:1786562650.762526:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652952448 00000100:00100000:0.0:1786562650.762590:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17358 00000100:00100000:0.0:1786562650.762612:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:68552:x1873345652952448:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562650.762826:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562650.762872:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a09f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4a4 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.762894:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562650.762899:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562650.763433:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.763452:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.763469:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562650.763533:0:33140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950812 00000004:00010000:0.0:1786562650.763563:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e234fae2 reply state 00000000a7afb7cb transno 8589950813 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.763572:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562650.764290:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:68552:x1873345652952448:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1677us (1893us total) trans 8589950813 rc 0/0 00000100:00100000:0.0:1786562650.764299:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17358 00000020:00080000:0.0:1786562650.764305:0:33140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786562650.774389:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.775098:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652952576 00000100:00100000:0.0:1786562650.775108:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652952576 00000100:00100000:0.0:1786562650.775175:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17955 00000100:00100000:0.0:1786562650.775185:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:68552:x1873345652952576:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562650.775206:0:8368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562650.775225:0:8368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4b2 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562650.775253:0:8368:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x722:0x0] initial LVB size: 1048576, mtime: 0x6a7cc859, atime: 0x0, ctime: 0x6a7cc859, blocks: 0x803 00010000:00010000:0.0:1786562650.775274:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=1083s v=(0 0) 00010000:00010000:0.0:1786562650.775279:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562650.775288:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 8 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.775303:0:8368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 8 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.775317:0:8368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562650.775380:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:68552:x1873345652952576:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 197us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.775389:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17955 00010000:00010000:2.0:1786562650.776041:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.776053:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.776060:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.776066:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562650.776071:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.776078:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.776093:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562650.776097:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562650.776101:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.776107:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0a1d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562650.782227:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.783075:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652952704 00000100:00100000:0.0:1786562650.783088:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652952704 00000100:00100000:0.0:1786562650.783215:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17956 00000100:00100000:0.0:1786562650.783227:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:68552:x1873345652952704:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562650.783253:0:29966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562650.783277:0:29966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4b9 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562650.783306:0:29966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x723:0x0] initial LVB size: 2097152, mtime: 0x6a7cc859, atime: 0x0, ctime: 0x6a7cc859, blocks: 0x807 00010000:00010000:0.0:1786562650.783330:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=1083s v=(0 0) 00010000:00010000:0.0:1786562650.783335:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562650.783345:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 9 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.783362:0:29966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 9 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.783376:0:29966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269000, rc 0) 00000100:00100000:0.0:1786562650.783445:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+9:68552:x1873345652952704:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 221us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.783457:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17956 00000100:00100000:3.0:1786562650.786642:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.786776:0:29459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652952832 00000100:00100000:0.0:1786562650.786787:0:29459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652952832 00002000:00010000:0.0:1786562650.786829:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1827 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562650.786834:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b35d2680 with x1873345652952832 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562650.786847:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b35d2680. 00000100:00100000:0.0:1786562650.786880:0:29459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11657 00000100:00100000:0.0:1786562650.786899:0:29459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652952832:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562650.787234:0:29459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562650.787238:0:29459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb mtime from disk: 1786562649 -> 1786562650 00002000:00010000:0.0:1786562650.787241:0:29459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562650.787243:0:29459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb ctime from disk: 1786562649 -> 1786562650 00002000:00010000:0.0:1786562650.787245:0:29459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562650.787350:0:29459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652952832:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 459us (716us total) trans 17179876134 rc 0/0 00000100:00100000:0.0:1786562650.787359:0:29459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11657 00002000:00010000:0.0:1786562650.787363:0:29459:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1827 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562650.787366:0:29459:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b35d2680 with x1873345652952832 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562650.787371:0:29459:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b35d2680. 00000100:00100000:3.0:1786562650.791491:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.791761:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953088 00000100:00100000:0.0:1786562650.791772:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953088 00000100:00100000:0.0:1786562650.791832:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17359 00000100:00100000:0.0:1786562650.791843:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:68552:x1873345652953088:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562650.791964:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.791983:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.792048:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562650.792372:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e55a7663 reply state 00000000e31ff96a transno 8589950814 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.792382:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562650.792783:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:68552:x1873345652953088:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 939us (1301us total) trans 8589950814 rc 0/0 00000100:00100000:0.0:1786562650.792792:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17359 00010000:00010000:2.0:1786562650.795349:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.795367:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.795375:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.795381:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562650.795385:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.795391:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.795408:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562650.795412:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562650.795418:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.795423:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0a32 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562650.801098:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.801369:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953216 00000100:00100000:1.0:1786562650.801380:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953216 00000100:00100000:1.0:1786562650.801464:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17957 00000100:00100000:1.0:1786562650.801476:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:68552:x1873345652953216:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562650.801499:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562650.801521:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4c0 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.801560:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.801574:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786562650.801580:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562650.801586:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->10485759] (req 0->10485759) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 10 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.801630:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.801958:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 10 pid: 28861 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562650.801985:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654924416:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562650.802190:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e883556c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562650.805875:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.806067:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654924416:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562650.806114:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->10485759] (req 0->10485759) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 10 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.806136:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0800, rc 0) 00000100:00100000:0.0:1786562650.806148:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953344 00000100:00100000:0.0:1786562650.806156:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953344 00000100:00100000:1.0:1786562650.806196:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+11:68552:x1873345652953216:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4721us (5107us total) trans 0 rc 0/0 00010000:00010000:0.0:1786562650.806206:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 11 pid: 28861 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562650.806207:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17957 00000100:00100000:0.0:1786562650.806248:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8778 00000100:00100000:0.0:1786562650.806259:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652953344:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562650.806274:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562650.806299:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 10 pid: 28861 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.806313:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 10 pid: 28861 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.806343:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a09fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ab expref: 10 pid: 28861 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.806358:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562650.806362:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562650.806370:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.806379:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.806412:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.806426:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d48000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654924544:192.168.204.29@tcp:105: 00000100:00100000:0.0:1786562650.806478:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562650.816468:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d48000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1873345654924544:192.168.204.29@tcp:105: 00010000:00010000:0.0:1786562650.816495:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562650.816565:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652953344:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 10307us (10697us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.816577:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8778 00000100:00100000:2.0:1786562650.817833:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.818053:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953472 00000100:00100000:3.0:1786562650.818064:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953472 00000100:00100000:3.0:1786562650.818125:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17958 00000100:00100000:3.0:1786562650.818136:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652953472:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562650.818436:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1786562650.818441:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb mtime from disk: 1786562636 -> 1786562636 00002000:00010000:3.0:1786562650.818444:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb atime from disk: 0 -> 1786562624 00002000:00010000:3.0:1786562650.818446:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb ctime from disk: 1786562636 -> 1786562650 00002000:00010000:3.0:1786562650.818448:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:3.0:1786562650.818861:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652953472:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 725us (1031us total) trans 21474843652 rc 0/0 00000100:00100000:3.0:1786562650.818871:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17958 00000100:00100000:3.0:1786562650.823985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.824528:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953728 00000100:00100000:2.0:1786562650.824539:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953728 00000100:00100000:2.0:1786562650.824597:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6337 00000100:00100000:2.0:1786562650.824606:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881db5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:68552:x1873345652953728:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1786562650.824725:0:35899:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4e7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a09c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd496 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.824786:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.824799:0:35899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.824808:0:35899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.824839:0:35899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.824860:0:35899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 20 pid: 35929 timeout: 1183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.824874:0:35899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654924672:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562650.824964:0:35899:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88202acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562650.829638:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.830346:0:35899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654924672:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562650.830377:0:35899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562650.831891:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953856 00000100:00100000:1.0:1786562650.831904:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953856 00010000:00010000:1.0:1786562650.831953:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 21 pid: 35929 timeout: 1183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562650.832045:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8779 00000100:00100000:1.0:1786562650.832068:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652953856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562650.832098:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562650.832107:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 21 pid: 35929 timeout: 1183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.832121:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 21 pid: 35929 timeout: 1183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.832145:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a09e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd49d expref: 21 pid: 35929 timeout: 1183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.832162:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562650.832167:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.832177:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.832184:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.832220:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562650.832288:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652953856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 232us (2659us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562650.832297:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8779 00010000:00010000:0.0:1786562650.832367:0:35899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.832377:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562650.834547:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4406, 88 off357488 00000004:00080000:0.0:1786562650.834562:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1083276555840ns, next at 1059271143808ns, rc = 0 00000040:00080000:0.0:1786562650.834617:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4436, 88 off360256 00000004:00080000:0.0:1786562650.834622:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1083276616092ns, next at 1059271361432ns, rc = 0 00000040:00080000:0.0:1786562650.834647:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4437, 88 off360344 00000004:00080000:0.0:1786562650.834651:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1083276645345ns, next at 1059271361432ns, rc = 0 00000001:00080000:2.0:1786562650.891607:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950815 is committed 00000004:00080000:2.0:1786562650.891623:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2940 committed 00000004:00080000:2.0:1786562650.891634:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2939 committed 00000004:00080000:2.0:1786562650.891638:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2908 committed 00000100:00100000:2.0:1786562650.891907:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654924928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562650.891976:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562650.892052:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562650.892058:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654924800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562650.892082:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562650.892111:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654925056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562650.892134:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562650.892389:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654924928 00000100:00100000:2.0:1786562650.892397:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654924928 00000100:00100000:2.0:1786562650.892532:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654924800 00000100:00100000:2.0:1786562650.892537:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654924800 00000100:00100000:1.0:1786562650.892610:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925056 00000100:00100000:1.0:1786562650.892614:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925056 00000100:00100000:1.0:1786562650.892652:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17959 00000100:00100000:1.0:1786562650.892661:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654924928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562650.892884:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562650.892888:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb mtime from disk: 1786562650 -> 1786562650 00002000:00010000:1.0:1786562650.892891:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562650.892893:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb ctime from disk: 1786562650 -> 1786562650 00002000:00010000:1.0:1786562650.892895:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x723:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1786562650.892951:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654924928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 291us (975us total) trans 17179876135 rc 0/0 00000100:00100000:1.0:1786562650.892959:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17959 00000100:00100000:1.0:1786562650.892977:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17960 00000100:00100000:1.0:1786562650.892984:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654924800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786562650.893119:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1786562650.893123:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb mtime from disk: 1786562649 -> 1786562649 00002000:00010000:1.0:1786562650.893125:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562650.893127:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb ctime from disk: 1786562649 -> 1786562649 00002000:00010000:1.0:1786562650.893129:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x722:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1786562650.893157:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654924800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (1074us total) trans 17179876136 rc 0/0 00000100:00100000:1.0:1786562650.893177:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17960 00000100:00100000:1.0:1786562650.893917:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17961 00000100:00100000:1.0:1786562650.893931:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654925056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786562650.894110:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1786562650.894114:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb mtime from disk: 1786562636 -> 1786562636 00002000:00010000:1.0:1786562650.894116:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb atime from disk: 1786562624 -> 1786562624 00002000:00010000:1.0:1786562650.894119:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb ctime from disk: 1786562650 -> 1786562650 00002000:00010000:1.0:1786562650.894122:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73e:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1786562650.894170:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654925056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (2034us total) trans 21474843653 rc 0/0 00000100:00100000:1.0:1786562650.894177:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17961 00000100:00100000:3.0:1786562650.894889:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876131 gen 2 00000004:00080000:3.0:1786562650.894897:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1d180, transno 17179876130 00000004:00080000:3.0:1786562650.894919:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9920380, transno 17179876131 00000100:00100000:3.0:1786562650.894927:0:3290:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9bade5c00 x1873345654924800/t17179876136(17179876136) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562666 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786562650.894944:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bade5c00/2, rc 0, transno 17179876136 00000100:00100000:3.0:1786562650.894950:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654924800:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1786562650.894964:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bade6680/2, rc 0, transno 17179876135 00000100:00100000:3.0:1786562650.894967:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654924928:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1786562650.896896:0:35899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f30e9af reply state 00000000701d310b transno 8589950815 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.896914:0:35899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786562650.896925:0:35899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:0.0:1786562650.896929:0:35899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562650.896938:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a09c9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd496 expref: 16 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1786562650.897120:0:35899:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1786562650.897134:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881db5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:68552:x1873345652953728:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 72528us (73160us total) trans 8589950815 rc 0/0 00000100:00100000:0.0:1786562650.897145:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6337 00000100:00100000:2.0:1786562650.900142:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843651 gen 2 00000004:00080000:2.0:1786562650.900157:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9916f8000, transno 21474843651 00000100:00100000:2.0:1786562650.900181:0:3291:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e9bade5180 x1873345654925056/t21474843653(21474843653) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562666 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786562650.900194:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bade5180/2, rc 0, transno 21474843653 00000100:00100000:2.0:1786562650.900200:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654925056:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1786562650.900234:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.900245:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.900253:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.901283:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562650.901292:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.901304:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.901326:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562650.901330:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562650.901335:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.901342:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a40 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562650.902769:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562650.904221:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652953984 00000100:00100000:1.0:1786562650.904235:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652953984 00000100:00100000:1.0:1786562650.904301:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17360 00000100:00100000:1.0:1786562650.904311:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+15:68552:x1873345652953984:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562650.904337:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562650.904361:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0a47 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4c7 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.904420:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0a47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c7 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.904436:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0a47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c7 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.904465:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562650.904477:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562650.904481:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0e00, rc 0) 00000100:00100000:2.0:1786562650.904820:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+16:68552:x1873345652953984:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 508us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562650.904833:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17360 00000100:00100000:2.0:1786562650.911775:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562650.911920:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652954240 00000100:00100000:3.0:1786562650.911929:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652954240 00000100:00100000:3.0:1786562650.912106:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6338 00000100:00100000:3.0:1786562650.912119:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:68552:x1873345652954240:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562650.913084:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:68552:x1873345652954240:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 962us (1314us total) trans 8589950816 rc 0/0 00000100:00100000:3.0:1786562650.913095:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6338 00010000:00010000:2.0:1786562650.919949:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562650.938873:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562650.938972:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652954496 00000100:00100000:2.0:1786562650.938984:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652954496 00000100:00100000:2.0:1786562650.939085:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17361 00000100:00100000:2.0:1786562650.939096:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68553:x1873345652954496:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562650.939121:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562650.939143:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4ce expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.939240:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.939260:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.939270:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.939286:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.939293:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562650.939299:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.943950:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.943980:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.943999:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944019:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.944025:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944035:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944058:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562650.944062:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.944067:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944074:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0a55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944095:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944101:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944107:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944112:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.944116:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944122:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944129:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332400) 00010000:00010000:0.0:1786562650.944131:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.944134:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944140:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0a5c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944199:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a4e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ce expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944210:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562650.944213:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562650.944216:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0a4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ce expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.944226:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd400, rc 0) 00000100:00100000:1.0:1786562650.944665:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68553:x1873345652954496:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5567us (5798us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562650.944677:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17361 00000100:00100000:2.0:1786562650.958933:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.959109:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652954624 00000100:00100000:0.0:1786562650.959119:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652954624 00000100:00100000:0.0:1786562650.959179:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17362 00000100:00100000:0.0:1786562650.959190:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68553:x1873345652954624:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562650.959268:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959289:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959299:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959314:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959321:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959328:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959845:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959856:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959864:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562650.959899:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097152 00000004:00200000:0.0:1786562650.959903:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562650.959915:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959927:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959937:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959944:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959949:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.959953:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959961:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959974:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562650.959976:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.959982:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.959987:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0a63 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960063:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960070:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960080:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960086:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.960090:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960095:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960103:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b46ab500) 00010000:00010000:0.0:1786562650.960105:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.960108:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960113:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0a6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960128:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960133:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960139:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960144:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562650.960146:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960152:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960158:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:0.0:1786562650.960161:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562650.960164:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562650.960168:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0a71 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562650.962875:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68553:x1873345652954624:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3672us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562650.962892:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17362 00000100:00100000:2.0:1786562650.996486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562650.997204:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652954880 00000100:00100000:0.0:1786562650.997216:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652954880 00000100:00100000:1.0:1786562650.997722:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17363 00000100:00100000:1.0:1786562650.997738:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9867050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:68559:x1873345652954880:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562650.997762:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562650.997785:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0a78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4d5 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.997871:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.997886:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.997897:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.997912:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.997919:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.997925:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998339:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998347:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998354:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998360:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562650.998365:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998372:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998384:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562650.998387:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562650.998391:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998397:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0a7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998426:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998432:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998437:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998441:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562650.998444:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998449:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998456:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562650.998459:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562650.998462:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998478:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0a86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998534:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0a78 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4d5 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998544:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562650.998547:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562650.998550:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0a78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4d5 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562650.998717:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:1.0:1786562650.998795:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9867050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:68559:x1873345652954880:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1062us (2320us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562650.998803:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17363 00000100:00100000:2.0:1786562651.006398:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562651.006487:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652955008 00000100:00100000:3.0:1786562651.006507:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652955008 00000100:00080000:0.0:1786562651.006585:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562651.009962:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17364 00000100:00100000:2.0:1786562651.010001:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:68559:x1873345652955008:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562651.010096:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.010115:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.010127:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.010144:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.010153:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.010160:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011164:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011180:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011255:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562651.011304:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097152 00000004:00200000:2.0:1786562651.011309:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562651.011324:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011340:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011346:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011353:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011359:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562651.011364:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011372:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011386:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562651.011389:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562651.011394:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011400:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0a8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011413:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011418:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011424:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011429:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562651.011432:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011438:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011447:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332600) 00010000:00010000:2.0:1786562651.011449:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562651.011452:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011512:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0a94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011530:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011536:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011542:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011547:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562651.011549:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011555:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011564:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:2.0:1786562651.011566:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562651.011569:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562651.011574:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a0a9b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562651.011725:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:68559:x1873345652955008:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1746us (5333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562651.011735:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17364 00000100:00100000:2.0:1786562651.055741:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562651.056065:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652955264 00000100:00100000:1.0:1786562651.056077:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652955264 00000100:00100000:1.0:1786562651.056139:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17365 00000100:00100000:1.0:1786562651.056150:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68566:x1873345652955264:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562651.056210:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562651.056234:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0aa2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4dc expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.056317:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.056335:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.056347:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.056371:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.056379:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.056385:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057169:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057180:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057187:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057193:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.057197:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057205:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057218:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562651.057222:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.057226:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057233:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0aa9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057257:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057264:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057270:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057275:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.057277:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057283:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057289:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562651.057292:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.057295:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057300:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ab0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057345:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0aa2 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4dc expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057356:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562651.057359:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562651.057362:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0aa2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4dc expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.057373:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:1.0:1786562651.057450:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:68566:x1873345652955264:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1302us (1718us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562651.057458:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17365 00000100:00100000:0.0:1786562651.069810:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562651.070119:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652955392 00000100:00100000:1.0:1786562651.070129:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652955392 00000100:00100000:1.0:1786562651.070237:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17366 00000100:00100000:1.0:1786562651.070249:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68566:x1873345652955392:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562651.070329:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070347:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070359:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070374:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070382:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070394:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070787:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070797:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070806:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562651.070844:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097152 00000004:00200000:1.0:1786562651.070862:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562651.070875:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070888:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070895:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070900:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070906:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.070909:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070916:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070929:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562651.070945:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.070950:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070956:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ab7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070982:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.070997:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072023:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072037:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.072041:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072049:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072063:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562651.072066:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.072070:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072077:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0abe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072106:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072112:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072118:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072124:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.072127:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072133:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072139:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562651.072141:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.072144:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.072149:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0ac5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562651.073580:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68566:x1873345652955392:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3322us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562651.073595:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17366 00000100:00100000:2.0:1786562651.124311:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562651.124667:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652955648 00000100:00100000:1.0:1786562651.124679:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652955648 00000100:00100000:1.0:1786562651.124798:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17367 00000100:00100000:1.0:1786562651.124810:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:68572:x1873345652955648:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562651.124833:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562651.124855:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0acc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4e3 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.124928:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.124942:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.124952:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.124967:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.124975:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.124982:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125442:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125451:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125457:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125467:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.125472:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125479:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125492:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562651.125495:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.125499:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125505:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0ad3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125531:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125539:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125544:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125549:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.125552:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125558:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125569:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562651.125572:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.125575:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125581:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0ada lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125616:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0acc lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4e3 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125627:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562651.125630:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562651.125634:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0acc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4e3 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.125655:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1600, rc 0) 00000100:00100000:1.0:1786562651.125724:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:68572:x1873345652955648:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 916us (1426us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562651.125734:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17367 00000100:00100000:2.0:1786562651.144052:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562651.144143:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652955776 00000100:00100000:3.0:1786562651.144154:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652955776 00000100:00100000:3.0:1786562651.144214:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17368 00000100:00100000:3.0:1786562651.144224:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:68572:x1873345652955776:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562651.144309:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144325:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144336:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144351:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144358:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144364:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144710:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144720:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144727:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562651.144759:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097152 00000004:00200000:3.0:1786562651.144764:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562651.144775:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144788:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144795:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144802:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144808:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562651.144812:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144820:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.144832:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:3.0:1786562651.144835:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562651.144839:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145375:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0ae1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145391:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145398:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145405:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145410:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562651.145413:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145420:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145429:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e999bb1500) 00010000:00010000:3.0:1786562651.145432:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562651.145435:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145443:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0ae8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145460:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145468:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145474:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145480:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562651.145482:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145488:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145494:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:3.0:1786562651.145497:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562651.145499:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.145505:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0aef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562651.145809:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:68572:x1873345652955776:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1581us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562651.145819:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17368 00000100:00100000:0.0:1786562651.171291:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562651.171465:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956032 00000100:00100000:3.0:1786562651.171477:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956032 00000100:00100000:3.0:1786562651.171555:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17369 00000100:00100000:3.0:1786562651.171567:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:68575:x1873345652956032:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562651.171592:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562651.171615:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0af6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4ea expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.171693:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.171708:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.171790:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.171810:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.171817:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562651.171824:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175110:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175124:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175133:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175139:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562651.175144:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175152:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175168:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562651.175234:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562651.175240:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175247:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca000/0x5c655bf6668a0afd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175263:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175269:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175275:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175280:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562651.175283:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175289:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175298:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e999bb1500) 00010000:00010000:0.0:1786562651.175301:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562651.175304:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175310:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca600/0x5c655bf6668a0b04 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175362:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0af6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ea expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175379:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562651.175381:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562651.175385:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb400/0x5c655bf6668a0af6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ea expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562651.175394:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb400, rc 0) 00000100:00100000:0.0:1786562651.175477:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:68575:x1873345652956032:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3912us (4196us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562651.175487:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17369 00000100:00100000:0.0:1786562651.182845:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562651.183064:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956160 00000100:00100000:1.0:1786562651.183077:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956160 00000100:00100000:1.0:1786562651.183201:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17370 00000100:00100000:1.0:1786562651.183214:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68575:x1873345652956160:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562651.183312:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183339:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183352:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183372:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183381:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183388:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183792:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183803:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183810:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562651.183846:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097152 00000004:00200000:1.0:1786562651.183851:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562651.183879:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183894:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183904:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183911:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183918:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.183922:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183929:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183941:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:1.0:1786562651.183944:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.183948:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183959:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a0b0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.183994:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184000:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184056:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184062:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.184066:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184072:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184080:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9bc2a2b00) 00010000:00010000:1.0:1786562651.184083:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.184086:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184093:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a0b12 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184122:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184129:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184135:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184141:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562651.184144:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184151:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184158:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562651.184161:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562651.184164:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562651.184170:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0b19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562651.184358:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:68575:x1873345652956160:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1145us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562651.184367:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17370 00000100:00100000:2.0:1786562651.429372:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654925184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562651.429448:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562651.429646:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925184 00000100:00100000:0.0:1786562651.429654:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925184 00000100:00100000:0.0:1786562651.429711:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1786562651.429721:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654925184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562651.429743:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3841982464 00000100:00100000:1.0:1786562651.429968:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654925312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562651.430033:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562651.430090:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925312 00000100:00100000:1.0:1786562651.430094:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925312 00000100:00100000:1.0:1786562651.430116:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1786562651.430123:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654925312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562651.430148:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562651.430196:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654925312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562651.430204:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1786562651.430247:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654925312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562651.431416:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654925184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1689us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562651.431430:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1786562651.431599:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654925568:0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.431644:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562651.431675:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562651.431681:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654925696:0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.431704:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562651.432451:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654925824:0@lo:400:kworker.0 00000100:00100000:1.0:1786562651.432490:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562651.432537:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562651.432545:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654925440:0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.432601:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925568 00000100:00100000:0.0:1786562651.432610:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925568 00000100:00100000:0.0:1786562651.432658:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925696 00000100:00100000:0.0:1786562651.432662:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925696 00000100:00100000:0.0:1786562651.432684:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925824 00000100:00100000:0.0:1786562651.432688:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925824 00000100:00100000:1.0:1786562651.432703:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562651.432713:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1786562651.432723:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654925568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562651.432755:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925440 00000100:00100000:1.0:1786562651.432761:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925440 00000100:00100000:0.0:1786562651.432783:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654925568:12345-0@lo:400:kworker.0 Request processed in 59us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562651.432791:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1786562651.432799:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1786562651.432808:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654925440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.432814:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1786562651.432825:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654925696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.432873:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654925696:12345-0@lo:400:kworker.0 Request processed in 50us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562651.432878:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654925440:12345-0@lo:400:kworker.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562651.432885:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1786562651.432893:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1786562651.432903:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1786562651.432911:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654925824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.432943:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654925824:12345-0@lo:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562651.432950:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1786562651.432966:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654925440:0@lo:400:kworker.0 00000100:00080000:0.0:1786562651.432967:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562651.432996:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654925824:0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.433034:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654925696:0@lo:400:kworker.0 00000100:00100000:0.0:1786562651.433052:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654925568:0@lo:400:kworker.0 00000100:00100000:3.0:1786562651.439488:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654925184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786562651.941806:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562652.965695:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562653.989274:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562655.013282:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562655.551202:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562655.551234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562655.551292:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956416 00000100:00100000:1.0:1786562655.551302:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956416 00000100:00100000:1.0:1786562655.551384:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 362 00000100:00100000:1.0:1786562655.551394:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652956416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562655.551462:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652956416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562655.551470:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 362 00000100:00100000:0.0:1786562655.551685:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956672 00000100:00100000:0.0:1786562655.551691:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956672 00000100:00100000:0.0:1786562655.551761:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 504 00000100:00100000:0.0:1786562655.551770:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652956672:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562655.551798:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652956672:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562655.551804:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 504 00000100:00080000:0.0:1786562655.551911:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562655.551916:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562655.552468:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562655.552501:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562655.552562:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956288 00000100:00100000:2.0:1786562655.552568:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956288 00000100:00100000:3.0:1786562655.552597:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956544 00000100:00100000:3.0:1786562655.552603:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956544 00000100:00100000:3.0:1786562655.552648:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 505 00000100:00100000:3.0:1786562655.552658:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652956544:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562655.552672:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 300 00000100:00100000:3.0:1786562655.552699:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652956544:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 43us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562655.552717:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 505 00000100:00100000:2.0:1786562655.552797:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652956288:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562655.552824:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652956288:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562655.552831:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 300 00000100:00080000:1.0:1786562655.552865:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1786562655.562623:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843653 is committed 00000001:00080000:0.0:1786562655.562640:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843652 is committed 00010000:00010000:3.0:1786562656.038619:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562656.174852:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950816 is committed 00000001:00080000:0.0:1786562656.176682:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876134 is committed 00000001:00080000:0.0:1786562656.176712:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876136 is committed 00000100:00100000:2.0:1786562656.550321:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562656.550347:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654925952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562656.550426:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562656.550558:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654925952 00000100:00100000:3.0:1786562656.550566:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654925952 00000100:00100000:3.0:1786562656.550618:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1786562656.550628:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654925952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562656.550661:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3844079616 avail 3841982464 00000100:00100000:3.0:1786562656.550714:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654925952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562656.550722:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1786562656.551256:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562656.551299:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654926080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562656.551333:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562656.551390:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926080 00000100:00100000:1.0:1786562656.551395:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926080 00000100:00100000:1.0:1786562656.551430:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1786562656.551438:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654926080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562656.551460:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562656.551494:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654926080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562656.551500:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:1.0:1786562656.551515:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562656.551548:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843653 gen 2 00000004:00080000:1.0:1786562656.551553:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bade5180, transno 21474843653 00000100:00100000:1.0:1786562656.551567:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654926080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562656.551965:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876136 gen 2 00000004:00080000:2.0:1786562656.551971:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bade6680, transno 17179876135 00000004:00080000:2.0:1786562656.551982:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bade5c00, transno 17179876136 00000100:00100000:2.0:1786562656.551992:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654925952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562656.553504:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654926464:0@lo:400:kworker.0 00000100:00100000:2.0:1786562656.553513:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654926336:0@lo:400:kworker.0 00000100:00100000:1.0:1786562656.553926:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562656.553994:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654926208:0@lo:400:kworker.0 00000100:00100000:1.0:1786562656.554048:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562656.554714:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562656.555403:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562656.555417:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654926592:0@lo:400:kworker.0 00000100:00100000:1.0:1786562656.555453:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562656.555491:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926208 00000100:00100000:1.0:1786562656.555498:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926208 00000100:00100000:1.0:1786562656.555557:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786562656.555566:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654926208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562656.555621:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654926208:12345-0@lo:400:kworker.0 Request processed in 56us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562656.555628:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786562656.555663:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926464 00000100:00100000:1.0:1786562656.555667:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926464 00000100:00100000:1.0:1786562656.555697:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926336 00000100:00100000:1.0:1786562656.555700:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926336 00000100:00100000:1.0:1786562656.555715:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926592 00000100:00100000:1.0:1786562656.555718:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926592 00000100:00100000:1.0:1786562656.558024:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1786562656.558051:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562656.558167:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654926464:12345-0@lo:400:kworker.0 Request processed in 129us (4241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562656.559873:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786562656.559913:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654926336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562656.560021:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654926336:12345-0@lo:400:kworker.0 Request processed in 108us (5292us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562656.560029:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786562656.560063:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1786562656.560071:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654926592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562656.560105:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654926592:12345-0@lo:400:kworker.0 Request processed in 35us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562656.560111:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:0.0:1786562656.560711:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562656.560751:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654926592:0@lo:400:kworker.0 00000100:00100000:0.0:1786562656.560765:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654926208:0@lo:400:kworker.0 00000100:00100000:0.0:1786562656.560871:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654926464:0@lo:400:kworker.0 00000100:00100000:1.0:1786562656.561554:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1786562656.562098:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654926336:0@lo:400:kworker.0 00000100:00100000:3.0:1786562656.686722:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562656.686824:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652956800 00000100:00100000:0.0:1786562656.686834:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652956800 00000100:00100000:0.0:1786562656.686907:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17371 00000100:00100000:0.0:1786562656.686919:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+16:68993:x1873345652956800:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:0.0:1786562656.686941:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562656.686977:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0b20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4f1 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.688612:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.688634:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.688648:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.688664:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.688671:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.688677:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689078:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689088:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689096:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562656.689129:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e7:0x0]: returning size 2097152 00000004:00200000:2.0:1786562656.689134:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562656.689155:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689167:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689176:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689182:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689189:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689195:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562656.689201:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689207:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689219:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:2.0:1786562656.689222:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562656.689226:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689232:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689243:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689249:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689255:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689261:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562656.689263:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689269:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689276:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b6332800) 00010000:00010000:2.0:1786562656.689279:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562656.689281:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689298:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689337:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a0b20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4f1 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689354:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4f1 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.689363:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:2.0:1786562656.689365:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562656.689369:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562656.689454:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:68993:x1873345652956800:12345-192.168.204.29@tcp:101:rm.0 Request processed in 2537us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562656.689463:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17371 00000100:00100000:2.0:1786562656.694027:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562656.694446:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957056 00000100:00100000:0.0:1786562656.694456:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957056 00000100:00100000:0.0:1786562656.694695:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17372 00000100:00100000:0.0:1786562656.694707:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:68993:x1873345652957056:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1786562656.695246:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786562656.695417:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0b35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4f1 expref: 17 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.695459:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0a47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c7 expref: 16 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.695651:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:0.0:1786562656.695679:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562656.695717:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.695743:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.695765:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.696307:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.696318:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.696325:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.701453:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.701474:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.701717:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786562656.705495:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4407, 64 off357552 00000004:00080000:1.0:1786562656.705509:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1089147503334ns, next at 1090147499990ns, rc = 0 00000040:00080000:1.0:1786562656.705563:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4438, 64 off360408 00000004:00080000:1.0:1786562656.705570:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1089147564234ns, next at 1090147562949ns, rc = 0 00000040:00080000:1.0:1786562656.705613:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4440, 64 off360512 00010000:00010000:1.0:1786562656.705733:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705750:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705761:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705770:0:36756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705778:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705784:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705812:0:36756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786562656.705836:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705843:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705851:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705858:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562656.705860:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562656.705863:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.705868:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705872:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705896:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562656.705902:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786562656.705907:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705914:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a0b4a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.705917:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562656.705925:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.705935:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.705947:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e7:0x0].0x0 (ffff90e9bc2a2e00) 00010000:00010000:0.0:1786562656.705950:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786562656.705953:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705957:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.705960:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0b51 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705974:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705983:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705988:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562656.705991:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.705997:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562656.705999:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562656.706025:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562656.706026:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x0 (ffff90e9b6332c00) 00010000:00010000:0.0:1786562656.706030:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562656.706031:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562656.706036:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562656.706042:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0b3c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562656.706061:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c15e3806 reply state 00000000312b6219 transno 8589950817 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562656.706071:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562656.706169:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:68993:x1873345652957056:12345-192.168.204.29@tcp:36:rm.0 Request processed in 11461us (12167us total) trans 8589950817 rc 0/0 00000100:00100000:1.0:1786562656.706177:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17372 00010000:00010000:2.0:1786562656.709757:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.709772:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.709781:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.709788:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562656.709793:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.709801:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.709818:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e6:0x0].0x769e758a (ffff90e9b46aba00) 00010000:00010000:2.0:1786562656.709822:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562656.709827:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562656.709833:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0b43 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e6:0x0].0x769e758a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562657.061358:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562658.085138:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786562658.308673:0:39013:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 204d: FLR write/stale/resync sel test with repeated comp ========================================================== 15:24:16 (1786562656) 00010000:00010000:0.0:1786562659.110619:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562660.134362:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786562660.477783:0:39109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1092919774236ns, next at 1090147499990ns, rc = 0 00000004:00080000:0.0:1786562660.595139:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2910 committed 00000001:00080000:0.0:1786562660.595180:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950817 is committed 00000004:00080000:0.0:1786562660.595186:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2941 committed 00000004:00080000:0.0:1786562660.595193:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2909 committed 00000100:00100000:3.0:1786562660.595420:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562660.595442:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654926720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786562660.595512:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562660.595583:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926720 00000100:00100000:3.0:1786562660.595591:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926720 00000100:00100000:3.0:1786562660.595649:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17962 00000100:00100000:3.0:1786562660.595658:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654926720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786562660.595684:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1854 count 1 00010000:00010000:3.0:1786562660.595710:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.595733:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.595743:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x73e:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1786562660.595747:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562660.595752:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.595781:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.595795:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 8 pid: 12119 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562660.595818:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654926848:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562660.595878:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1786562660.595891:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562660.597581:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562660.597606:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654926976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562660.597663:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562660.597709:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654926976 00000100:00100000:2.0:1786562660.597715:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654926976 00000100:00100000:2.0:1786562660.597767:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17963 00000100:00100000:2.0:1786562660.597776:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654926976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786562660.597811:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1826 count 1 00010000:00010000:2.0:1786562660.597834:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.597855:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 8 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.597864:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x722:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1786562660.597870:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562660.597874:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.597903:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 8 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.597913:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 8 pid: 8368 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562660.597924:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654927104:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562660.597983:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99401c6c0 going to sleep for 11 seconds 00000100:00080000:3.0:1786562660.598597:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562660.612144:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654926848:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562660.612189:0:29662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562660.612415:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654927104:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562660.612435:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562660.617916:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562660.618432:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957184 00000100:00100000:0.0:1786562660.618443:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957184 00010000:00010000:0.0:1786562660.618500:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562660.618552:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8780 00000100:00100000:0.0:1786562660.618562:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652957184:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562660.618578:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562660.618584:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562660.618598:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562660.618625:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b951fb/0x5c655bf6668a0a39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4c0 expref: 9 pid: 12119 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562660.618656:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562660.618660:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562660.618667:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562660.618677:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562660.618702:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562660.618755:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652957184:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 194us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562660.618763:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8780 00000100:00080000:3.0:1786562660.623846:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562660.623932:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562660.623978:0:29662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.623995:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624035:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624046:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624067:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786562660.624696:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654926720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29036us (29180us total) trans 21474843654 rc 0/0 00000100:00100000:3.0:1786562660.624708:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17962 00010000:00010000:3.0:1786562660.624741:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562660.624748:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624757:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562660.624762:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624771:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624792:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624811:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c696438d/0x5c655bf6668a0b58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.624831:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562660.624833:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562660.624835:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786562660.624873:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b35d0a80/2, rc 0, transno 21474843654 00000100:00100000:3.0:1786562660.624885:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654926720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562660.626934:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957312 00000100:00100000:1.0:1786562660.626951:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957312 00010000:00010000:1.0:1786562660.627054:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 9 pid: 8368 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562660.627091:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8781 00000100:00100000:1.0:1786562660.627101:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652957312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562660.627116:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562660.627122:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 9 pid: 8368 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627136:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 9 pid: 8368 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627162:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32d77c0/0x5c655bf6668a0a24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b2 expref: 9 pid: 8368 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627179:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562660.627184:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x722:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562660.627191:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627201:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627236:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562660.627303:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652957312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 203us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562660.627311:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8781 00010000:00010000:1.0:1786562660.627347:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627358:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627368:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627376:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.627391:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786562660.628042:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654926976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30265us (30375us total) trans 17179876137 rc 0/0 00000100:00100000:1.0:1786562660.628051:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17963 00000004:00080000:1.0:1786562660.628103:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bae95c00/2, rc 0, transno 17179876137 00000100:00100000:1.0:1786562660.628115:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654926976:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786562660.629261:0:39109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1093071253124ns, next at 1090147562949ns, rc = 0 00010000:00010000:3.0:1786562660.629693:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562660.629704:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.629718:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562660.629723:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.629735:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.629756:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.629763:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0b5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.629784:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562660.629786:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562660.629787:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786562660.629825:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1786562660.631766:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2942 committed 00000100:00100000:2.0:1786562660.632157:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654927232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562660.632253:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562660.632557:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654927232 00000100:00100000:1.0:1786562660.632565:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654927232 00000100:00100000:1.0:1786562660.632616:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17964 00000100:00100000:1.0:1786562660.632625:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654927232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786562660.632653:0:29964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1827 count 1 00010000:00010000:1.0:1786562660.632677:0:29964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.632698:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 7 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.632707:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x723:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1786562660.632712:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562660.632716:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.632744:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 7 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.632757:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 7 pid: 29966 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562660.632769:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654927360:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562660.632840:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2480 going to sleep for 11 seconds 00000100:00100000:1.0:1786562660.636531:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562660.636561:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957440 00000100:00100000:1.0:1786562660.636570:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957440 00010000:00010000:1.0:1786562660.636618:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 8 pid: 29966 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562660.636660:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8782 00000100:00100000:1.0:1786562660.636670:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652957440:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562660.636688:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562660.636694:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 8 pid: 29966 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.636708:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 8 pid: 29966 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.636733:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562660.636737:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x723:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562660.636742:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.636751:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562660.636771:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562660.636836:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652957440:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 167us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562660.636844:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8782 00010000:00010000:2.0:1786562660.637139:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9c88d1b/0x5c655bf6668a0a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4b9 expref: 7 pid: 29966 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562660.637229:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29964:1873345654927360:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562660.637263:0:29964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.637274:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.637281:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.637291:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.637299:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.637358:0:29964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786562660.637898:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654927232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5272us (5642us total) trans 17179876138 rc 0/0 00000100:00100000:2.0:1786562660.637911:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17964 00000004:00080000:1.0:1786562660.639282:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9916f9180/2, rc 0, transno 17179876138 00000100:00100000:1.0:1786562660.639306:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654927232:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786562660.640325:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562660.640751:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.640766:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562660.640771:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.640782:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.641485:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562660.641703:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7c266db/0x5c655bf6668a0b66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562660.641761:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562660.641765:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562660.641769:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562660.664186:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562660.664226:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957696 00000100:00100000:3.0:1786562660.664235:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957696 00000100:00100000:3.0:1786562660.664308:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 366 00000100:00100000:3.0:1786562660.664319:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652957696:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562660.664400:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652957696:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562660.664408:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 366 00000100:00080000:2.0:1786562660.664618:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562660.673375:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562660.677813:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957568 00000100:00100000:3.0:1786562660.677832:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957568 00000100:00100000:3.0:1786562660.677887:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 302 00000100:00100000:3.0:1786562660.677897:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652957568:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562660.677978:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652957568:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 83us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562660.677985:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 302 00000001:00080000:2.0:1786562660.726598:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843654 is committed 00010000:00010000:0.0:1786562661.157208:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562661.205826:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876137 is committed 00000001:00080000:0.0:1786562661.205920:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876138 is committed 00000100:00100000:3.0:1786562661.673220:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654927488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562661.673297:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562661.673378:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654927488 00000100:00100000:3.0:1786562661.673386:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654927488 00000100:00100000:3.0:1786562661.673433:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1786562661.673442:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654927488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562661.673479:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562661.673523:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654927488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562661.673530:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1786562661.673565:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876138 gen 2 00000004:00080000:3.0:1786562661.673569:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bae95c00, transno 17179876137 00000004:00080000:3.0:1786562661.673576:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9916f9180, transno 17179876138 00000100:00100000:3.0:1786562661.673586:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654927488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562661.674792:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562661.676506:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654927744:0@lo:400:kworker.0 00000100:00100000:0.0:1786562661.676587:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562661.676679:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654927744 00000100:00100000:2.0:1786562661.676689:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654927744 00000100:00100000:0.0:1786562661.676706:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562661.676714:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654927872:0@lo:400:kworker.0 00000100:00100000:2.0:1786562661.676732:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1786562661.676741:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654927744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562661.676742:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562661.676772:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654927872 00000100:00100000:0.0:1786562661.676786:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654927872 00000100:00100000:2.0:1786562661.676810:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654927744:12345-0@lo:400:kworker.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562661.676818:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786562661.676826:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1786562661.676832:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654927872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562661.676864:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654927872:12345-0@lo:400:kworker.0 Request processed in 33us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562661.676870:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1786562661.676905:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654927872:0@lo:400:kworker.0 00000100:00100000:0.0:1786562661.676915:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654927744:0@lo:400:kworker.0 00000100:00080000:0.0:1786562661.677099:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562661.681149:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654928000:0@lo:400:kworker.0 00000100:00100000:3.0:1786562661.681227:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562661.681265:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654927616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562661.681291:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562661.685771:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654927616 00000100:00100000:0.0:1786562661.685794:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654927616 00000100:00100000:0.0:1786562661.685857:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1786562661.685866:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654927616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562661.685905:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562661.686036:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654927616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562661.686045:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1786562661.686095:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843654 gen 2 00000004:00080000:0.0:1786562661.686101:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b35d0a80, transno 21474843654 00000100:00100000:0.0:1786562661.686122:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654927616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562661.687809:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928000 00000100:00100000:2.0:1786562661.687823:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928000 00000100:00100000:2.0:1786562661.687895:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1786562661.687905:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654928000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562661.688032:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654928000:12345-0@lo:400:kworker.0 Request processed in 128us (6806us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562661.688041:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:0.0:1786562661.688308:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562661.688347:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654928000:0@lo:400:kworker.0 00000100:00100000:1.0:1786562661.690422:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562661.690446:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654928128:0@lo:400:kworker.0 00000100:00100000:1.0:1786562661.690516:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562661.690564:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928128 00000100:00100000:1.0:1786562661.690572:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928128 00000100:00100000:1.0:1786562661.690616:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1786562661.690624:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654928128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562661.690830:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654928128:12345-0@lo:400:kworker.0 Request processed in 205us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562661.690837:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1786562661.690933:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654928128:0@lo:400:kworker.0 00010000:00010000:0.0:1786562662.181218:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562663.205291:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562664.229263:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562665.254254:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562665.789953:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562665.790024:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562665.790055:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958080 00000100:00100000:0.0:1786562665.790065:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958080 00000100:00100000:0.0:1786562665.790187:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 506 00000100:00100000:0.0:1786562665.790199:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652958080:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562665.790279:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652958080:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562665.790287:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 506 00000100:00080000:0.0:1786562665.790309:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562665.790461:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957824 00000100:00100000:3.0:1786562665.790466:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957824 00000100:00100000:3.0:1786562665.790514:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 304 00000100:00100000:3.0:1786562665.790522:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652957824:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562665.790558:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652957824:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562665.790564:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 304 00000100:00100000:0.0:1786562665.794579:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562665.794619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562665.794651:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958208 00000100:00100000:0.0:1786562665.794660:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958208 00000100:00100000:0.0:1786562665.794730:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 507 00000100:00100000:0.0:1786562665.794742:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652958208:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562665.794822:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652958208:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562665.794835:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 507 00000100:00080000:0.0:1786562665.794855:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562665.795072:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652957952 00000100:00100000:3.0:1786562665.795077:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652957952 00000100:00100000:3.0:1786562665.795130:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 370 00000100:00100000:3.0:1786562665.795138:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652957952:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562665.795178:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+15:2351:x1873345652957952:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 41us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562665.795184:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 370 00000100:00080000:0.0:1786562665.796736:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562666.277451:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562666.789640:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654928256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562666.789731:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562666.789815:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928256 00000100:00100000:0.0:1786562666.789822:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928256 00000100:00100000:0.0:1786562666.789875:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1786562666.789885:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654928256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562666.789922:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562666.789968:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654928256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562666.789975:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00080000:0.0:1786562666.789999:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562666.790051:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654928256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562666.790289:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562666.790298:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654928384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562666.790325:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562666.790559:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654928640:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.790591:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562666.790620:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786562666.790626:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654928512:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.790657:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562666.790766:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654929024:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.790793:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562666.790818:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654928896:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.790842:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562666.790859:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562666.790864:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654928768:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.790884:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562666.790910:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928512 00000100:00100000:2.0:1786562666.790915:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928512 00000100:00100000:2.0:1786562666.790949:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1786562666.790956:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654928512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.790993:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654928512:12345-0@lo:400:kworker.0 Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562666.790999:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1786562666.791049:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928640 00000100:00100000:2.0:1786562666.791053:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928640 00000100:00100000:2.0:1786562666.791079:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929024 00000100:00100000:2.0:1786562666.791082:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929024 00000100:00100000:2.0:1786562666.791095:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928768 00000100:00100000:2.0:1786562666.791098:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928768 00000100:00100000:2.0:1786562666.791131:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1786562666.791138:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654928640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.791171:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654928640:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562666.791177:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1786562666.791189:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1786562666.791196:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654929024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.791223:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654929024:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562666.791229:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1786562666.791240:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1786562666.791246:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654928768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.791275:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654928768:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562666.791281:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1786562666.791309:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654928768:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.791339:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654928512:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.791349:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654929024:0@lo:400:kworker.0 00000100:00100000:2.0:1786562666.791357:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654928640:0@lo:400:kworker.0 00000100:00080000:0.0:1786562666.791470:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562666.793184:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928896 00000100:00100000:1.0:1786562666.793205:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928896 00000100:00100000:1.0:1786562666.793298:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1786562666.793308:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654928896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562666.793392:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654928896:12345-0@lo:400:kworker.0 Request processed in 86us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562666.793399:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1786562666.793454:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654928896:0@lo:400:kworker.0 00000100:00080000:0.0:1786562666.794152:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562666.796287:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654928384 00000100:00100000:3.0:1786562666.796301:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654928384 00000100:00100000:3.0:1786562666.796409:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1786562666.796421:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654928384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562666.796461:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562666.796567:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654928384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (6240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562666.796575:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1786562666.796667:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654928384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786562667.301400:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562668.325156:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562669.349807:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562670.373280:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562670.904368:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562670.904416:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562670.904453:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562670.904480:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562670.904529:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958592 00000100:00100000:0.0:1786562670.904542:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958592 00000100:00100000:0.0:1786562670.904625:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958720 00000100:00100000:0.0:1786562670.904629:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958720 00000100:00100000:0.0:1786562670.904658:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 509 00000100:00100000:0.0:1786562670.904670:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652958592:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562670.904765:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652958592:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562670.904773:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 509 00000100:00100000:0.0:1786562670.904807:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 510 00000100:00100000:0.0:1786562670.904823:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652958720:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562670.904853:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652958720:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562670.905037:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958336 00000100:00100000:1.0:1786562670.905054:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958336 00000100:00100000:0.0:1786562670.905122:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 510 00000100:00100000:1.0:1786562670.905131:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 306 00000100:00100000:1.0:1786562670.905146:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652958336:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562670.905155:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958464 00000100:00100000:0.0:1786562670.905162:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958464 00000100:00100000:0.0:1786562670.905208:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 374 00000100:00100000:0.0:1786562670.905218:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652958464:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562670.905236:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652958336:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562670.905246:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 306 00000100:00100000:0.0:1786562670.905271:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652958464:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 53us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562670.905281:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 374 00000100:00080000:0.0:1786562670.905315:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562670.905321:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562670.905323:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786562671.397333:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562671.910555:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654929152:0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.910561:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654929280:0@lo:400:kworker.0 00000100:00100000:1.0:1786562671.910660:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654929536:0@lo:400:kworker.0 00000100:00100000:3.0:1786562671.910695:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654929408:0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.915237:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562671.915319:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654929792:0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.915501:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562671.915581:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562671.915588:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562671.915708:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562671.915748:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929152 00000100:00100000:0.0:1786562671.915756:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929152 00000100:00100000:0.0:1786562671.915883:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1786562671.915893:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654929152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562671.915944:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654929152:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562671.915952:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1786562671.916003:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929536 00000100:00100000:0.0:1786562671.916023:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929536 00000100:00100000:0.0:1786562671.916062:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1786562671.916069:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654929536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.922109:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929280 00000100:00100000:2.0:1786562671.922125:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929280 00000100:00100000:2.0:1786562671.922181:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929792 00000100:00100000:2.0:1786562671.922185:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929792 00000100:00100000:2.0:1786562671.922204:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929408 00000100:00100000:2.0:1786562671.922207:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929408 00000100:00100000:2.0:1786562671.922240:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1786562671.922251:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654929280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.922345:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654929280:12345-0@lo:400:kworker.0 Request processed in 96us (7118us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562671.922352:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1786562671.922371:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1786562671.922377:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654929792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.922408:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654929792:12345-0@lo:400:kworker.0 Request processed in 31us (6908us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562671.922414:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1786562671.922426:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1786562671.922432:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654929408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562671.922462:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654929408:12345-0@lo:400:kworker.0 Request processed in 30us (6888us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562671.922467:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1786562671.922559:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654929408:0@lo:400:kworker.0 00000100:00100000:3.0:1786562671.922585:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562671.922698:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562671.922732:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929920 00000100:00100000:3.0:1786562671.922737:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929920 00000100:00100000:3.0:1786562671.922767:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1786562671.922838:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654929920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562671.922868:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562671.922902:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654929920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562671.922912:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1786562671.923250:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654929152:0@lo:400:kworker.0 00000100:00100000:1.0:1786562671.923272:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654929664:0@lo:400:kworker.0 00000100:00100000:1.0:1786562671.923304:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562671.923336:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654929664 00000100:00100000:1.0:1786562671.923339:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654929664 00000100:00100000:1.0:1786562671.923365:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1786562671.923371:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562671.923408:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654929664:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562671.923415:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1786562671.923441:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654929664:0@lo:400:kworker.0 00000100:00080000:1.0:1786562671.923559:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562671.923564:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562671.923567:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562671.923730:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562671.923785:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654929280:0@lo:400:kworker.0 00000100:00100000:3.0:1786562671.923798:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654929792:0@lo:400:kworker.0 00000100:00100000:0.0:1786562671.924813:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654929536:12345-0@lo:400:kworker.0 Request processed in 8737us (9236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562671.924825:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1786562671.925069:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562671.925180:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654930048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562671.925973:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562671.926714:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930048 00000100:00100000:0.0:1786562671.926725:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930048 00000100:00100000:0.0:1786562671.926860:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1786562671.926872:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654930048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562671.926913:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562671.926988:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654930048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562671.926995:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1786562671.927177:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654930048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562671.928296:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654929536:0@lo:400:kworker.0 00010000:00010000:0.0:1786562672.421299:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562673.445272:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562674.469132:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562675.494791:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562676.032234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562676.032282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562676.032283:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958976 00000100:00100000:0.0:1786562676.032293:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958976 00000100:00100000:3.0:1786562676.032310:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562676.032332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562676.032353:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652958848 00000100:00100000:3.0:1786562676.032356:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652958848 00000100:00100000:0.0:1786562676.032365:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 378 00000100:00100000:0.0:1786562676.032375:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652958976:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562676.032382:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 308 00000100:00100000:3.0:1786562676.032387:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652958848:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562676.032457:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652958848:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 69us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562676.032465:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 308 00000100:00100000:0.0:1786562676.032579:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2349:x1873345652958976:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 205us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562676.032587:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 378 00000100:00100000:0.0:1786562676.032609:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959232 00000100:00100000:0.0:1786562676.032613:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959232 00000100:00100000:0.0:1786562676.032638:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959104 00000100:00100000:0.0:1786562676.032641:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959104 00000100:00100000:0.0:1786562676.032663:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 513 00000100:00100000:0.0:1786562676.032839:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652959232:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562676.032948:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652959232:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562676.032958:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 513 00000100:00100000:0.0:1786562676.032970:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 514 00000100:00100000:0.0:1786562676.032977:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652959104:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562676.033023:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652959104:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562676.033029:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 514 00000100:00080000:0.0:1786562676.033046:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562676.033050:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562676.033052:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562676.517196:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562677.029226:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654930176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562677.029300:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562677.029449:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930176 00000100:00100000:3.0:1786562677.029458:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930176 00000100:00100000:3.0:1786562677.029603:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1786562677.029688:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654930176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562677.029724:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562677.029848:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654930176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 235us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562677.029856:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1786562677.029904:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654930176:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786562677.030654:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562677.030712:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654930304:0@lo:400:kworker.0 00000100:00100000:0.0:1786562677.030757:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562677.030785:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654930816:0@lo:400:kworker.0 00000100:00100000:0.0:1786562677.030813:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562677.030832:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562677.030838:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654930432:0@lo:400:kworker.0 00000100:00100000:0.0:1786562677.030858:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562677.030988:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930304 00000100:00100000:0.0:1786562677.030994:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930304 00000100:00100000:3.0:1786562677.031018:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654930688:0@lo:400:kworker.0 00000100:00100000:0.0:1786562677.031045:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1786562677.031047:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562677.031052:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654930304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031068:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562677.031073:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654930560:0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031092:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562677.031093:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654930304:12345-0@lo:400:kworker.0 Request processed in 41us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562677.031100:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1786562677.031115:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930688 00000100:00100000:3.0:1786562677.031119:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930688 00000100:00100000:3.0:1786562677.031150:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1786562677.031156:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654930688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031192:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654930688:12345-0@lo:400:kworker.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562677.031198:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1786562677.031215:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930816 00000100:00100000:3.0:1786562677.031218:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930816 00000100:00100000:3.0:1786562677.031239:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930432 00000100:00100000:3.0:1786562677.031241:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930432 00000100:00100000:3.0:1786562677.031259:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930560 00000100:00100000:3.0:1786562677.031261:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930560 00000100:00100000:3.0:1786562677.031283:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1786562677.031289:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654930816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031321:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654930816:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562677.031326:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1786562677.031337:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1786562677.031440:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654930304:0@lo:400:kworker.0 00000100:00100000:0.0:1786562677.031453:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654930816:0@lo:400:kworker.0 00000100:00080000:0.0:1786562677.031482:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562677.031486:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562677.031497:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1786562677.031504:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654930560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562677.031535:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654930560:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562677.031540:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1786562677.031835:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654930432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031879:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654930432:12345-0@lo:400:kworker.0 Request processed in 536us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562677.031885:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1786562677.031891:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654930432:0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031909:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654930560:0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.031919:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654930688:0@lo:400:kworker.0 00000100:00100000:3.0:1786562677.033516:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654930944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562677.033578:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562677.033864:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654930944 00000100:00100000:3.0:1786562677.033871:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654930944 00000100:00100000:3.0:1786562677.033911:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1786562677.033920:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654930944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562677.033954:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562677.033999:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654930944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562677.034031:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1786562677.034084:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654930944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786562677.541126:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562678.569924:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562679.589642:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562680.613445:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562681.150227:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.150348:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562681.150502:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959488 00000100:00100000:1.0:1786562681.150512:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959488 00000100:00100000:1.0:1786562681.150598:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 382 00000100:00100000:1.0:1786562681.150610:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652959488:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562681.150695:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+15:2350:x1873345652959488:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 88us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562681.150704:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 382 00000100:00080000:0.0:1786562681.151779:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562681.151861:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562681.151897:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.152303:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959744 00000100:00100000:0.0:1786562681.152311:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959744 00000100:00100000:0.0:1786562681.152358:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959616 00000100:00100000:0.0:1786562681.152361:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959616 00000100:00100000:0.0:1786562681.152397:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 516 00000100:00100000:0.0:1786562681.152408:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652959744:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562681.152465:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652959744:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 60us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562681.152472:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 516 00000100:00100000:0.0:1786562681.152486:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 517 00000100:00100000:0.0:1786562681.152492:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652959616:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562681.152514:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652959616:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562681.152520:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 517 00000100:00080000:0.0:1786562681.152539:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562681.152542:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562681.154360:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959360 00000100:00100000:2.0:1786562681.154374:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959360 00000100:00100000:2.0:1786562681.154443:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 310 00000100:00100000:2.0:1786562681.154451:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652959360:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562681.154580:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652959360:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 128us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562681.154596:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 310 00010000:00010000:0.0:1786562681.641505:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562681.746522:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.746662:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652959872 00000100:00100000:0.0:1786562681.746675:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652959872 00000100:00100000:0.0:1786562681.746787:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17373 00000100:00100000:0.0:1786562681.746799:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652959872:12345-192.168.204.29@tcp:41:mkdir.0 00000004:00000024:0.0:1786562681.746856:0:33113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2260205568 avail 2258108416 00000100:00100000:0.0:1786562681.746936:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652959872:12345-192.168.204.29@tcp:41:mkdir.0 Request processed in 139us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562681.746944:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17373 00000100:00100000:1.0:1786562681.756701:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562681.756903:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960128 00000100:00100000:3.0:1786562681.756915:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960128 00000100:00100000:3.0:1786562681.756988:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17374 00000100:00100000:3.0:1786562681.756999:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+15:69504:x1873345652960128:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:3.0:1786562681.757096:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562681.757128:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a07bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd411 expref: 15 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.757150:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46ab700) 00010000:00010000:3.0:1786562681.757165:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562681.758788:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.759148:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.759162:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.759679:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.759689:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.759697:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562681.770945:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e9:0x0]: returning size 512 00010000:00010000:2.0:1786562681.770966:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.770976:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.770983:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.770989:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.770994:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.771001:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.771046:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1300) 00010000:00010000:2.0:1786562681.771050:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.771054:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.771061:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca400/0x5c655bf6668a0b6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562681.771086:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007308d216 reply state 00000000fc8236ee transno 8589950818 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562681.771096:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562681.771826:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:69504:x1873345652960128:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 14823us (15130us total) trans 8589950818 rc 0/0 00000100:00100000:2.0:1786562681.771837:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17374 00010000:00010000:2.0:1786562681.780035:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.780053:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.780061:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.780067:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850ca200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.780072:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.780080:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.780097:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f26d1c0 (ffff90e999bb1b00) 00010000:00010000:2.0:1786562681.780101:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.780106:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.780112:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850ca200/0x5c655bf6668a0b74 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562681.835782:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.835906:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960256 00000100:00100000:2.0:1786562681.835917:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960256 00000100:00100000:2.0:1786562681.835982:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17375 00000100:00100000:2.0:1786562681.835994:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+15:69507:x1873345652960256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562681.836060:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562681.836086:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4f8 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.836158:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.836174:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.836186:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562681.836496:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562681.836501:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 42 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562681.836531:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.836558:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a0b7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4f8 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.836580:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4f8 expref: 16 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.836588:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:0.0:1786562681.836591:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562681.836594:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:0.0:1786562681.836659:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+16:69507:x1873345652960256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 667us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562681.836666:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17375 00000100:00100000:1.0:1786562681.839722:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562681.839889:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960384 00000100:00100000:3.0:1786562681.839899:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960384 00000100:00100000:3.0:1786562681.839962:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17376 00000100:00100000:3.0:1786562681.839975:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+16:69507:x1873345652960384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562681.839997:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562681.840058:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd4ff expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840131:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840146:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840157:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840175:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840183:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840190:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840304:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf6668a0b9e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840313:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf6668a0b9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840320:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf6668a0b9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562681.840355:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e9:0x0]: returning size 512 00000004:00200000:3.0:1786562681.840359:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562681.840392:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf6668a0b9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840405:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840412:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840418:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840424:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cbc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562681.840428:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840436:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840448:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:3.0:1786562681.840450:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562681.840455:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840461:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840475:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840486:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840492:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840497:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562681.840500:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840506:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840513:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f26d1c0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562681.840516:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562681.840519:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840525:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0b97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f26d1c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840555:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ff expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840569:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbe00/0x5c655bf6668a0b9e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4ff expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.840575:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:3.0:1786562681.840578:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786562681.840580:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cbe00, rc 0) 00000100:00100000:3.0:1786562681.840637:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:69507:x1873345652960384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 665us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562681.840654:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17376 00000100:00100000:1.0:1786562681.845450:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.845543:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960512 00000100:00100000:2.0:1786562681.845553:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960512 00000100:00100000:2.0:1786562681.845648:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17377 00000100:00100000:2.0:1786562681.845659:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:69507:x1873345652960512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562681.845680:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562681.845702:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0ba5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd506 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845772:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845786:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845796:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845863:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845871:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845878:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845951:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845959:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845965:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845972:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.845976:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845984:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.845996:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.846000:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.846045:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846053:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0bac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846066:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846071:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846078:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846083:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.846086:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846092:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846100:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332200) 00010000:00010000:2.0:1786562681.846103:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.846106:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846111:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0bb3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846145:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0ba5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd506 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846155:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.846158:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.846161:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0ba5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd506 expref: 18 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.846170:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562681.846245:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:69507:x1873345652960512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 589us (806us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562681.846256:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17377 00000100:00100000:1.0:1786562681.850114:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.850270:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960640 00000100:00100000:2.0:1786562681.850280:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960640 00000100:00100000:2.0:1786562681.850339:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17378 00000100:00100000:2.0:1786562681.850354:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:69507:x1873345652960640:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562681.850385:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562681.850407:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0bba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd50d expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850472:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850486:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850497:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850512:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850519:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850526:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850586:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850598:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850605:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850611:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.850616:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850623:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850635:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.850638:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.850642:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850648:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0bc1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850661:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850667:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850673:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850679:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.850682:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850687:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850694:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332300) 00010000:00010000:2.0:1786562681.850696:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.850698:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850704:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bc8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850735:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0bba lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd50d expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850744:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.850746:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.850750:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0bba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd50d expref: 18 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.850759:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562681.851071:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:69507:x1873345652960640:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 723us (966us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562681.851079:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17378 00000100:00100000:1.0:1786562681.865902:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.865999:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960768 00000100:00100000:0.0:1786562681.866045:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960768 00000100:00100000:0.0:1786562681.866109:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17379 00000100:00100000:0.0:1786562681.866123:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:69507:x1873345652960768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562681.866149:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562681.866171:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd514 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.866466:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0bd6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.866481:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.866497:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562681.866553:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e9:0x0]: returning size 512 00000004:00200000:0.0:1786562681.866558:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562681.866735:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.866764:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd514 expref: 19 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.866783:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd514 expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.866792:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562681.866795:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562681.866798:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269000, rc 0) 00000100:00100000:0.0:1786562681.866854:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:69507:x1873345652960768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 734us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562681.866861:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17379 00000100:00100000:1.0:1786562681.873543:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.873800:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652960896 00000100:00100000:0.0:1786562681.873812:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652960896 00000100:00100000:0.0:1786562681.873951:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17380 00000100:00100000:0.0:1786562681.873963:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:69507:x1873345652960896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562681.873991:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562681.874046:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0bdd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd51b expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875410:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875427:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875439:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875454:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875462:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875469:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875541:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875549:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875556:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875562:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562681.875567:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875579:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875593:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562681.875596:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562681.875601:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875607:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0be4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875621:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875627:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875633:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875638:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562681.875640:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875647:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875654:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46ab300) 00010000:00010000:0.0:1786562681.875656:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562681.875659:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875665:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0beb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875707:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0bdd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd51b expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875718:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562681.875721:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562681.875724:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0bdd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd51b expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.875734:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269a00, rc 0) 00000100:00100000:0.0:1786562681.875817:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:69507:x1873345652960896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1857us (2284us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562681.875827:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17380 00000100:00100000:1.0:1786562681.882988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.883453:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652961152 00000100:00100000:2.0:1786562681.883463:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652961152 00000100:00100000:2.0:1786562681.883527:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17381 00000100:00100000:2.0:1786562681.883537:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:69507:x1873345652961152:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562681.883562:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562681.883565:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562681.883594:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0bd6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd514 expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.883614:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.883618:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562681.883631:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0bf2 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd522 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.883766:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.883780:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.883790:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.883804:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.883812:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.885437:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886118:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886137:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886145:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562681.886156:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 0 00010000:00010000:2.0:1786562681.886183:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886191:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886198:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886205:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.886209:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886216:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886228:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.886231:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.886235:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.886241:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0bf9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562681.886258:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000387acad2 reply state 0000000050058f51 transno 8589950819 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562681.886266:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786562681.887129:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0bf2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.887149:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.887157:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:2.0:1786562681.887160:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562681.887162:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562681.887411:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:69507:x1873345652961152:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3874us (4431us total) trans 8589950819 rc 0/0 00000100:00100000:2.0:1786562681.887421:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17381 00010000:00010000:2.0:1786562681.892441:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.892460:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.892469:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.892475:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.892480:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.892492:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.892510:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332300) 00010000:00010000:2.0:1786562681.892513:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.892518:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.892525:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a0c00 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562681.896527:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.896607:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652961408 00000100:00100000:2.0:1786562681.896619:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652961408 00000100:00100000:2.0:1786562681.896679:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17382 00000100:00100000:2.0:1786562681.896690:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69507:x1873345652961408:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562681.896716:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562681.896738:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0c15 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd529 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.896841:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.896858:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.896868:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.896904:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.896919:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 20 pid: 36756 timeout: 1214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562681.896934:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654931072:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562681.897071:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562681.904075:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345654931072:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562681.904260:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562681.904325:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.904409:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652961536 00000100:00100000:2.0:1786562681.904416:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652961536 00010000:00010000:2.0:1786562681.904873:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 21 pid: 36756 timeout: 1214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562681.905215:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8783 00000100:00100000:2.0:1786562681.905231:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652961536:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562681.905247:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562681.905254:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 21 pid: 36756 timeout: 1214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.905267:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 21 pid: 36756 timeout: 1214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.905291:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0c07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd522 expref: 21 pid: 36756 timeout: 1214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.905312:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:2.0:1786562681.905317:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.905327:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.905334:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.905365:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562681.905429:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:2348:x1873345652961536:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 203us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562681.905437:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8783 00010000:00010000:1.0:1786562681.905828:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.905839:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562681.905862:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 0 00000004:00080000:1.0:1786562681.907193:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73f:0x0], index 0: 0 00000004:00080000:1.0:1786562681.907216:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x724:0x0], index 1: 0 00010000:00010000:1.0:1786562681.907761:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907773:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907786:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907793:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562681.907798:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907806:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907827:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9b6332200) 00010000:00010000:1.0:1786562681.907831:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562681.907835:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907842:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a0c1c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907912:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0c15 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd529 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907923:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562681.907926:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562681.907930:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0c15 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd529 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562681.907941:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:1.0:1786562681.908196:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69507:x1873345652961408:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11507us (11678us total) trans 8589950820 rc 301/301 00000100:00100000:1.0:1786562681.908205:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17382 00000100:00100000:1.0:1786562681.911958:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.912076:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652961792 00000100:00100000:0.0:1786562681.912086:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652961792 00000100:00100000:0.0:1786562681.912145:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6339 00000100:00100000:0.0:1786562681.912157:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69507:x1873345652961792:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562681.912554:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:69507:x1873345652961792:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 398us (606us total) trans 8589950821 rc 0/0 00000100:00100000:0.0:1786562681.912563:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6339 00000100:00100000:0.0:1786562681.915515:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562681.915601:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652962048 00000100:00100000:3.0:1786562681.915610:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652962048 00000100:00100000:2.0:1786562681.915844:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6340 00000100:00100000:2.0:1786562681.915857:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:69507:x1873345652962048:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562681.916134:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:69507:x1873345652962048:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 279us (625us total) trans 8589950822 rc 0/0 00000100:00100000:2.0:1786562681.916142:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6340 00000100:00100000:2.0:1786562681.938705:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562681.938869:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652962304 00000100:00100000:3.0:1786562681.938879:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652962304 00000100:00100000:3.0:1786562681.938942:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17383 00000100:00100000:3.0:1786562681.938953:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:69508:x1873345652962304:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562681.938988:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562681.939031:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c2a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd530 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939111:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939125:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939136:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939151:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939159:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939166:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939276:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939283:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939289:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939294:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562681.939299:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939305:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939316:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:3.0:1786562681.939319:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562681.939324:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939330:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c31 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939344:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939350:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939355:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939360:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cbc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562681.939363:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939369:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939388:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e999bb1100) 00010000:00010000:3.0:1786562681.939391:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562681.939394:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939399:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c38 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939435:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c2a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd530 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939445:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:3.0:1786562681.939447:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562681.939450:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c2a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd530 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562681.939459:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb000, rc 0) 00000100:00100000:3.0:1786562681.939521:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:69508:x1873345652962304:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 570us (827us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562681.939529:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17383 00000100:00100000:1.0:1786562681.943432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562681.943734:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652962560 00000100:00100000:0.0:1786562681.943756:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652962560 00000100:00100000:0.0:1786562681.943820:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17384 00000100:00100000:0.0:1786562681.943832:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:69508:x1873345652962560:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562681.943855:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562681.943882:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd537 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562681.943999:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e9:0x0]: returning size 512 00010000:00010000:0.0:1786562681.944160:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0c3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd537 expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.944175:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:0.0:1786562681.944179:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562681.944184:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd537 expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562681.944197:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562681.944264:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:69508:x1873345652962560:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 434us (843us total) trans 8589950823 rc 301/301 00000100:00100000:0.0:1786562681.944272:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17384 00000100:00100000:0.0:1786562681.950946:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562681.951102:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652962688 00000100:00100000:2.0:1786562681.951112:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652962688 00000100:00100000:2.0:1786562681.951206:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17385 00000100:00100000:2.0:1786562681.951218:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+22:69508:x1873345652962688:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562681.951294:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951315:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951337:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951353:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951361:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951368:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951478:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951488:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951494:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562681.951526:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 0 00000004:00200000:2.0:1786562681.951531:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562681.951543:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951557:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951568:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951575:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951581:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.951591:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951599:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951612:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562681.951615:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.951620:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951626:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0c4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951639:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951656:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951662:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951668:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.951672:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951678:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951685:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332300) 00010000:00010000:2.0:1786562681.951687:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.951690:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951696:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0c54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951711:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951717:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951723:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951727:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562681.951730:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951736:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951743:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562681.951745:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562681.951748:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562681.951754:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a0c5b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562681.951829:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+22:69508:x1873345652962688:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 613us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562681.951838:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17385 00000100:00100000:2.0:1786562681.961226:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562681.961324:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652962944 00000100:00100000:1.0:1786562681.961334:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652962944 00000100:00100000:1.0:1786562681.961402:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6341 00000100:00100000:1.0:1786562681.961414:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:69508:x1873345652962944:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562681.962036:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:69508:x1873345652962944:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 623us (817us total) trans 8589950824 rc 0/0 00000100:00100000:1.0:1786562681.962046:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6341 00000100:00100000:0.0:1786562682.149248:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654931456:0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.149321:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562682.149391:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562682.149397:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654931584:0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.149422:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562682.149456:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931456 00000100:00100000:0.0:1786562682.149464:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931456 00000100:00100000:0.0:1786562682.149515:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1786562682.149528:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654931456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.149597:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654931456:12345-0@lo:400:kworker.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562682.149605:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1786562682.149627:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931584 00000100:00100000:0.0:1786562682.149630:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931584 00000100:00100000:0.0:1786562682.149669:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786562682.149677:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654931584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.149706:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654931584:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562682.149713:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00080000:0.0:1786562682.149731:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562682.149735:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562682.149760:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654931584:0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.149770:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654931456:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.149876:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654931328:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.149910:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562682.149942:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654931840:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.149963:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562682.149985:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786562682.149990:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654931200:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562682.150063:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654931712:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150085:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562682.150109:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931328 00000100:00100000:2.0:1786562682.150113:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931328 00000100:00100000:2.0:1786562682.150143:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931840 00000100:00100000:2.0:1786562682.150146:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931840 00000100:00100000:2.0:1786562682.150163:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1786562682.150169:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654931328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150208:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654931328:12345-0@lo:400:kworker.0 Request processed in 39us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562682.150215:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1786562682.150230:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1786562682.150236:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654931840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150265:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654931840:12345-0@lo:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562682.150272:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1786562682.150290:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931200 00000100:00100000:2.0:1786562682.150293:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931200 00000100:00100000:2.0:1786562682.150316:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1786562682.150322:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654931200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150352:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654931200:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562682.150358:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1786562682.150396:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562682.150413:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654931200:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150424:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654931328:0@lo:400:kworker.0 00000100:00100000:2.0:1786562682.150433:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654931840:0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.150715:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931712 00000100:00100000:0.0:1786562682.150720:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931712 00000100:00100000:0.0:1786562682.150763:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1786562682.150770:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654931712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562682.150808:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654931712:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562682.150814:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1786562682.150842:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654931712:0@lo:400:kworker.0 00000100:00080000:2.0:1786562682.151160:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562682.153986:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654932096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562682.154082:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562682.154121:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562682.154127:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654931968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562682.154152:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562682.154244:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932096 00000100:00100000:2.0:1786562682.154251:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932096 00000100:00100000:2.0:1786562682.154294:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654931968 00000100:00100000:2.0:1786562682.154297:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654931968 00000100:00100000:2.0:1786562682.154313:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1786562682.154320:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654932096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562682.154358:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562682.154417:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654932096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562682.154430:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1786562682.154449:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1786562682.154456:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654931968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562682.154476:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:2.0:1786562682.154503:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654931968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562682.154510:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786562682.158841:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654931968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562682.158864:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654932096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562682.665504:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562683.685376:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562684.709772:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562685.735033:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562686.268733:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562686.268768:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562686.268794:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562686.268818:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562686.268845:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963072 00000100:00100000:0.0:1786562686.268854:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963072 00000100:00100000:0.0:1786562686.268902:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 312 00000100:00100000:0.0:1786562686.268912:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652963072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562686.268983:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652963072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562686.268985:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963456 00000100:00100000:0.0:1786562686.268993:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 312 00000100:00100000:2.0:1786562686.268998:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963456 00000100:00100000:0.0:1786562686.269073:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963328 00000100:00100000:0.0:1786562686.269079:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963328 00000100:00100000:2.0:1786562686.269117:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 520 00000100:00100000:0.0:1786562686.269128:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 521 00000100:00100000:2.0:1786562686.269137:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652963456:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562686.269147:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652963328:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562686.269191:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652963328:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562686.269198:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 521 00000100:00100000:2.0:1786562686.269215:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652963456:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 86us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562686.269225:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 520 00000100:00080000:2.0:1786562686.269256:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562686.269262:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562686.269958:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963200 00000100:00100000:1.0:1786562686.269967:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963200 00000100:00100000:1.0:1786562686.270054:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 386 00000100:00100000:1.0:1786562686.270066:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:2351:x1873345652963200:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562686.270123:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:2351:x1873345652963200:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 60us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562686.270130:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 386 00000100:00080000:2.0:1786562686.270227:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1786562686.324353:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950823 is committed 00000001:00080000:0.0:1786562686.324396:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950824 is committed 00010000:00010000:0.0:1786562686.757446:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562687.269345:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654932224:0@lo:400:kworker.0 00000100:00100000:0.0:1786562687.269615:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562687.269882:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932224 00000100:00100000:2.0:1786562687.269895:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932224 00000100:00100000:2.0:1786562687.269968:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1786562687.269980:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654932224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562687.273845:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654932736:0@lo:400:kworker.0 00000100:00100000:0.0:1786562687.273961:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562687.274285:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654932608:0@lo:400:kworker.0 00000100:00100000:3.0:1786562687.274364:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562687.274430:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562687.274438:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654932480:0@lo:400:kworker.0 00000100:00100000:3.0:1786562687.274462:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562687.274560:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932608 00000100:00100000:3.0:1786562687.274568:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932608 00000100:00100000:3.0:1786562687.274623:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932480 00000100:00100000:3.0:1786562687.274626:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932480 00000100:00100000:3.0:1786562687.274656:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1786562687.274665:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654932608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562687.274718:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654932608:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562687.274726:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1786562687.274745:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1786562687.274751:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654932480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562687.274779:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654932480:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562687.274786:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1786562687.274822:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654932480:0@lo:400:kworker.0 00000100:00100000:3.0:1786562687.274833:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654932608:0@lo:400:kworker.0 00000100:00080000:3.0:1786562687.274887:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562687.274928:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932736 00000100:00100000:3.0:1786562687.274932:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932736 00000100:00100000:3.0:1786562687.275653:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1786562687.275665:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654932736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562687.275715:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654932736:12345-0@lo:400:kworker.0 Request processed in 54us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562687.275722:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1786562687.275748:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654932352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562687.275776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562687.275800:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654932864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562687.275821:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786562687.275846:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562687.275867:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932352 00000100:00100000:3.0:1786562687.275871:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932352 00000100:00100000:3.0:1786562687.275912:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932864 00000100:00100000:3.0:1786562687.275916:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932864 00000100:00100000:3.0:1786562687.275928:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1786562687.275934:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654932352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562687.276113:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1786562687.276135:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654932864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562687.276176:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:1.0:1786562687.276235:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654932992:0@lo:400:kworker.0 00000100:00100000:0.0:1786562687.276244:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654932864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562687.276253:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1786562687.276298:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562687.276360:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654932864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562687.276363:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654932992 00000100:00100000:1.0:1786562687.276370:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654932992 00000100:00100000:1.0:1786562687.276416:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00080000:0.0:1786562687.276420:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562687.276440:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562687.276503:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654932992:12345-0@lo:400:kworker.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562687.276512:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1786562687.276525:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654932992:0@lo:400:kworker.0 00002000:00000024:3.0:1786562687.276798:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562687.276858:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654932352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 923us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562687.276870:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1786562687.278755:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654932352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562687.283235:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654932224:0@lo:400:kworker.0 00000100:00100000:0.0:1786562687.283312:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654932736:0@lo:400:kworker.0 00000100:00100000:2.0:1786562687.287707:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654932224:12345-0@lo:400:kworker.0 Request processed in 17710us (18074us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562687.287730:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:3.0:1786562687.782887:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562688.807331:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562689.831190:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562690.854719:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562691.383484:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562691.383541:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562691.383646:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963712 00000100:00100000:1.0:1786562691.383660:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963712 00000100:00100000:1.0:1786562691.383744:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 390 00000100:00100000:1.0:1786562691.383757:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652963712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562691.383853:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+16:2351:x1873345652963712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 98us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562691.383861:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 390 00000100:00100000:3.0:1786562691.384405:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562691.384434:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562691.384488:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963584 00000100:00100000:1.0:1786562691.384494:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963584 00000100:00100000:1.0:1786562691.384527:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 314 00000100:00100000:1.0:1786562691.384535:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652963584:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562691.384572:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652963584:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562691.384580:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 314 00000100:00080000:0.0:1786562691.385377:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562691.390769:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963968 00000100:00100000:2.0:1786562691.390791:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963968 00000100:00100000:2.0:1786562691.390912:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652963840 00000100:00100000:2.0:1786562691.390917:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652963840 00000100:00100000:2.0:1786562691.390957:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 523 00000100:00100000:2.0:1786562691.390970:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652963968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562691.391109:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652963968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 142us (7566us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562691.391118:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 523 00000100:00100000:2.0:1786562691.391141:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 524 00000100:00100000:2.0:1786562691.391148:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652963840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562691.391202:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652963840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 55us (6767us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562691.391210:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 524 00000100:00080000:1.0:1786562691.391503:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562691.391510:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786562691.877625:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562692.389463:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654933248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562692.389486:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654933376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562692.390734:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654933504:0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.390916:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562692.391046:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933504 00000100:00100000:3.0:1786562692.391056:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933504 00000100:00100000:3.0:1786562692.391131:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786562692.391144:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654933504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.391226:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654933504:12345-0@lo:400:kworker.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562692.391236:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:3.0:1786562692.391271:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562692.391309:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654933504:0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.391356:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654933632:0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.391384:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562692.391426:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933632 00000100:00100000:3.0:1786562692.391431:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933632 00000100:00100000:3.0:1786562692.391462:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786562692.391469:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654933632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.391506:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654933632:12345-0@lo:400:kworker.0 Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562692.391514:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:3.0:1786562692.391534:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562692.391855:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654933632:0@lo:400:kworker.0 00000100:00100000:2.0:1786562692.394204:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562692.394293:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654933120:0@lo:400:kworker.0 00000100:00100000:2.0:1786562692.394350:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562692.394918:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933248 00000100:00100000:3.0:1786562692.394932:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933248 00000100:00100000:3.0:1786562692.395043:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1786562692.395056:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654933248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562692.395108:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49610752 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562692.395184:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654933248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562692.395194:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:3.0:1786562692.395237:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562692.395249:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562692.395262:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654933760:0@lo:400:kworker.0 00000100:00100000:1.0:1786562692.395267:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562692.395282:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654933888:0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.395298:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562692.395334:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562692.395335:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933760 00000100:00100000:3.0:1786562692.395340:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933760 00000100:00100000:1.0:1786562692.395377:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933888 00000100:00100000:3.0:1786562692.395382:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786562692.395384:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933888 00000100:00100000:3.0:1786562692.395391:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654933760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.395432:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654933760:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562692.395439:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1786562692.395443:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786562692.395462:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654933888:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786562692.395463:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562692.395522:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654933888:12345-0@lo:400:kworker.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562692.395529:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1786562692.395635:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654933888:0@lo:400:kworker.0 00000100:00100000:2.0:1786562692.395661:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654933248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562692.395697:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933120 00000100:00100000:1.0:1786562692.395702:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933120 00000100:00100000:1.0:1786562692.395734:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1786562692.395754:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654933120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562692.396317:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654933120:12345-0@lo:400:kworker.0 Request processed in 562us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562692.396326:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1786562692.397196:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654933120:0@lo:400:kworker.0 00000100:00100000:3.0:1786562692.397305:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654933760:0@lo:400:kworker.0 00000100:00100000:0.0:1786562692.401583:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562692.403276:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654933376 00000100:00100000:3.0:1786562692.403297:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654933376 00000100:00100000:3.0:1786562692.403401:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1786562692.403414:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654933376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562692.403478:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562692.403614:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654933376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562692.403622:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1786562692.403848:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654933376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786562692.901377:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562693.670279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562693.670455:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652964224 00000100:00100000:3.0:1786562693.670470:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652964224 00000100:00100000:3.0:1786562693.670572:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17386 00000100:00100000:3.0:1786562693.670586:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+16:69536:x1873345652964224:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:3.0:1786562693.670615:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562693.670644:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c62 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd53e expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671252:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671274:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671290:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671307:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671314:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671325:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671572:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0c77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671581:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0c77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671589:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0c77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562693.671600:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 0 00010000:00010000:3.0:1786562693.671771:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671780:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671787:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671795:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cbc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562693.671800:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671809:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671824:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:3.0:1786562693.671827:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562693.671835:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671842:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0c69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671864:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671870:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671876:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671880:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cae00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562693.671883:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671889:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671896:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e999bb1100) 00010000:00010000:3.0:1786562693.671899:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562693.671901:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671907:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.671974:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c62 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd53e expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.672071:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0c77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd53e expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.672080:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562693.672083:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562693.672085:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cba00, rc 0) 00000100:00100000:3.0:1786562693.672192:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:69536:x1873345652964224:12345-192.168.204.29@tcp:101:dd.0 Request processed in 1609us (1927us total) trans 8589950825 rc 0/0 00000100:00100000:3.0:1786562693.672202:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17386 00000100:00080000:0.0:1786562693.672927:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562693.676773:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562693.676905:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652964480 00000100:00100000:3.0:1786562693.676919:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652964480 00000100:00100000:3.0:1786562693.677038:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17387 00000100:00100000:3.0:1786562693.677050:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:69536:x1873345652964480:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:3.0:1786562693.677085:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562693.677090:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562693.677147:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0c77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd53e expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.677170:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1d00) 00010000:00010000:3.0:1786562693.677185:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562693.677205:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c85 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd545 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.677278:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c8c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.677298:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c8c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.677311:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c8c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786562693.678212:0:33115:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x725:0x0], index 1: 0 00000040:00080000:3.0:1786562693.678460:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4408, 88 off357640 00000004:00080000:3.0:1786562693.678475:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1126120468581ns, next at 1090147499990ns, rc = 0 00000040:00080000:3.0:1786562693.678581:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4441, 88 off360600 00000004:00080000:3.0:1786562693.678588:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1126120582563ns, next at 1090147562949ns, rc = 0 00000040:00080000:3.0:1786562693.678618:0:33115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4442, 88 off360688 00000004:00080000:3.0:1786562693.678624:0:33115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1126120617981ns, next at 1090147562949ns, rc = 0 00000001:00080000:0.0:1786562693.771567:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950826 is committed 00000004:00080000:0.0:1786562693.771588:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2944 committed 00000004:00080000:0.0:1786562693.771601:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2943 committed 00000004:00080000:0.0:1786562693.771605:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2911 committed 00000100:00100000:0.0:1786562693.771771:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654934016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562693.771875:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562693.771973:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934016 00000100:00100000:0.0:1786562693.771997:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934016 00000100:00100000:0.0:1786562693.772093:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17965 00000100:00100000:0.0:1786562693.772103:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654934016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562693.772511:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654934016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 408us (635us total) trans 17179876139 rc 0/0 00000100:00100000:0.0:1786562693.772520:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17965 00000004:00080000:0.0:1786562693.772582:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9920e00/2, rc 0, transno 17179876139 00000100:00100000:0.0:1786562693.772590:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654934016:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1786562693.773907:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c8c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd545 expref: 18 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.773930:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562693.773935:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1786562693.773960:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0c85 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd545 expref: 18 pid: 33115 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.774117:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c8c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd545 expref: 17 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562693.774178:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562693.774183:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1786562693.774186:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cae00, rc 0) 00000100:00100000:3.0:1786562693.774349:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:69536:x1873345652964480:12345-192.168.204.29@tcp:101:dd.0 Request processed in 97290us (97581us total) trans 8589950826 rc 0/0 00000100:00100000:3.0:1786562693.774360:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17387 00000100:00100000:3.0:1786562693.774431:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654934144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562693.774498:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562693.774557:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562693.774565:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654934272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562693.774591:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562693.774626:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934144 00000100:00100000:3.0:1786562693.774635:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934144 00000100:00100000:3.0:1786562693.774677:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934272 00000100:00100000:3.0:1786562693.774680:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934272 00000100:00100000:3.0:1786562693.774704:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17966 00000100:00100000:3.0:1786562693.774714:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654934144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562693.775058:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654934144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (558us total) trans 17179876140 rc 0/0 00000100:00100000:3.0:1786562693.775066:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17966 00000100:00100000:3.0:1786562693.775083:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17967 00000100:00100000:3.0:1786562693.775091:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654934272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562693.775296:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654934272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (704us total) trans 21474843655 rc 0/0 00000100:00100000:3.0:1786562693.775302:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17967 00000004:00080000:3.0:1786562693.775381:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9921880/2, rc 0, transno 21474843655 00000100:00100000:3.0:1786562693.775389:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654934272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562693.775401:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9921f80/2, rc 0, transno 17179876140 00000100:00100000:3.0:1786562693.775405:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654934144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562693.790682:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562693.790884:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652964608 00000100:00100000:0.0:1786562693.790899:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652964608 00000100:00080000:3.0:1786562693.791096:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562693.791229:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17968 00000100:00100000:0.0:1786562693.791244:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:69536:x1873345652964608:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562693.791269:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562693.791297:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd54c expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562693.791343:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562693.791374:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=1126s v=(0 0) 00010000:00010000:0.0:1786562693.791379:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562693.791391:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562693.791422:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562693.791437:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562693.791523:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:69536:x1873345652964608:12345-192.168.204.29@tcp:101:dd.0 Request processed in 283us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562693.791535:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17968 00000100:00100000:0.0:1786562693.833730:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562693.833947:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652964864 00000100:00100000:3.0:1786562693.833960:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652964864 00000100:00100000:3.0:1786562693.834083:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6342 00000100:00100000:3.0:1786562693.834106:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+17:69536:x1873345652964864:12345-192.168.204.29@tcp:35:dd.0 00000001:00080000:3.0:1786562693.834601:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950827 00000100:00100000:3.0:1786562693.834768:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69536:x1873345652964864:12345-192.168.204.29@tcp:35:dd.0 Request processed in 674us (1052us total) trans 8589950828 rc 0/0 00000100:00100000:3.0:1786562693.834779:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6342 00000020:00080000:3.0:1786562693.834784:0:34647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786562693.838836:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562693.848877:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652964992 00000100:00100000:0.0:1786562693.848900:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652964992 00002000:00100000:0.0:1786562693.848981:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x725:0x0] (69206016->70254591) req@ffff90e9baa15f80 x1873345652964992/t0(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:164/0 lens 488/0 e 0 to 0 dl 1786562704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562693.848995:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9baa15f80 with x1873345652964992 ext(69206016->70254591) 00002000:00010000:0.0:1786562693.849002:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9baa15f80 00000100:00100000:0.0:1786562693.849057:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11658 00000100:00100000:0.0:1786562693.850587:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652964992:12345-192.168.204.29@tcp:4:dd.0 00000100:00100000:0.0:1786562693.903149:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652964992:12345-192.168.204.29@tcp:4:dd.0 Request processed in 54062us (64309us total) trans 17179876141 rc 0/0 00000100:00100000:0.0:1786562693.903166:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11658 00002000:00100000:0.0:1786562693.903312:0:29460:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x725:0x0] (69206016->70254591) req@ffff90e9baa15f80 x1873345652964992/t17179876141(0) o4->cae43410-29f4-4da8-9608-d4626744ead5@192.168.204.29@tcp:164/0 lens 488/448 e 0 to 0 dl 1786562704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786562693.903326:0:29460:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9baa15f80 with x1873345652964992 ext(69206016->70254591) 00002000:00010000:0.0:1786562693.903334:0:29460:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9baa15f80 00010000:00010000:1.0:1786562693.926409:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562694.049088:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843655 is committed 00010000:00010000:0.0:1786562694.952529:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562695.973320:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562696.512282:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562696.515471:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562696.515534:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562696.515574:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562696.515618:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965248 00000100:00100000:0.0:1786562696.515631:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965248 00000100:00100000:0.0:1786562696.515717:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 394 00000100:00100000:0.0:1786562696.515731:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652965248:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562696.515838:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652965248:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562696.515846:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 394 00000100:00100000:0.0:1786562696.515874:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965376 00000100:00100000:0.0:1786562696.515878:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965376 00000100:00100000:0.0:1786562696.515909:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965504 00000100:00100000:0.0:1786562696.515913:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965504 00000100:00100000:0.0:1786562696.515938:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 526 00000100:00100000:0.0:1786562696.515944:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652965376:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562696.515974:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652965376:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562696.515981:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 526 00000100:00100000:0.0:1786562696.515993:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 527 00000100:00100000:0.0:1786562696.516000:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652965504:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562696.516057:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652965504:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 58us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562696.516064:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 527 00000100:00080000:0.0:1786562696.516092:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562696.516097:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562696.516100:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562696.523394:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965120 00000100:00100000:3.0:1786562696.523416:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965120 00000100:00100000:3.0:1786562696.523516:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 316 00000100:00100000:3.0:1786562696.523528:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652965120:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562696.523645:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652965120:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 119us (11378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562696.523654:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 316 00010000:00010000:0.0:1786562696.997365:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562697.509595:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562697.509630:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562697.509747:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562697.510995:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934400 00000100:00100000:0.0:1786562697.511043:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934400 00000100:00100000:0.0:1786562697.511155:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1786562697.511169:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654934400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562697.511221:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562697.511579:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654934400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 412us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562697.511589:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1786562697.511655:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843655 gen 2 00000004:00080000:0.0:1786562697.511662:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9921880, transno 21474843655 00000100:00100000:0.0:1786562697.511687:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562697.512155:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654934656:0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512211:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562697.512248:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654935168:0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512352:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562697.512376:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562697.512382:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654934784:0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512406:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562697.512435:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935168 00000100:00100000:2.0:1786562697.512441:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935168 00000100:00100000:2.0:1786562697.512475:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934784 00000100:00100000:2.0:1786562697.512478:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934784 00000100:00100000:2.0:1786562697.512504:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1786562697.512513:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654935168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512559:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654935168:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562697.512565:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1786562697.512581:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786562697.512587:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654934784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512613:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654934784:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562697.512620:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786562697.512646:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654934784:0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512655:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654935168:0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.512700:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654934528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562697.512726:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562697.512943:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654934912:0@lo:400:kworker.0 00000100:00100000:1.0:1786562697.512977:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562697.513037:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934656 00000100:00100000:1.0:1786562697.513041:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934656 00000100:00100000:1.0:1786562697.513087:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1786562697.513093:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654934656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562697.513131:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654934656:12345-0@lo:400:kworker.0 Request processed in 38us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562697.513138:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1786562697.513169:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934912 00000100:00100000:1.0:1786562697.513172:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934912 00000100:00100000:1.0:1786562697.513198:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1786562697.513205:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654934912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562697.513238:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654934912:12345-0@lo:400:kworker.0 Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562697.513245:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1786562697.513365:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654934912:0@lo:400:kworker.0 00000100:00100000:1.0:1786562697.513389:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654934656:0@lo:400:kworker.0 00000100:00100000:1.0:1786562697.513427:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654934528 00000100:00100000:1.0:1786562697.513431:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654934528 00000100:00100000:1.0:1786562697.513459:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1786562697.513466:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654934528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562697.513497:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 53018624 pending 1703936 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562697.513532:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654934528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562697.513539:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:3.0:1786562697.513987:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562697.513994:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562697.513997:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562697.515371:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654935040:0@lo:400:kworker.0 00000100:00100000:2.0:1786562697.515453:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562697.515563:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654934528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562697.516162:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935040 00000100:00100000:3.0:1786562697.516170:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935040 00000100:00100000:3.0:1786562697.516245:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1786562697.516268:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654935040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562697.516352:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654935040:12345-0@lo:400:kworker.0 Request processed in 98us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562697.516361:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786562697.516746:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654935040:0@lo:400:kworker.0 00010000:00010000:3.0:1786562698.022899:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562698.586122:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876141 is committed 00000001:00080000:2.0:1786562698.586142:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876139 is committed 00000001:00080000:2.0:1786562698.586149:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876140 is committed 00010000:00010000:0.0:1786562699.045185:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562699.100043:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950828 is committed 00010000:00010000:0.0:1786562700.071067:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562701.093282:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562701.625368:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562701.625419:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562701.625455:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562701.625489:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562701.625523:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965888 00000100:00100000:0.0:1786562701.625533:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965888 00000100:00100000:0.0:1786562701.625594:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652966016 00000100:00100000:0.0:1786562701.625597:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652966016 00000100:00100000:0.0:1786562701.625618:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 529 00000100:00100000:0.0:1786562701.625628:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652965888:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562701.625716:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652965888:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562701.625725:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 529 00000100:00100000:0.0:1786562701.625745:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 530 00000100:00100000:0.0:1786562701.625752:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652966016:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562701.625778:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652966016:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562701.625784:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 530 00000100:00080000:0.0:1786562701.625800:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562701.625804:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562701.625937:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965760 00000100:00100000:0.0:1786562701.625941:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965760 00000100:00100000:0.0:1786562701.625993:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 398 00000100:00100000:0.0:1786562701.626002:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652965760:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562701.626077:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:2350:x1873345652965760:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 77us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562701.626085:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 398 00000100:00080000:0.0:1786562701.626125:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562701.626878:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652965632 00000100:00100000:1.0:1786562701.626886:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652965632 00000100:00100000:1.0:1786562701.626945:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 318 00000100:00100000:1.0:1786562701.626953:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652965632:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562701.627052:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652965632:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 99us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562701.627059:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 318 00010000:00010000:0.0:1786562702.117910:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562702.629430:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654935296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562702.629509:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562702.629691:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935296 00000100:00100000:0.0:1786562702.629699:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935296 00000100:00100000:0.0:1786562702.629769:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1786562702.629779:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654935296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562702.629829:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520683520 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562702.629884:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654935296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562702.629891:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1786562702.630564:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654935296:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786562702.631175:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562702.631385:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654935680:0@lo:400:kworker.0 00000100:00100000:0.0:1786562702.631394:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654935552:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.631463:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562702.631468:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654935808:0@lo:400:kworker.0 00000100:00100000:0.0:1786562702.631506:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562702.631538:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935680 00000100:00100000:1.0:1786562702.631546:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935680 00000100:00100000:0.0:1786562702.631553:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935808 00000100:00100000:0.0:1786562702.631559:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935808 00000100:00100000:1.0:1786562702.631600:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1786562702.631611:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654935680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562702.631618:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1786562702.631660:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654935680:12345-0@lo:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562702.631669:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:1.0:1786562702.631694:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562702.631698:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562702.631708:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562702.631728:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786562702.631734:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654935424:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.631764:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562702.631786:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654935936:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.631810:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562702.631835:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935552 00000100:00100000:1.0:1786562702.631839:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935552 00000100:00100000:1.0:1786562702.631865:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935936 00000100:00100000:1.0:1786562702.631868:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935936 00000100:00100000:1.0:1786562702.631886:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1786562702.631892:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654935552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562702.632206:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654935808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562702.632327:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654935808:12345-0@lo:400:kworker.0 Request processed in 127us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562702.632334:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1786562702.632376:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1786562702.632384:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654935936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562702.632426:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654935936:12345-0@lo:400:kworker.0 Request processed in 43us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562702.632432:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1786562702.632464:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876140 gen 2 00000004:00080000:0.0:1786562702.632470:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9920e00, transno 17179876139 00000004:00080000:0.0:1786562702.632479:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9921f80, transno 17179876140 00000100:00100000:0.0:1786562702.632485:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654935808:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.633572:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654935552:12345-0@lo:400:kworker.0 Request processed in 1673us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562702.633577:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654935424 00000100:00100000:2.0:1786562702.633586:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654935424 00000100:00100000:1.0:1786562702.633586:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1786562702.633630:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1786562702.633638:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562702.633680:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654935424:12345-0@lo:400:kworker.0 Request processed in 43us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562702.633686:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:2.0:1786562702.633714:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562702.633744:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654935680:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.633907:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654935424:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.634241:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654935936:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.634254:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654935552:0@lo:400:kworker.0 00000100:00100000:1.0:1786562702.634275:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654936064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562702.634311:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562702.634905:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654936064 00000100:00100000:3.0:1786562702.634912:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654936064 00000100:00100000:3.0:1786562702.634971:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1786562702.634980:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654936064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562702.635030:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3845128192 avail 3843031040 00000100:00100000:3.0:1786562702.635089:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654936064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562702.635098:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1786562702.636664:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654936064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562703.141309:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562704.165376:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562705.189240:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562706.214035:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562706.708127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562706.708286:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652966272 00000100:00100000:0.0:1786562706.708297:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652966272 00000100:00100000:0.0:1786562706.708378:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17388 00000100:00100000:0.0:1786562706.708399:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:69559:x1873345652966272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562706.708422:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562706.708444:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0c9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd553 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708542:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708557:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708570:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708586:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708594:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708601:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708976:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708985:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708992:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.708998:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.709002:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709048:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709060:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562706.709064:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.709068:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709074:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0ca1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709087:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709093:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709100:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709104:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.709107:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709113:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709120:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46abc00) 00010000:00010000:0.0:1786562706.709122:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.709125:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709130:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a0ca8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709164:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0c9a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd553 expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709174:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562706.709176:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562706.709180:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0c9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd553 expref: 18 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.709189:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562706.709258:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:69559:x1873345652966272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 872us (1142us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562706.709266:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17388 00000100:00080000:2.0:1786562706.709618:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562706.721236:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562706.721325:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652966528 00000100:00100000:1.0:1786562706.721335:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652966528 00000100:00100000:0.0:1786562706.721472:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17389 00000100:00100000:0.0:1786562706.721543:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:69559:x1873345652966528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562706.721566:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562706.721588:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd55a expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562706.721844:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e9:0x0]: returning size 7680 00010000:00010000:0.0:1786562706.722239:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0caf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd55a expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.722254:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:0.0:1786562706.722257:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562706.722262:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a0caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd55a expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.722275:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562706.722381:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:69559:x1873345652966528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 841us (1698us total) trans 8589950829 rc 301/301 00000100:00100000:0.0:1786562706.722397:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17389 00000100:00100000:3.0:1786562706.736096:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562706.736199:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652966656 00000100:00100000:2.0:1786562706.736211:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652966656 00000100:00100000:2.0:1786562706.736279:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17390 00000100:00100000:2.0:1786562706.736290:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:69559:x1873345652966656:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562706.736375:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.736405:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.736419:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.736434:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.736441:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.736447:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737109:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737120:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737128:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562706.737166:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00000004:00200000:2.0:1786562706.737171:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562706.737183:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737196:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737203:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737214:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737220:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.737224:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737232:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737244:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562706.737247:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.737252:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737258:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0cbd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737269:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737275:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737281:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737286:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.737289:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737298:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737305:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332d00) 00010000:00010000:2.0:1786562706.737308:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.737310:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737316:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0cc4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737329:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737335:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737340:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737345:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.737348:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737353:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737360:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:2.0:1786562706.737362:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.737365:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.737372:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ccb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562706.737895:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:69559:x1873345652966656:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1181us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562706.737909:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17390 00000100:00100000:3.0:1786562706.740191:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562706.740582:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652966912 00000100:00100000:2.0:1786562706.740592:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652966912 00000100:00100000:2.0:1786562706.740648:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6343 00000100:00100000:2.0:1786562706.740658:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881db6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:69559:x1873345652966912:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562706.741428:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881db6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:69559:x1873345652966912:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 767us (1242us total) trans 8589950830 rc 0/0 00000100:00100000:2.0:1786562706.741438:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6343 00000100:00100000:0.0:1786562706.747526:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562706.747727:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562706.747778:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562706.747809:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652967296 00000100:00100000:0.0:1786562706.747818:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652967296 00000100:00100000:0.0:1786562706.747872:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652967168 00000100:00100000:0.0:1786562706.747875:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652967168 00000100:00100000:0.0:1786562706.747912:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 532 00000100:00100000:0.0:1786562706.747924:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652967296:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562706.748028:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652967296:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562706.748037:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 532 00000100:00100000:0.0:1786562706.748055:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 533 00000100:00100000:0.0:1786562706.748061:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652967168:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562706.748095:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652967168:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562706.748102:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 533 00000100:00080000:0.0:1786562706.748125:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562706.748129:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562706.751126:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652967040 00000100:00100000:1.0:1786562706.751141:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652967040 00000100:00100000:1.0:1786562706.751217:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 320 00000100:00100000:1.0:1786562706.751228:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652967040:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562706.751306:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652967040:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 81us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562706.751316:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 320 00000100:00100000:2.0:1786562706.802353:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562706.802580:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652967552 00000100:00100000:1.0:1786562706.802591:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652967552 00000100:00100000:1.0:1786562706.802656:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17391 00000100:00100000:1.0:1786562706.802667:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:69566:x1873345652967552:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562706.802694:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562706.802715:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0cd2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd561 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.802793:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.802808:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.802820:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.802836:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.802843:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.802849:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803259:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803271:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803278:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803284:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562706.803288:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803296:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803309:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562706.803312:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562706.803317:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803322:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0cd9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803349:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803356:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803361:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803366:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562706.803369:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803374:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803381:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562706.803384:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562706.803400:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803406:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0ce0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803450:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0cd2 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd561 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803461:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562706.803464:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562706.803467:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0cd2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd561 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.803502:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1a00, rc 0) 00000100:00100000:1.0:1786562706.803573:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:69566:x1873345652967552:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 908us (1230us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562706.803581:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17391 00000100:00100000:0.0:1786562706.808965:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562706.809565:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652967808 00000100:00100000:1.0:1786562706.809576:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652967808 00000100:00100000:1.0:1786562706.809640:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17392 00000100:00100000:1.0:1786562706.809651:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69566:x1873345652967808:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562706.809674:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562706.809694:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd568 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.809986:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0cee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.810001:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0cee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.810035:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0cee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562706.810048:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4e9:0x0]: returning size 7680 00010000:00010000:1.0:1786562706.810237:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd568 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.810260:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0200/0x5c655bf6668a0cee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd568 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.810269:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562706.810273:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562706.810277:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0200, rc 0) 00000100:00100000:1.0:1786562706.810343:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:69566:x1873345652967808:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 694us (1389us total) trans 8589950831 rc 0/0 00000100:00100000:1.0:1786562706.810351:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17392 00000100:00100000:3.0:1786562706.816444:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562706.816536:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652967936 00000100:00100000:0.0:1786562706.816547:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652967936 00000100:00100000:0.0:1786562706.816609:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17393 00000100:00100000:0.0:1786562706.816619:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:69566:x1873345652967936:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562706.816702:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.816724:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.816735:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.816750:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.816757:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.816763:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817215:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817226:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817233:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562706.817267:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00000004:00200000:0.0:1786562706.817272:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562706.817285:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817299:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817310:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817317:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817323:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.817327:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817333:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817346:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562706.817349:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.817354:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817361:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0cfc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817373:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817380:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817386:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817391:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.817395:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817401:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817407:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46abc00) 00010000:00010000:0.0:1786562706.817410:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.817412:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817417:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0d03 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817432:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817439:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817445:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817451:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.817453:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817459:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817468:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:0.0:1786562706.817470:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.817474:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.817480:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0d0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562706.817576:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:69566:x1873345652967936:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 955us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562706.817586:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17393 00000100:00100000:3.0:1786562706.894781:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562706.897296:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652968192 00000100:00100000:2.0:1786562706.897311:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652968192 00000100:00100000:2.0:1786562706.897369:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17394 00000100:00100000:2.0:1786562706.897380:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:69567:x1873345652968192:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562706.897402:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562706.897423:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d11 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd56f expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.897499:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.897514:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.897526:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.897542:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.897549:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.897805:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898610:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898621:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898628:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898634:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.898640:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898647:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898662:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562706.898665:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.898670:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898677:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d18 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898691:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898697:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898703:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898708:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.898710:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898715:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898722:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332d00) 00010000:00010000:2.0:1786562706.898724:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.898727:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898733:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898774:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d11 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd56f expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898789:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562706.898791:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562706.898794:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d11 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd56f expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.898804:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562706.898939:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:69567:x1873345652968192:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1559us (4167us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562706.898948:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17394 00000100:00100000:1.0:1786562706.909842:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562706.910346:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652968320 00000100:00100000:2.0:1786562706.910356:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652968320 00000100:00100000:2.0:1786562706.910445:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17395 00000100:00100000:2.0:1786562706.910457:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:69567:x1873345652968320:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562706.910532:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910549:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910561:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910575:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910581:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910592:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910960:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910970:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.910977:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562706.911050:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00000004:00200000:2.0:1786562706.911055:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562706.911067:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911091:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911098:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911105:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911111:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.911115:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911122:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911134:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562706.911137:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.911153:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911159:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0d26 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911171:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911176:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911444:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911452:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.911455:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911461:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911469:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332d00) 00010000:00010000:2.0:1786562706.911472:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.911475:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911481:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a0d2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911498:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911503:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911508:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911513:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562706.911515:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911520:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911527:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:2.0:1786562706.911529:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562706.911532:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562706.911537:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a0d34 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562706.911626:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:69567:x1873345652968320:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1168us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562706.911639:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17395 00000100:00100000:0.0:1786562706.945680:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562706.945753:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652968576 00000100:00100000:0.0:1786562706.945762:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652968576 00000100:00100000:0.0:1786562706.945818:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17396 00000100:00100000:0.0:1786562706.945829:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:69569:x1873345652968576:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562706.945852:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562706.945884:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0d3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd576 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.946813:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.946831:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.946842:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.946857:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.946864:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.946871:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947603:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947612:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947618:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947623:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.947627:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947634:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947646:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562706.947649:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.947652:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947658:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0d42 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947667:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947672:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947679:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947684:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562706.947686:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947691:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947697:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46abc00) 00010000:00010000:0.0:1786562706.947699:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562706.947701:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947706:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0d49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947745:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0d3b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd576 expref: 22 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947755:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562706.947757:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562706.947760:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0d3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd576 expref: 22 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562706.947768:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562706.947829:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:69569:x1873345652968576:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2001us (2159us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562706.947841:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17396 00000100:00100000:1.0:1786562706.977105:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562706.977173:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652968704 00000100:00100000:1.0:1786562706.977185:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652968704 00000100:00100000:1.0:1786562706.977239:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17397 00000100:00100000:1.0:1786562706.977250:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:69569:x1873345652968704:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562706.977326:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977344:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977355:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977369:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977377:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977394:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977722:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977731:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977739:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562706.977772:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00000004:00200000:1.0:1786562706.977777:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562706.977791:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977805:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977811:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977818:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977824:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562706.977828:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977836:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977849:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562706.977853:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562706.977856:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977862:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d50 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977896:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.977902:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978200:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978206:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562706.978209:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978216:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978225:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562706.978227:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562706.978230:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978235:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978264:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978271:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978277:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978281:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562706.978284:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978293:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978300:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562706.978302:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562706.978305:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562706.978311:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a0d5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562706.978501:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:69569:x1873345652968704:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1250us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562706.978512:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17397 00000100:00100000:3.0:1786562707.023107:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.023146:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652968832 00000100:00100000:3.0:1786562707.023155:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652968832 00000100:00100000:3.0:1786562707.023209:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17398 00000100:00100000:3.0:1786562707.023220:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:69572:x1873345652968832:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562707.023242:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562707.023632:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0d65 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd57d expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.023696:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.023709:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.023720:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.023734:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.023741:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.023747:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024595:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024608:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024617:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562707.024655:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00000004:00200000:3.0:1786562707.024660:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562707.024677:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024688:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024697:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024703:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024710:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024717:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562707.024721:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024729:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024741:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:3.0:1786562707.024744:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562707.024748:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024754:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb000/0x5c655bf6668a0d6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024769:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024776:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024782:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024788:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cbc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562707.024791:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024797:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024804:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e999bb1d00) 00010000:00010000:3.0:1786562707.024807:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562707.024810:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024817:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0d73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024852:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0d65 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd57d expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024866:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd57d expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.024893:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562707.024895:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562707.024898:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb800, rc 0) 00000100:00100000:3.0:1786562707.025323:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+22:69572:x1873345652968832:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2102us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.025333:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17398 00000100:00100000:1.0:1786562707.035630:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.035887:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652968960 00000100:00100000:3.0:1786562707.035897:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652968960 00000100:00100000:3.0:1786562707.035968:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17969 00000100:00100000:3.0:1786562707.035980:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652968960:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562707.036000:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562707.036043:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd584 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562707.036069:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562707.036087:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=1139s v=(0 0) 00010000:00010000:3.0:1786562707.036092:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562707.036103:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.036123:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.036147:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850caa00, rc 0) 00000100:00100000:3.0:1786562707.036212:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652968960:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 234us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.036220:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17969 00000100:00100000:2.0:1786562707.045855:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.046072:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652969216 00000100:00100000:1.0:1786562707.046083:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652969216 00000100:00100000:1.0:1786562707.046137:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17399 00000100:00100000:1.0:1786562707.046148:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+22:69572:x1873345652969216:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562707.046261:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562707.046282:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd58b expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.046803:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d8f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.046819:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.046849:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562707.046884:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00010000:00010000:1.0:1786562707.047044:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a0d88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd58b expref: 25 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.047069:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd58b expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.047078:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562707.047081:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562707.047085:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0e00, rc 0) 00000100:00100000:1.0:1786562707.047146:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+24:69572:x1873345652969216:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 999us (1299us total) trans 8589950832 rc 0/0 00000100:00100000:1.0:1786562707.047162:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17399 00000100:00100000:1.0:1786562707.053239:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.053453:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652969344 00000100:00100000:0.0:1786562707.053462:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652969344 00000100:00100000:0.0:1786562707.053635:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 995 00000100:00100000:0.0:1786562707.053647:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345652969344:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562707.053666:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562707.053696:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a0d8f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd58b expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.053731:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:0.0:1786562707.053737:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562707.053808:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345652969344:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 163us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.053818:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 995 00000100:00100000:3.0:1786562707.054309:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.054334:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652969600 00000100:00100000:3.0:1786562707.054338:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652969600 00000100:00100000:3.0:1786562707.054372:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17400 00000100:00100000:3.0:1786562707.054390:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:69572:x1873345652969600:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562707.054415:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562707.054432:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0d9d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd592 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.054545:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0da4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.054560:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0da4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.054570:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0da4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562707.054582:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00010000:00010000:3.0:1786562707.054705:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cba00/0x5c655bf6668a0d9d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd592 expref: 26 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.054727:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0da4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd592 expref: 25 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.054735:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562707.054739:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562707.054742:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cbc00, rc 0) 00000100:00100000:3.0:1786562707.054781:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:69572:x1873345652969600:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 403us (474us total) trans 8589950833 rc 0/0 00000100:00100000:3.0:1786562707.054788:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17400 00000100:00100000:3.0:1786562707.065292:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.065376:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.068530:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652969728 00000100:00100000:3.0:1786562707.068545:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652969728 00000100:00100000:3.0:1786562707.068592:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652969856 00000100:00100000:3.0:1786562707.068595:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652969856 00000100:00100000:3.0:1786562707.068620:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17970 00000100:00100000:3.0:1786562707.068629:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652969728:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562707.068677:0:29964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.068698:0:29964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.068708:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562707.068712:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562707.068717:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.068755:0:29964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 9 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.068769:0:29964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 9 pid: 28861 timeout: 1239 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.068790:0:29964:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654936192:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562707.068898:0:29964:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988bce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562707.073958:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17971 00000100:00100000:3.0:1786562707.074756:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.074812:0:29964:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29964:1873345654936192:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562707.074842:0:29964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.074883:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652969984 00000100:00100000:3.0:1786562707.074889:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652969984 00010000:00010000:3.0:1786562707.075845:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 10 pid: 28861 timeout: 1239 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.076602:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8784 00000100:00100000:3.0:1786562707.076622:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652969984:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562707.076640:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562707.076668:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 10 pid: 28861 timeout: 1239 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.076685:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 10 pid: 28861 timeout: 1239 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.076711:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0d81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd584 expref: 10 pid: 28861 timeout: 1239 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.076733:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562707.076738:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562707.076744:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.076754:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.076782:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562707.076841:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652969984:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 226us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.076848:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8784 00010000:00010000:3.0:1786562707.076898:0:29964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.076992:0:29964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077037:0:29964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077046:0:29964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077054:0:29964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077062:0:29964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9850cb600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562707.077066:0:29964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077074:0:29964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077087:0:29964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.077094:0:29964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f660f67f/0x5c655bf6668a0db2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.077139:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652969728:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 8510us (11856us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.077147:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17970 00000100:00100000:1.0:1786562707.085137:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652969856:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1786562707.085194:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.085215:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.085224:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x725:0x0].0x0 since=13s v=(0 0) 00010000:00010000:1.0:1786562707.085229:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562707.085235:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.085274:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.085290:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 8 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.085305:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654936320:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562707.085403:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e990b26300 going to sleep for 11 seconds 00000100:00100000:2.0:1786562707.093726:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.093831:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652970112 00000100:00100000:0.0:1786562707.093842:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652970112 00010000:00010000:0.0:1786562707.093901:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 9 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.093938:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8785 00000100:00100000:0.0:1786562707.093948:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652970112:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562707.093963:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786562707.093983:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb size from disk: 0 -> 70254592 00002000:00010000:0.0:1786562707.093987:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb mtime from disk: 0 -> 1786562693 00002000:00010000:0.0:1786562707.093990:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb ctime from disk: 0 -> 1786562693 00002000:00010000:0.0:1786562707.093992:0:5807:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1786562707.093999:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 9 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.094038:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 9 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.094045:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873345654936320:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562707.094071:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0c93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 69206016->70254591) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd54c expref: 9 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.094085:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.094086:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562707.094095:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562707.094106:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.094862:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.103499:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562707.103585:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652970112:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 9631us (9861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.103601:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8785 00010000:00010000:2.0:1786562707.105116:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105143:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105188:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105198:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105209:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105216:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562707.105221:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105230:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105251:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.105259:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec48cb82/0x5c655bf6668a0db9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.105375:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345652969856:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 31399us (39995us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.105396:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17971 00000100:00100000:3.0:1786562707.113000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.113348:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652970368 00000100:00100000:1.0:1786562707.113437:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652970368 00000100:00100000:1.0:1786562707.113554:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17401 00000100:00100000:1.0:1786562707.113566:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:69572:x1873345652970368:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562707.113625:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786562707.113655:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb800/0x5c655bf6668a0d7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd57d expref: 25 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.113680:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cae00/0x5c655bf6668a0c8c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd545 expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.113694:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562707.113699:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562707.113731:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.113749:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.113758:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786562707.114476:0:33114:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x740:0x0], index 0: 0 00000040:00080000:1.0:1786562707.114621:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4409, 88 off357728 00000004:00080000:1.0:1786562707.114630:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1139556624110ns, next at 1090147499990ns, rc = 0 00000040:00080000:1.0:1786562707.114706:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4443, 88 off360776 00000004:00080000:1.0:1786562707.114713:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1139556707087ns, next at 1090147562949ns, rc = 0 00000040:00080000:1.0:1786562707.114756:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4444, 88 off360864 00000004:00080000:1.0:1786562707.114762:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1139556755979ns, next at 1090147562949ns, rc = 0 00000040:00080000:1.0:1786562707.114780:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4410, 88 off357816 00000004:00080000:1.0:1786562707.114785:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1139556779775ns, next at 1090147499990ns, rc = 0 00000004:00010000:1.0:1786562707.188588:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3615de3 reply state 00000000c06f692d transno 8589950834 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562707.188595:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950829 is committed 00000100:00100000:1.0:1786562707.188607:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1786562707.188613:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950834 is committed 00000004:00080000:2.0:1786562707.188619:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2913 committed 00000004:00080000:2.0:1786562707.188629:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2946 committed 00000004:00080000:2.0:1786562707.188637:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2945 committed 00000004:00080000:2.0:1786562707.188640:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2912 committed 00010000:00080000:1.0:1786562707.188726:0:33114:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1786562707.188746:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:69572:x1873345652970368:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 75178us (75751us total) trans 8589950834 rc 0/0 00000100:00100000:1.0:1786562707.188755:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17401 00000100:00100000:2.0:1786562707.189628:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654936448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562707.189701:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562707.189740:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562707.189747:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654936576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562707.189771:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562707.189802:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654936704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562707.189826:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562707.189844:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562707.189850:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654936832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562707.189890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562707.189934:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654936448 00000100:00100000:2.0:1786562707.189941:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654936448 00000100:00100000:2.0:1786562707.189988:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654936576 00000100:00100000:2.0:1786562707.189991:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654936576 00000100:00100000:2.0:1786562707.190371:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654936704 00000100:00100000:2.0:1786562707.190375:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654936704 00000100:00100000:2.0:1786562707.190470:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654936832 00000100:00100000:2.0:1786562707.190474:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654936832 00000100:00100000:2.0:1786562707.190490:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17972 00000100:00100000:2.0:1786562707.190498:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654936448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562707.191310:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654936448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 810us (1618us total) trans 21474843656 rc 0/0 00000100:00100000:2.0:1786562707.191320:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17972 00000100:00100000:2.0:1786562707.191344:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17973 00000100:00100000:2.0:1786562707.191353:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654936576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562707.192331:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654936576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 551us (2130us total) trans 21474843657 rc 0/0 00000100:00100000:2.0:1786562707.192342:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17973 00000100:00100000:2.0:1786562707.192364:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17974 00000100:00100000:2.0:1786562707.192373:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654936704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562707.192585:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654936704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (2757us total) trans 17179876142 rc 0/0 00000100:00100000:2.0:1786562707.192592:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17974 00000100:00100000:2.0:1786562707.192606:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17975 00000100:00100000:2.0:1786562707.192613:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654936832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562707.192727:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654936832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (2843us total) trans 17179876143 rc 0/0 00000100:00100000:2.0:1786562707.192734:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17975 00000100:00080000:2.0:1786562707.192789:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562707.192794:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1786562707.192844:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b35d3b80/2, rc 0, transno 17179876143 00000100:00100000:2.0:1786562707.192850:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654936832:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1786562707.192862:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b35d1880/2, rc 0, transno 17179876142 00000100:00100000:2.0:1786562707.192865:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654936704:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1786562707.192917:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e886c1ca80/2, rc 0, transno 21474843657 00000100:00100000:2.0:1786562707.192923:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654936576:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1786562707.192933:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883179880/2, rc 0, transno 21474843656 00000100:00100000:2.0:1786562707.192936:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654936448:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1786562707.195291:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.195308:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.195321:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.195328:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.195332:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.195341:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.195356:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562707.195361:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562707.195366:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.195372:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dc0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.204498:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.205085:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652970496 00000100:00100000:3.0:1786562707.205097:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652970496 00000100:00100000:3.0:1786562707.205798:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17402 00000100:00100000:3.0:1786562707.206298:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:69572:x1873345652970496:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562707.206324:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562707.206343:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd599 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.206898:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.206997:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.207045:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562707.207048:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562707.208237:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850cb600, rc 0) 00000100:00100000:3.0:1786562707.208320:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:69572:x1873345652970496:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2025us (3829us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.216531:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17402 00000100:00100000:3.0:1786562707.219888:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.220131:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652970624 00000100:00100000:0.0:1786562707.220147:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652970624 00000100:00100000:0.0:1786562707.220256:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17403 00000100:00100000:0.0:1786562707.220268:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69572:x1873345652970624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562707.220291:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562707.220312:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0dce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5a0 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.220401:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0dd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.220417:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.220428:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562707.220455:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254593 00000004:00200000:0.0:1786562707.220461:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562707.220477:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.221117:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0dce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a0 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.221140:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a0 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.221150:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:0.0:1786562707.221153:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562707.221157:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:0.0:1786562707.221232:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:69572:x1873345652970624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 966us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.221244:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17403 00000100:00100000:2.0:1786562707.229671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.230370:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.235388:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652970880 00000100:00100000:3.0:1786562707.235401:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652970880 00000100:00100000:2.0:1786562707.235800:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652970752 00000100:00100000:2.0:1786562707.235806:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652970752 00000100:00100000:2.0:1786562707.235837:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17976 00000100:00100000:2.0:1786562707.235846:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345652970880:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562707.235863:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562707.235895:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5ae expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562707.235930:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x725:0x0] initial LVB size: 70254592, mtime: 0x6a7cc885, atime: 0x0, ctime: 0x6a7cc885, blocks: 0x807 00010000:00010000:2.0:1786562707.235948:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=1139s v=(0 0) 00010000:00010000:2.0:1786562707.235953:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.235963:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 8 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.235980:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 8 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.235999:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:3.0:1786562707.236117:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17977 00000100:00100000:3.0:1786562707.236128:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652970752:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562707.236137:0:29964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562707.236149:0:29964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5a7 expref: -99 pid: 29964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562707.236166:0:29964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562707.236176:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=1139s v=(0 0) 00010000:00010000:3.0:1786562707.236180:0:29964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562707.236187:0:29964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 9 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.236199:0:29964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 9 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.236207:0:29964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9850caa00, rc 0) 00000100:00100000:3.0:1786562707.236268:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652970752:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 142us (5901us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.236275:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17977 00000100:00100000:2.0:1786562707.237187:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652970880:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1338us (7522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.237195:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17976 00010000:00010000:0.0:1786562707.238325:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562707.343848:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.347250:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971008 00000100:00100000:3.0:1786562707.347265:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971008 00000100:00100000:3.0:1786562707.347337:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17978 00000100:00100000:3.0:1786562707.347348:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652971008:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:1.0:1786562707.433998:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876143 is committed 00000100:00100000:3.0:1786562707.441917:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652971008:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 94558us (98066us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562707.441943:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17978 00000100:00100000:3.0:1786562707.452440:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.452608:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971136 00000100:00100000:2.0:1786562707.452617:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971136 00000100:00100000:2.0:1786562707.452677:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17979 00000100:00100000:2.0:1786562707.452688:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652971136:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:2.0:1786562707.452856:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652971136:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 169us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.452875:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17979 00000100:00100000:0.0:1786562707.460740:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.460841:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971392 00000100:00100000:1.0:1786562707.460852:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971392 00000100:00100000:1.0:1786562707.460923:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17404 00000100:00100000:1.0:1786562707.460934:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:69572:x1873345652971392:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562707.460990:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562707.461056:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0dd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a0 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.461094:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562707.461100:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562707.461737:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.461754:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.461765:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562707.461838:0:34450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950835 00000004:00010000:1.0:1786562707.461881:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd2b6f89 reply state 00000000e5b54fac transno 8589950836 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.461890:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562707.461988:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:69572:x1873345652971392:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1054us (1255us total) trans 8589950836 rc 0/0 00000100:00100000:1.0:1786562707.461996:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17404 00000020:00080000:1.0:1786562707.462001:0:34450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786562707.465575:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.465592:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.465600:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.465610:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562707.465614:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.465622:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.465639:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562707.465642:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562707.465646:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.465651:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a0dea lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.466969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.467516:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971520 00000100:00100000:2.0:1786562707.467527:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971520 00000100:00100000:2.0:1786562707.467628:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17980 00000100:00100000:2.0:1786562707.467650:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:69572:x1873345652971520:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562707.467671:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562707.467696:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5b5 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786562707.467724:0:29963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786562707.467745:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=1139s v=(0 0) 00010000:00010000:2.0:1786562707.467750:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.467761:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.467777:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 9 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.467789:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd400, rc 0) 00000100:00100000:2.0:1786562707.467853:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+9:69572:x1873345652971520:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 215us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.467860:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17980 00000100:00100000:2.0:1786562707.474875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.475729:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971648 00000100:00100000:0.0:1786562707.475742:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971648 00000100:00100000:0.0:1786562707.475809:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17981 00000100:00100000:0.0:1786562707.475821:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:69572:x1873345652971648:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562707.475838:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562707.475859:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5bc expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562707.475899:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562707.475918:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=1139s v=(0 0) 00010000:00010000:0.0:1786562707.475923:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562707.475932:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 10 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.475948:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 10 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.475962:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:0.0:1786562707.476066:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+10:69572:x1873345652971648:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 239us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.476073:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17981 00000100:00100000:0.0:1786562707.483482:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.483791:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971776 00000100:00100000:1.0:1786562707.483801:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971776 00002000:00010000:1.0:1786562707.483841:0:29463:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1856 (10485760->18446744073709551615) 00002000:00100000:1.0:1786562707.483845:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9920e00 with x1873345652971776 ext(10485760->18446744073709551615) 00002000:00010000:1.0:1786562707.483858:0:29463:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a9920e00. 00000100:00100000:1.0:1786562707.483933:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11659 00000100:00100000:1.0:1786562707.483943:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652971776:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:1.0:1786562707.484291:0:29463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:1.0:1786562707.484295:0:29463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb mtime from disk: 0 -> 1786562706 00002000:00010000:1.0:1786562707.484298:0:29463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786562707.484300:0:29463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb ctime from disk: 0 -> 1786562706 00002000:00010000:1.0:1786562707.484302:0:29463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562707.484359:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652971776:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 417us (886us total) trans 21474843658 rc 0/0 00000100:00100000:1.0:1786562707.484368:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11659 00002000:00010000:1.0:1786562707.484372:0:29463:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1856 (10485760->18446744073709551615) 00002000:00100000:1.0:1786562707.484375:0:29463:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9a9920e00 with x1873345652971776 ext(10485760->18446744073709551615) 00002000:00010000:1.0:1786562707.484380:0:29463:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9a9920e00. 00000100:00100000:1.0:1786562707.487836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.487947:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652971904 00000100:00100000:2.0:1786562707.487957:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652971904 00000100:00100000:2.0:1786562707.488042:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17405 00000100:00100000:2.0:1786562707.488053:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:69572:x1873345652971904:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562707.488236:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562707.488258:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0dff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5c3 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.488344:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0e06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.488360:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0e06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.488370:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0e06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562707.488471:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 10485760 00000004:00200000:2.0:1786562707.488477:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562707.488495:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0e06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.488523:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a0dff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5c3 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.488542:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0e06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5c3 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.488550:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:2.0:1786562707.488553:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562707.488557:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562707.488677:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:69572:x1873345652971904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 625us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.488685:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17405 00000100:00100000:2.0:1786562707.497842:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.500490:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652972032 00000100:00100000:1.0:1786562707.500504:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652972032 00000100:00100000:1.0:1786562707.500590:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11660 00000100:00100000:1.0:1786562707.500601:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652972032:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:1.0:1786562707.500639:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.500665:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562707.500670:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562707.500677:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.500692:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534810:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534834:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534850:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534859:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562707.534877:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534886:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534907:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.534916:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1a893d/0x5c655bf6668a0e0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.535367:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652972032:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 34762us (37530us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562707.535379:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11660 00000100:00100000:1.0:1786562707.546589:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.546733:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652972160 00000100:00100000:0.0:1786562707.546743:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652972160 00000100:00100000:0.0:1786562707.546821:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11661 00000100:00100000:0.0:1786562707.546832:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345652972160:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562707.546884:0:13913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.546905:0:13913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 11 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.546915:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562707.546920:0:13913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562707.546925:0:13913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.546961:0:13913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 11 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.546976:0:13913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 11 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.546991:0:13913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:13913:1873345654936960:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562707.547245:0:13913:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562707.550843:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.550948:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652972288 00000100:00100000:1.0:1786562707.550957:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652972288 00010000:00010000:1.0:1786562707.551406:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 12 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.551459:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8786 00000100:00100000:1.0:1786562707.551471:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652972288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562707.551486:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562707.551507:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 12 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.551521:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 12 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.551550:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562707.551555:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562707.551560:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.551570:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.551591:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562707.552351:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652972288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 878us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.552362:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8786 00010000:00010000:3.0:1786562707.553337:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001122ba44/0x5c655bf6668a0df8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5bc expref: 11 pid: 29965 timeout: 1239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.553360:0:13913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:13913:1873345654936960:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562707.553388:0:13913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.554857:0:13913:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.554886:0:13913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786562707.700975:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843659 is committed 00002000:00010000:0.0:1786562707.702414:0:13913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb size from disk: 10485760 -> 70254592 00002000:00010000:0.0:1786562707.702424:0:13913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1786562707.702444:0:13913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.702538:0:13913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.702550:0:13913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.702559:0:13913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562707.702565:0:13913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.702576:0:13913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.702605:0:13913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.702614:0:13913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.702760:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652972160:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 155922us (156175us total) trans 21474843659 rc 0/0 00000100:00100000:0.0:1786562707.702774:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11661 00000001:00080000:1.0:1786562707.702881:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843657 is committed 00000100:00100000:2.0:1786562707.743782:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562707.743906:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652972544 00000100:00100000:3.0:1786562707.743919:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652972544 00000100:00100000:3.0:1786562707.744002:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17406 00000100:00100000:3.0:1786562707.744072:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+22:69572:x1873345652972544:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562707.744158:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562707.744436:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a0e06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5c3 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562707.744465:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562707.744472:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562707.748622:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.748658:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.748679:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562707.748751:0:36756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950837 00000004:00010000:2.0:1786562707.748783:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e3660d6 reply state 00000000de71ce8d transno 8589950838 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.748793:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562707.749064:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:69572:x1873345652972544:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 4989us (5281us total) trans 8589950838 rc 0/0 00000100:00100000:2.0:1786562707.749076:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17406 00000020:00080000:2.0:1786562707.749083:0:36756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786562707.750416:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654937216:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.750505:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.750575:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654937728:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.750605:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.750637:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786562707.750644:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654937088:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.750678:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.750704:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654937600:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.750732:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.750764:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654937344:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.750792:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.750812:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562707.750818:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654937472:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.750841:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.750889:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937088 00000100:00100000:1.0:1786562707.750899:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937088 00000100:00100000:1.0:1786562707.750957:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786562707.750968:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654937088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751059:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654937088:12345-0@lo:400:kworker.0 Request processed in 93us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.751067:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786562707.751111:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937600 00000100:00100000:1.0:1786562707.751115:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937600 00000100:00100000:1.0:1786562707.751146:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937472 00000100:00100000:1.0:1786562707.751149:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937472 00000100:00100000:1.0:1786562707.751169:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1786562707.751176:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654937600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751212:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654937600:12345-0@lo:400:kworker.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.751222:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1786562707.751235:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1786562707.751242:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751276:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654937472:12345-0@lo:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.751282:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1786562707.751301:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937216 00000100:00100000:1.0:1786562707.751304:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937216 00000100:00100000:1.0:1786562707.751341:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937728 00000100:00100000:1.0:1786562707.751344:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937728 00000100:00100000:1.0:1786562707.751361:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937344 00000100:00100000:1.0:1786562707.751364:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937344 00000100:00100000:1.0:1786562707.751386:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1786562707.751393:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654937216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751427:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654937216:12345-0@lo:400:kworker.0 Request processed in 35us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.751434:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1786562707.751447:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1786562707.751453:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654937728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751482:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654937728:12345-0@lo:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.751488:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1786562707.751499:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1786562707.751505:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654937344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751533:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654937344:12345-0@lo:400:kworker.0 Request processed in 28us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.751542:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:1.0:1786562707.751572:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562707.751613:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843657 gen 2 00000004:00080000:1.0:1786562707.751620:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179880, transno 21474843656 00000004:00080000:1.0:1786562707.751631:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e886c1ca80, transno 21474843657 00000100:00100000:1.0:1786562707.751640:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654937472:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.751655:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654937344:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.752277:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654937088:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.752292:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876143 gen 2 00000004:00080000:1.0:1786562707.752296:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b35d1880, transno 17179876142 00000004:00080000:1.0:1786562707.752311:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b35d3b80, transno 17179876143 00000100:00100000:1.0:1786562707.752316:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654937600:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.752332:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654937216:0@lo:400:kworker.0 00000100:00100000:1.0:1786562707.752343:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654937728:0@lo:400:kworker.0 00000100:00100000:2.0:1786562707.753308:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562707.753330:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654937856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562707.753401:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562707.755392:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937856 00000100:00100000:0.0:1786562707.755414:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937856 00000100:00100000:0.0:1786562707.755518:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1786562707.755532:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654937856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562707.755587:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3845128192 avail 3843031040 00000100:00100000:0.0:1786562707.755695:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654937856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.755704:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1786562707.755776:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654937856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562707.757793:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562707.757819:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654937984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562707.757920:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562707.757976:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654937984 00000100:00100000:0.0:1786562707.757984:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654937984 00000100:00100000:0.0:1786562707.758281:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1786562707.758294:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654937984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562707.758323:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3834642432 00000100:00100000:0.0:1786562707.758795:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654937984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 502us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.758804:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00010000:00010000:1.0:1786562707.759654:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.759670:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.759679:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.759687:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.759693:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.759703:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.759724:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562707.759727:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.759733:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.759739:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0e1b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.759952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.760429:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652972672 00000100:00100000:0.0:1786562707.760441:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652972672 00000100:00100000:0.0:1786562707.760496:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17982 00000100:00100000:0.0:1786562707.760506:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:69572:x1873345652972672:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562707.760529:0:28861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562707.760554:0:28861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5ca expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562707.760591:0:28861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x740:0x0] initial LVB size: 70254592, mtime: 0x6a7cc892, atime: 0x0, ctime: 0x6a7cc892, blocks: 0x807 00010000:00010000:0.0:1786562707.760619:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=1140s v=(0 0) 00010000:00010000:0.0:1786562707.760625:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562707.760637:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.760655:0:28861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 10 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.760669:0:28861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268600, rc 0) 00000100:00100000:0.0:1786562707.760739:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:69572:x1873345652972672:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 234us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.760747:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17982 00000100:00100000:2.0:1786562707.761762:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654937984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562707.766713:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.768734:0:14017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652972800 00000100:00100000:1.0:1786562707.768755:0:14017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652972800 00002000:00010000:1.0:1786562707.768825:0:14017:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1856 (70254592->18446744073709551615) 00002000:00100000:1.0:1786562707.768832:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c52dc00 with x1873345652972800 ext(70254592->18446744073709551615) 00002000:00010000:1.0:1786562707.768848:0:14017:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88c52dc00. 00000100:00100000:1.0:1786562707.768909:0:14017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11662 00000100:00100000:1.0:1786562707.768923:0:14017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652972800:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562707.771938:0:14017:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb size from disk: 70254592 -> 70254592 00002000:00010000:0.0:1786562707.771951:0:14017:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb mtime from disk: 1786562706 -> 1786562707 00002000:00010000:0.0:1786562707.771954:0:14017:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562707.771957:0:14017:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb ctime from disk: 1786562706 -> 1786562707 00002000:00010000:0.0:1786562707.771960:0:14017:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1786562707.772092:0:14017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652972800:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 3164us (5384us total) trans 21474843660 rc 0/0 00000100:00100000:0.0:1786562707.772108:0:14017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11662 00002000:00010000:0.0:1786562707.772115:0:14017:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1856 (70254592->18446744073709551615) 00002000:00100000:0.0:1786562707.772119:0:14017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e88c52dc00 with x1873345652972800 ext(70254592->18446744073709551615) 00002000:00010000:0.0:1786562707.772128:0:14017:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e88c52dc00. 00000100:00100000:3.0:1786562707.775581:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.775965:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973056 00000100:00100000:2.0:1786562707.775979:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973056 00000100:00100000:2.0:1786562707.776121:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17407 00000100:00100000:2.0:1786562707.776134:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:69572:x1873345652973056:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562707.776291:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.776314:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.776328:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562707.776528:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f9419ab reply state 00000000467652e3 transno 8589950839 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.776539:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562707.776668:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+25:69572:x1873345652973056:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 536us (1103us total) trans 8589950839 rc 0/0 00000100:00100000:2.0:1786562707.776677:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17407 00010000:00010000:2.0:1786562707.778829:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.778850:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.778875:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.778882:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562707.778887:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.778896:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.778917:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:2.0:1786562707.778921:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562707.778927:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.778934:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e29 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.789141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.790085:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973184 00000100:00100000:2.0:1786562707.790101:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973184 00000100:00100000:2.0:1786562707.790201:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17983 00000100:00100000:2.0:1786562707.790214:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+11:69572:x1873345652973184:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562707.790238:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562707.790263:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5d1 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.790309:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.790320:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562707.790326:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.790332:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->67108863] (req 0->67108863) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.790378:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.790395:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.790413:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654938112:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562707.790532:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562707.796830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.796979:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654938112:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562707.797062:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->67108863] (req 0->67108863) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.797093:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfda00, rc 0) 00000100:00100000:2.0:1786562707.797189:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+12:69572:x1873345652973184:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6977us (8063us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.797201:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17983 00000100:00100000:3.0:1786562707.801038:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973312 00000100:00100000:3.0:1786562707.801250:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973312 00010000:00010000:2.0:1786562707.801414:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.801474:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8787 00000100:00100000:2.0:1786562707.801487:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652973312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562707.801513:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562707.801546:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.801562:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.801591:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940380a2/0x5c655bf6668a0de3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5a7 expref: 12 pid: 29964 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.801615:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.801621:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.801631:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.801645:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.801694:0:35896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.801712:0:35896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654938240:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562707.801936:0:35896:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562707.806447:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.806597:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973440 00000100:00100000:1.0:1786562707.806610:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973440 00000100:00100000:1.0:1786562707.806677:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17984 00000100:00100000:1.0:1786562707.806688:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:69572:x1873345652973440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562707.806712:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562707.806735:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5d8 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.806783:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.806793:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786562707.806799:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562707.806805:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [67108864->134217727] (req 67108864->134217727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.806844:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 10 pid: 28861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.806869:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 10 pid: 28861 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.806885:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654938368:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562707.806986:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baeb6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562707.807500:0:35896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35896:1873345654938240:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562707.807522:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562707.807563:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652973312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6079us (10749us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.807575:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8787 00000100:00100000:0.0:1786562707.814273:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.814389:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973568 00000100:00100000:2.0:1786562707.814402:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973568 00010000:00010000:2.0:1786562707.814456:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 11 pid: 28861 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.814507:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8788 00000100:00100000:2.0:1786562707.814518:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652973568:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562707.814538:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562707.814567:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 11 pid: 28861 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.814603:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 11 pid: 28861 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.814640:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.814645:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562707.814655:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.814668:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.814719:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.814739:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654938496:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562707.814866:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b480 going to sleep for 11 seconds 00010000:00010000:1.0:1786562707.815387:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51850bf/0x5c655bf6668a0ddc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ae expref: 11 pid: 28861 timeout: 1240 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.815407:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873345654938368:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562707.815446:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.815465:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:1.0:1786562707.815560:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:69572:x1873345652973440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8872us (9124us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.815570:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17984 00000100:00100000:0.0:1786562707.818677:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.818750:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.818905:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973696 00000100:00100000:1.0:1786562707.818918:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973696 00000100:00100000:1.0:1786562707.818980:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652973824 00000100:00100000:1.0:1786562707.818983:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652973824 00000100:00100000:1.0:1786562707.819038:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17985 00000100:00100000:1.0:1786562707.819052:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652973696:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562707.819402:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562707.819407:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb mtime from disk: 0 -> 1786562693 00002000:00010000:1.0:1786562707.819410:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb atime from disk: 0 -> 1786562681 00002000:00010000:1.0:1786562707.819412:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb ctime from disk: 0 -> 1786562707 00002000:00010000:1.0:1786562707.819414:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786562707.819504:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17986 00000100:00100000:1.0:1786562707.819504:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652973696:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 451us (840us total) trans 21474843661 rc 0/0 00000100:00100000:1.0:1786562707.819521:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17985 00000100:00100000:3.0:1786562707.819533:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652973824:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562707.819820:0:29963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb size from disk: 70254592 -> 70254592 00002000:00010000:3.0:1786562707.819824:0:29963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb mtime from disk: 1786562693 -> 1786562693 00002000:00010000:3.0:1786562707.819827:0:29963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb atime from disk: 0 -> 1786562681 00002000:00010000:3.0:1786562707.819829:0:29963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb ctime from disk: 1786562693 -> 1786562707 00002000:00010000:3.0:1786562707.819831:0:29963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562707.819922:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+11:2349:x1873345652973824:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 401us (1171us total) trans 17179876144 rc 0/0 00000100:00100000:3.0:1786562707.819931:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17986 00000100:00100000:2.0:1786562707.820803:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873345654938496:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562707.820845:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562707.820909:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652973568:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6391us (6653us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562707.820919:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8788 00000100:00100000:0.0:1786562707.835047:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.835614:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652974080 00000100:00100000:2.0:1786562707.835633:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652974080 00000100:00100000:2.0:1786562707.835723:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6344 00000100:00100000:2.0:1786562707.835739:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:69572:x1873345652974080:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1786562707.835837:0:35899:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4ea:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0da4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd592 expref: 24 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.835920:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.835938:0:35899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.835948:0:35899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.835993:0:35899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.836053:0:35899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 24 pid: 36756 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562707.836072:0:35899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654938624:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562707.836206:0:35899:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562707.839365:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.839556:0:35899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:35899:1873345654938624:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562707.839594:0:35899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.842660:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652974208 00000100:00100000:0.0:1786562707.842853:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652974208 00010000:00010000:0.0:1786562707.842917:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 25 pid: 36756 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562707.843073:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8789 00000100:00100000:0.0:1786562707.843087:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345652974208:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562707.843106:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562707.843113:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 25 pid: 36756 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.843129:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 25 pid: 36756 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.843152:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cb600/0x5c655bf6668a0dc7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd599 expref: 25 pid: 36756 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.843170:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:0.0:1786562707.843176:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.843190:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.843197:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.843227:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562707.843298:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345652974208:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 214us (3942us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.843307:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8789 00010000:00010000:2.0:1786562707.843339:0:35899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562707.843362:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786562707.844885:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4411, 88 off357904 00000004:00080000:2.0:1786562707.844904:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1140286897549ns, next at 1090147499990ns, rc = 0 00000040:00080000:2.0:1786562707.845097:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4445, 88 off360952 00000004:00080000:2.0:1786562707.845104:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1140287097913ns, next at 1090147562949ns, rc = 0 00000040:00080000:2.0:1786562707.845153:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4446, 88 off361040 00000004:00080000:2.0:1786562707.845158:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1140287152230ns, next at 1090147562949ns, rc = 0 00000040:00080000:2.0:1786562707.845191:0:35899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4412, 88 off357992 00000004:00080000:2.0:1786562707.845197:0:35899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1140287191074ns, next at 1090147499990ns, rc = 0 00000004:00010000:3.0:1786562707.870791:0:35899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d92f046 reply state 00000000ec738270 transno 8589950840 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.870815:0:35899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786562707.870831:0:35899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562707.870836:0:35899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562707.870849:0:35899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9850cbc00/0x5c655bf6668a0da4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd592 expref: 24 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562707.871082:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:69572:x1873345652974080:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 35347us (36081us total) trans 8589950840 rc 0/0 00000100:00100000:3.0:1786562707.871096:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6344 00000001:00080000:2.0:1786562707.871698:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950836 is committed 00000001:00080000:2.0:1786562707.871765:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950840 is committed 00000004:00080000:2.0:1786562707.871771:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2915 committed 00000004:00080000:2.0:1786562707.871821:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2948 committed 00000004:00080000:2.0:1786562707.871839:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2947 committed 00000004:00080000:2.0:1786562707.871842:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2914 committed 00010000:00010000:1.0:1786562707.871886:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.871898:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.871906:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.871918:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.871924:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.871932:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.871950:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:1.0:1786562707.871954:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562707.871959:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.871965:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0e3e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.872206:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654938752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562707.872282:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562707.872373:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562707.872380:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654938880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562707.872409:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562707.872692:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654939008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562707.872731:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654939136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562707.873062:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654938752 00000100:00100000:0.0:1786562707.873073:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654938752 00000100:00100000:0.0:1786562707.873126:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654938880 00000100:00100000:0.0:1786562707.873130:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654938880 00000100:00100000:0.0:1786562707.873154:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17987 00000100:00100000:0.0:1786562707.873165:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654938752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562707.873479:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb size from disk: 70254592 -> 70254592 00002000:00010000:0.0:1786562707.873484:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb mtime from disk: 1786562693 -> 1786562693 00002000:00010000:0.0:1786562707.873486:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb atime from disk: 1786562681 -> 1786562681 00002000:00010000:0.0:1786562707.873489:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb ctime from disk: 1786562707 -> 1786562707 00002000:00010000:0.0:1786562707.873492:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x725:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562707.873557:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562707.873612:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939136 00000100:00100000:3.0:1786562707.873617:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939136 00000100:00100000:3.0:1786562707.873648:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17988 00000100:00100000:3.0:1786562707.873656:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654938880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786562707.873764:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x724:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786562707.873768:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x724:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1786562707.873770:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x724:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562707.873772:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x724:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1786562707.873774:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x724:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786562707.873815:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3289:x1873345654938880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (1405us total) trans 17179876146 rc 0/0 00000100:00100000:3.0:1786562707.873822:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17988 00000100:00100000:3.0:1786562707.873843:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17989 00000100:00100000:3.0:1786562707.873850:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654939136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562707.873991:0:28861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb size from disk: 70254592 -> 70254592 00002000:00010000:3.0:1786562707.873994:0:28861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb mtime from disk: 1786562707 -> 1786562707 00002000:00010000:3.0:1786562707.873996:0:28861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786562707.873999:0:28861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb ctime from disk: 1786562707 -> 1786562707 00002000:00010000:3.0:1786562707.874002:0:28861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x740:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1786562707.874067:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654939136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (509us total) trans 21474843662 rc 0/0 00000100:00100000:3.0:1786562707.874074:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17989 00000100:00100000:3.0:1786562707.874104:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562707.874141:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939008 00000100:00100000:3.0:1786562707.874146:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939008 00000100:00100000:3.0:1786562707.874173:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17990 00000100:00100000:3.0:1786562707.874179:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654939008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786562707.874265:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786562707.874268:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb mtime from disk: 1786562693 -> 1786562693 00002000:00010000:3.0:1786562707.874271:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb atime from disk: 1786562681 -> 1786562681 00002000:00010000:3.0:1786562707.874273:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb ctime from disk: 1786562707 -> 1786562707 00002000:00010000:3.0:1786562707.874275:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786562707.874309:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654939008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (204us total) trans 21474843663 rc 0/0 00000100:00100000:3.0:1786562707.874317:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17990 00000004:00080000:3.0:1786562707.874365:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c52e680/2, rc 0, transno 21474843663 00000100:00100000:3.0:1786562707.874372:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654939008:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1786562707.874391:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88c52ce00/2, rc 0, transno 21474843662 00000100:00100000:3.0:1786562707.874394:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654939136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562707.874571:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f4e00/2, rc 0, transno 17179876146 00000100:00100000:1.0:1786562707.874577:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654938880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562707.874767:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654938752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1603us (2485us total) trans 17179876145 rc 0/0 00000100:00100000:0.0:1786562707.874775:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17987 00000004:00080000:1.0:1786562707.875211:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9b42f5c00/2, rc 0, transno 17179876145 00000100:00100000:1.0:1786562707.875218:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654938752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562707.879781:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.879894:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652974336 00000100:00100000:1.0:1786562707.879912:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652974336 00000100:00100000:1.0:1786562707.880101:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17408 00000100:00100000:1.0:1786562707.880116:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:69572:x1873345652974336:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562707.880151:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562707.880186:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a0e45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5df expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.880270:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a0e45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5df expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.880290:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a0e45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5df expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.881486:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562707.881496:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562707.881501:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0800, rc 0) 00000100:00100000:0.0:1786562707.883407:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:69572:x1873345652974336:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3276us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562707.883425:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17408 00000100:00100000:3.0:1786562707.887640:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562707.887767:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652974592 00000100:00100000:2.0:1786562707.887787:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652974592 00000100:00100000:2.0:1786562707.887896:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6345 00000100:00100000:2.0:1786562707.887909:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+18:69572:x1873345652974592:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562707.888403:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69572:x1873345652974592:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 495us (770us total) trans 8589950841 rc 0/0 00000100:00100000:2.0:1786562707.888413:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6345 00000100:00100000:3.0:1786562707.912444:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.912850:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652974848 00000100:00100000:0.0:1786562707.912878:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652974848 00000100:00100000:0.0:1786562707.912972:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17409 00000100:00100000:0.0:1786562707.912985:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69573:x1873345652974848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562707.913063:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562707.913091:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0e4c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5e6 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913203:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913221:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913234:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913250:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913258:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913265:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913696:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913705:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913716:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913722:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562707.913727:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913735:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913748:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562707.913752:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562707.913756:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913762:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0e53 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913776:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913782:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913788:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913793:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562707.913796:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913805:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913812:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46ab600) 00010000:00010000:0.0:1786562707.913814:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562707.913817:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913823:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0e5a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913878:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0e4c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5e6 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913890:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562707.913892:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562707.913896:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0e4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5e6 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562707.913906:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268a00, rc 0) 00000100:00100000:0.0:1786562707.913998:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69573:x1873345652974848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1014us (1563us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562707.914048:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17409 00000100:00100000:3.0:1786562707.921572:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562707.925573:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652974976 00000100:00100000:0.0:1786562707.925589:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652974976 00000100:00100000:1.0:1786562707.925789:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17410 00000100:00100000:1.0:1786562707.925808:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:69573:x1873345652974976:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562707.925929:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.925951:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.925965:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.925983:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.925990:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.925997:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926491:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926504:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926514:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562707.926560:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:1.0:1786562707.926566:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562707.926582:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926611:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926618:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926626:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926632:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.926637:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926646:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926664:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562707.926668:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.926673:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926679:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e61 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926715:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926722:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926727:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926732:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.926734:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926740:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926748:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562707.926750:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.926753:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926759:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926779:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926785:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926791:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926798:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.926801:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926806:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926813:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562707.926815:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.926818:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.926824:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e6f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.926985:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:69573:x1873345652974976:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1178us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.926998:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17410 00000100:00100000:3.0:1786562707.968662:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.968788:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652975232 00000100:00100000:1.0:1786562707.968807:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652975232 00000100:00100000:1.0:1786562707.968917:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17411 00000100:00100000:1.0:1786562707.968931:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:69578:x1873345652975232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562707.968959:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562707.968990:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5ed expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969145:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969163:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969176:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969194:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969202:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969209:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969668:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969678:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969685:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969696:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.969702:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969709:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969725:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562707.969728:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.969733:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969739:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969774:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969782:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969787:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969792:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.969796:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969801:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969814:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562707.969817:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.969820:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969825:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969887:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e76 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ed expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969899:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562707.969901:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562707.969905:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e76 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ed expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.969930:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1200, rc 0) 00000100:00100000:1.0:1786562707.970080:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:69578:x1873345652975232:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1151us (1428us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562707.970091:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17411 00000100:00100000:0.0:1786562707.977710:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562707.977812:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652975360 00000100:00100000:1.0:1786562707.977829:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652975360 00000100:00100000:1.0:1786562707.977928:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17412 00000100:00100000:1.0:1786562707.977941:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:69578:x1873345652975360:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562707.978085:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978112:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978125:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978144:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978153:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978160:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978695:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978706:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978714:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562707.978756:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:1.0:1786562707.978761:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562707.978776:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978792:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978803:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978812:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978819:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.978824:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978832:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978846:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562707.978862:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.978869:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978877:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0e8b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978913:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978920:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978927:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978933:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.978937:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978943:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978950:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562707.978953:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.978956:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978962:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0e92 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.978993:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.979000:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.979055:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.979061:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562707.979064:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.979070:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.979077:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562707.979080:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562707.979083:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562707.979090:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0e99 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562707.979203:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:69578:x1873345652975360:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1260us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562707.979215:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17412 00000100:00100000:3.0:1786562708.061085:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562708.061416:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652975616 00000100:00100000:1.0:1786562708.061435:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652975616 00000100:00100000:1.0:1786562708.061560:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17413 00000100:00100000:1.0:1786562708.061574:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69584:x1873345652975616:12345-192.168.204.29@tcp:101:lfs.0 00000100:00080000:2.0:1786562708.061754:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562708.061806:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562708.061836:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0ea0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5f4 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.061953:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.061971:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.061986:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062041:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062050:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062063:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062780:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062791:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062800:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062807:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562708.062813:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062822:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062839:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562708.062843:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562708.062848:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062867:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0ea7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062908:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062915:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062922:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062928:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562708.062931:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062938:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062946:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562708.062949:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562708.062953:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.062959:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0eae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.063159:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0ea0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5f4 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.063172:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562708.063186:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562708.063191:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a0ea0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5f4 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.063205:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0000, rc 0) 00000100:00100000:1.0:1786562708.063303:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69584:x1873345652975616:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1731us (2232us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562708.063319:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17413 00000100:00100000:1.0:1786562708.067314:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562708.067461:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652975744 00000100:00100000:0.0:1786562708.067475:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652975744 00000100:00100000:0.0:1786562708.067558:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17414 00000100:00100000:0.0:1786562708.067571:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:69584:x1873345652975744:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562708.067686:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.067708:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.067722:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.067740:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.067748:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.067754:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068288:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068299:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068307:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562708.068352:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:0.0:1786562708.068357:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562708.068373:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068389:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068396:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068404:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068411:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562708.068415:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068424:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068438:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562708.068442:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562708.068447:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068453:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eb5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068468:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068475:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068480:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068487:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562708.068490:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068496:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068504:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46ab600) 00010000:00010000:0.0:1786562708.068507:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562708.068510:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068516:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ebc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068534:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068540:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068547:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068552:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562708.068555:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068561:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068572:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:0.0:1786562708.068575:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562708.068578:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.068583:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0ec3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562708.068692:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:69584:x1873345652975744:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1120us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562708.068703:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17414 00000100:00100000:0.0:1786562708.131602:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562708.131797:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652976000 00000100:00100000:2.0:1786562708.131810:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652976000 00000100:00100000:2.0:1786562708.131891:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17415 00000100:00100000:2.0:1786562708.131903:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:69592:x1873345652976000:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562708.131931:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562708.131962:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0eca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd5fb expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132109:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132133:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132148:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132167:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132175:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132182:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132689:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132700:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132708:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132717:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.132722:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132730:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132744:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562708.132747:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.132751:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132758:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0ed1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132773:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132779:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132784:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132789:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.132793:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132798:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132809:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332400) 00010000:00010000:2.0:1786562708.132812:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.132815:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132821:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0ed8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132875:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0eca lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5fb expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132887:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562708.132889:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562708.132892:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0eca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5fb expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.132903:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfdc00, rc 0) 00000100:00100000:2.0:1786562708.133000:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:69592:x1873345652976000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1098us (1416us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562708.133069:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17415 00000100:00100000:3.0:1786562708.141388:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562708.141719:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652976128 00000100:00100000:0.0:1786562708.141739:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652976128 00000100:00100000:0.0:1786562708.141840:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17416 00000100:00100000:0.0:1786562708.141866:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69592:x1873345652976128:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562708.141974:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.141998:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.142055:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.142075:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.142084:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.142092:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144213:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144236:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144251:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562708.144311:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:0.0:1786562708.144317:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562708.144335:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144353:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144360:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144368:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144374:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562708.144379:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144388:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144406:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562708.144410:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562708.144415:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144421:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0edf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144436:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144443:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144449:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144456:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562708.144459:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144465:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144473:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46ab600) 00010000:00010000:0.0:1786562708.144476:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562708.144479:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144485:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0ee6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144505:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144511:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144517:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144522:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562708.144525:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144531:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144538:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:0.0:1786562708.144541:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562708.144544:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562708.144550:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0eed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562708.144698:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:69592:x1873345652976128:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2840us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562708.144712:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17416 00000100:00100000:3.0:1786562708.198945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562708.207844:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652976384 00000100:00100000:1.0:1786562708.207877:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652976384 00000100:00100000:1.0:1786562708.207984:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17417 00000100:00100000:1.0:1786562708.207997:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69598:x1873345652976384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562708.208044:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562708.208085:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0ef4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd602 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208199:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208217:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208231:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208251:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208259:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208265:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208938:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208952:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208960:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208967:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562708.208972:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208981:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.208999:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562708.209039:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562708.209046:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209054:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0efb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209296:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209305:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209311:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209316:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562708.209321:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209327:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209337:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562708.209340:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562708.209343:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209349:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f02 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209494:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0ef4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd602 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209508:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562708.209511:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562708.209515:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0ef4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd602 expref: 20 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.209529:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1200, rc 0) 00000100:00100000:1.0:1786562708.209634:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:69598:x1873345652976384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1639us (10704us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562708.209645:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17417 00000100:00100000:1.0:1786562708.221316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562708.221530:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652976512 00000100:00100000:2.0:1786562708.221544:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652976512 00000100:00100000:2.0:1786562708.221618:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17418 00000100:00100000:2.0:1786562708.221630:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:69598:x1873345652976512:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562708.221727:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.221754:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.221768:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.221787:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.221794:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.221801:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222294:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222305:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222313:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562708.222355:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:2.0:1786562708.222361:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562708.222376:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222392:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222548:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222555:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222562:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.222567:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222575:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222590:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562708.222594:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.222601:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222607:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f09 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222623:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222629:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222635:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222640:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.222644:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222649:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222656:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332400) 00010000:00010000:2.0:1786562708.222659:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.222661:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222666:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f10 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222683:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222690:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222696:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222701:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.222704:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222710:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222718:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:2.0:1786562708.222721:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.222725:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.222731:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562708.222854:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:69598:x1873345652976512:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1215us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562708.222865:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17418 00010000:00010000:3.0:1786562708.265776:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562708.266721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562708.266970:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652976768 00000100:00100000:1.0:1786562708.266983:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652976768 00000100:00100000:1.0:1786562708.267094:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17419 00000100:00100000:1.0:1786562708.267106:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:69602:x1873345652976768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562708.267132:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562708.267157:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0f1e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd609 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267257:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267275:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267288:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267304:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267310:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267317:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267786:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267796:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267805:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267817:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562708.267822:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267831:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267861:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562708.267866:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562708.267872:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267880:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1a00/0x5c655bf6668a0f25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267917:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267924:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267929:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267934:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562708.267938:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267943:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267955:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562708.267957:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562708.267960:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.267966:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0400/0x5c655bf6668a0f2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.271459:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0f1e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd609 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.271490:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:1.0:1786562708.271494:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562708.271500:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a0f1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd609 expref: 20 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562708.271547:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1200, rc 0) 00000100:00100000:1.0:1786562708.271695:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:69602:x1873345652976768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4589us (4982us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562708.271706:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17419 00000100:00100000:3.0:1786562708.275970:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562708.276882:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652976896 00000100:00100000:2.0:1786562708.276899:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652976896 00000100:00100000:2.0:1786562708.276980:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17420 00000100:00100000:2.0:1786562708.276992:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:69602:x1873345652976896:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562708.277123:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277144:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277158:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277174:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277285:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277293:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277789:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277800:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277808:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562708.277864:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:2.0:1786562708.277870:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562708.277889:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277905:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277911:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277920:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277928:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.277932:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277940:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277954:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:2.0:1786562708.277957:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.277962:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277974:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a0f33 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277991:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.277996:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278409:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278418:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.278422:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278430:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278439:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b6332400) 00010000:00010000:2.0:1786562708.278442:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.278445:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278452:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a0f3a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278471:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278477:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278484:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278489:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562708.278492:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278499:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278506:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:2.0:1786562708.278509:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562708.278513:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562708.278519:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a0f41 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562708.278636:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:69602:x1873345652976896:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1640us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562708.278649:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17420 00010000:00010000:1.0:1786562709.285282:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562710.310706:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562711.334147:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562711.865799:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562711.865854:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562711.865894:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562711.865924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562711.866074:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977152 00000100:00100000:1.0:1786562711.866086:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977280 00000100:00100000:0.0:1786562711.866089:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977152 00000100:00100000:1.0:1786562711.866090:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977280 00000100:00100000:2.0:1786562711.866159:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977024 00000100:00100000:2.0:1786562711.866163:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977024 00000100:00100000:2.0:1786562711.866202:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 322 00000100:00100000:2.0:1786562711.866228:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652977024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562711.866331:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652977024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 119us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562711.866345:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 322 00000100:00100000:0.0:1786562711.866622:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 405 00000100:00100000:0.0:1786562711.866633:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652977152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562711.866692:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652977152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 63us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562711.866699:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 405 00000100:00080000:0.0:1786562711.867717:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562711.867727:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562711.867818:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977408 00000100:00100000:0.0:1786562711.867831:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977408 00000100:00100000:0.0:1786562711.867905:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 536 00000100:00100000:0.0:1786562711.867916:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652977408:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:2.0:1786562711.868028:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562711.868297:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 537 00000100:00100000:2.0:1786562711.868308:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652977280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562711.868392:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+12:2348:x1873345652977280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 86us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562711.868400:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 537 00000100:00100000:0.0:1786562711.868506:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652977408:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 591us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562711.868514:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 536 00010000:00010000:0.0:1786562712.357505:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562712.869492:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654939264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562712.869598:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562712.869751:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939264 00000100:00100000:3.0:1786562712.869771:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939264 00000100:00100000:3.0:1786562712.869855:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1786562712.869867:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654939264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562712.869912:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3845128192 avail 3843031040 00000100:00100000:3.0:1786562712.869968:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654939264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562712.869977:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00080000:0.0:1786562712.870063:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562712.870117:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654939264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562712.870343:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562712.870351:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654939392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562712.870384:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562712.870423:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939392 00000100:00100000:0.0:1786562712.870429:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939392 00000100:00100000:0.0:1786562712.870467:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1786562712.870475:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654939392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562712.870500:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3836739584 avail 3834642432 00000100:00100000:0.0:1786562712.870536:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654939392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562712.870543:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:0.0:1786562712.870559:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562712.870585:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654939392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562712.872396:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654939520:0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.872485:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562712.872541:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562712.872547:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654939648:0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.872580:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562712.872614:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654939904:0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.872640:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562712.872661:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562712.872666:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654939776:0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.872686:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562712.872716:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939520 00000100:00100000:2.0:1786562712.872724:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939520 00000100:00100000:2.0:1786562712.872790:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1786562712.872801:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654939520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.872856:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654939520:12345-0@lo:400:kworker.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562712.872864:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1786562712.872904:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939648 00000100:00100000:2.0:1786562712.872908:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939648 00000100:00100000:2.0:1786562712.872953:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939904 00000100:00100000:2.0:1786562712.872957:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939904 00000100:00100000:2.0:1786562712.872979:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654939776 00000100:00100000:2.0:1786562712.872982:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654939776 00000100:00100000:2.0:1786562712.873026:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1786562712.873034:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654939648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562712.873038:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1786562712.873047:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654939904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.873069:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654939648:12345-0@lo:400:kworker.0 Request processed in 37us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562712.873076:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1786562712.873085:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654939904:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562712.873089:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1786562712.873092:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1786562712.873094:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654939776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.873122:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654939776:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562712.873128:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00080000:2.0:1786562712.873160:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562712.873196:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654939648:0@lo:400:kworker.0 00000100:00100000:2.0:1786562712.873205:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654939520:0@lo:400:kworker.0 00000100:00100000:3.0:1786562712.879692:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654939776:0@lo:400:kworker.0 00000100:00100000:3.0:1786562712.879715:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654939904:0@lo:400:kworker.0 00000001:00080000:2.0:1786562712.933583:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950841 is committed 00000001:00080000:1.0:1786562712.943200:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843660 is committed 00000001:00080000:1.0:1786562712.943223:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843661 is committed 00000001:00080000:1.0:1786562712.943231:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843663 is committed 00000001:00080000:1.0:1786562712.953531:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876145 is committed 00000001:00080000:1.0:1786562712.953562:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876146 is committed 00000001:00080000:1.0:1786562712.953570:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876144 is committed 00010000:00010000:3.0:1786562713.381200:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562713.658951:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562713.659057:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977536 00000100:00100000:0.0:1786562713.659071:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977536 00000100:00100000:0.0:1786562713.659176:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17421 00000100:00100000:0.0:1786562713.659189:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:70020:x1873345652977536:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:0.0:1786562713.659218:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562713.659246:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0f48 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd610 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659343:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659362:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659383:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659401:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659409:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659417:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659890:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659902:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.659910:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562713.659958:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ea:0x0]: returning size 70254592 00000004:00200000:0.0:1786562713.659964:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562713.659991:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660035:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660046:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660058:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660065:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660072:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562713.660077:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660085:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660099:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562713.660102:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562713.660108:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660115:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a0f4f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660127:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660134:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660141:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660147:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562713.660152:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660158:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660167:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46ab700) 00010000:00010000:0.0:1786562713.660170:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562713.660174:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660179:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a0f56 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660220:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a0f48 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd610 expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660237:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd610 expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.660245:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:0.0:1786562713.660247:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562713.660250:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562713.660344:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:70020:x1873345652977536:12345-192.168.204.29@tcp:101:rm.0 Request processed in 1157us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562713.660354:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17421 00000100:00080000:2.0:1786562713.660554:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562713.667671:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562713.667748:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977792 00000100:00100000:0.0:1786562713.667762:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977792 00000100:00100000:0.0:1786562713.667846:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17422 00000100:00100000:0.0:1786562713.667859:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:70020:x1873345652977792:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1786562713.667938:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786562713.667977:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f5d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd610 expref: 19 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668038:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a0e45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5df expref: 18 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668075:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:0.0:1786562713.668090:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562713.668119:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668136:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668148:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668165:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668173:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668180:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668640:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668651:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.668659:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562713.670250:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4413, 64 off358056 00000004:00080000:0.0:1786562713.670270:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1146112263071ns, next at 1147112259496ns, rc = 0 00000040:00080000:0.0:1786562713.670330:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4447, 64 off361104 00000004:00080000:0.0:1786562713.670338:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1146112332279ns, next at 1147112330849ns, rc = 0 00000040:00080000:0.0:1786562713.670358:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4448, 64 off361168 00000040:00080000:0.0:1786562713.670376:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4414, 64 off358120 00010000:00010000:0.0:1786562713.670486:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.670505:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.670518:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.670528:0:33113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.670535:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.670543:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.674024:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562713.674055:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.674071:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562713.674073:0:33113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786562713.674077:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.674091:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.674118:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:3.0:1786562713.674122:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786562713.674130:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674130:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.674148:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0f79 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ea:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674161:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674169:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.674171:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562713.674174:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562713.674178:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562713.674179:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562713.674186:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674193:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674204:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ea:0x0].0x0 (ffff90e9b46ab400) 00010000:00010000:0.0:1786562713.674219:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786562713.674223:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674230:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0f72 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674263:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674270:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674276:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674282:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562713.674285:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674291:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674300:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0x0 (ffff90e999bb1000) 00010000:00010000:0.0:1786562713.674304:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562713.674307:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562713.674313:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0f64 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562713.674325:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5f235a5 reply state 00000000081fefd8 transno 8589950842 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562713.674336:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562713.674515:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:70020:x1873345652977792:12345-192.168.204.29@tcp:36:rm.0 Request processed in 6652us (6854us total) trans 8589950842 rc 0/0 00000100:00100000:0.0:1786562713.674525:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17422 00010000:00010000:3.0:1786562713.686257:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.686282:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.686290:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.686298:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562713.686304:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.686312:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.686335:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4e9:0x0].0xc2cf826c (ffff90e9b46ab600) 00010000:00010000:3.0:1786562713.686338:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562713.686345:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562713.686353:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0f6b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4e9:0x0].0xc2cf826c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562714.406877:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562715.435598:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786562715.741483:0:39942:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 204e: FLR write/stale/resync sel test with repeated comp ========================================================== 15:25:13 (1786562713) 00010000:00010000:0.0:1786562716.453339:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562716.985637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562716.985701:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562716.985734:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562716.985760:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562716.985801:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978176 00000100:00100000:1.0:1786562716.985814:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978176 00000100:00100000:3.0:1786562716.985998:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652977920 00000100:00100000:3.0:1786562716.986025:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652977920 00000100:00100000:3.0:1786562716.986091:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 324 00000100:00100000:3.0:1786562716.986104:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652977920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562716.986203:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652977920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 102us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562716.986212:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 324 00000100:00100000:3.0:1786562716.986366:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978304 00000100:00100000:3.0:1786562716.986371:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978304 00000100:00100000:3.0:1786562716.986416:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 538 00000100:00100000:3.0:1786562716.986424:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652978304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562716.986460:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652978304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562716.986467:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 538 00000100:00100000:3.0:1786562716.986487:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978048 00000100:00100000:3.0:1786562716.986490:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978048 00000100:00100000:3.0:1786562716.986520:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 409 00000100:00100000:3.0:1786562716.986526:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652978048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562716.986563:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+18:2350:x1873345652978048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 36us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562716.986570:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 409 00000100:00080000:3.0:1786562716.986588:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562716.986595:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562716.988738:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 539 00000100:00100000:1.0:1786562716.988756:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652978176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562716.988863:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+10:2350:x1873345652978176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 111us (3161us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562716.988882:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 539 00000100:00080000:3.0:1786562716.990967:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786562717.481092:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786562717.990181:0:33136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1150432171512ns, next at 1151432168614ns, rc = 0 00000100:00100000:0.0:1786562717.990221:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654940032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562717.990325:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562717.990417:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940032 00000100:00100000:0.0:1786562717.990426:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940032 00000100:00100000:0.0:1786562717.990495:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1786562717.990506:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654940032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562717.990552:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3836739584 avail 3834642432 00000100:00100000:0.0:1786562717.990610:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654940032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562717.990617:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1786562717.990677:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843663 gen 2 00000004:00080000:0.0:1786562717.990684:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c52ce00, transno 21474843662 00000004:00080000:0.0:1786562717.990692:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88c52e680, transno 21474843663 00000100:00100000:0.0:1786562717.990704:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654940032:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1786562717.992109:0:33139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1150434100658ns, next at 1151434097826ns, rc = 0 00000100:00080000:3.0:1786562717.992149:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562717.992766:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654940160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562717.992883:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562717.993443:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940160 00000100:00100000:3.0:1786562717.993454:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940160 00000100:00100000:3.0:1786562717.993527:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1786562717.993539:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654940160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562717.993588:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3845128192 avail 3843031040 00000100:00100000:3.0:1786562717.993671:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654940160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562717.993680:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00080000:3.0:1786562717.994201:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562717.994247:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876146 gen 2 00000004:00080000:3.0:1786562717.994255:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f5c00, transno 17179876145 00000004:00080000:3.0:1786562717.994270:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9b42f4e00, transno 17179876146 00000100:00100000:3.0:1786562717.994286:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654940160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562717.997106:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654940544:0@lo:400:kworker.0 00000100:00100000:1.0:1786562717.997241:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562717.997447:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562717.997457:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654940672:0@lo:400:kworker.0 00000100:00100000:1.0:1786562717.997486:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562718.003398:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654940288:0@lo:400:kworker.0 00000100:00100000:3.0:1786562718.003506:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562718.003571:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562718.003580:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654940416:0@lo:400:kworker.0 00000100:00100000:3.0:1786562718.003613:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562718.003740:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940288 00000100:00100000:3.0:1786562718.003751:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940288 00000100:00100000:3.0:1786562718.003813:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1786562718.003824:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654940288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562718.003898:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654940288:12345-0@lo:400:kworker.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562718.003906:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1786562718.003960:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940544 00000100:00100000:3.0:1786562718.003965:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940544 00000100:00100000:3.0:1786562718.004002:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940672 00000100:00100000:3.0:1786562718.004033:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940672 00000100:00100000:3.0:1786562718.004053:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940416 00000100:00100000:3.0:1786562718.004056:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940416 00000100:00100000:3.0:1786562718.004079:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1786562718.004085:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654940544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562718.004123:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654940544:12345-0@lo:400:kworker.0 Request processed in 38us (6884us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562718.004431:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1786562718.004443:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654940672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562718.004486:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654940672:12345-0@lo:400:kworker.0 Request processed in 48us (6999us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562718.004493:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1786562718.004509:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1786562718.004515:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654940416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562718.004537:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654940416:12345-0@lo:400:kworker.0 Request processed in 23us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562718.004543:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1786562718.004928:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654940672:0@lo:400:kworker.0 00000100:00100000:1.0:1786562718.004943:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654940544:0@lo:400:kworker.0 00000100:00100000:3.0:1786562718.005792:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1786562718.006067:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654940416:0@lo:400:kworker.0 00000100:00100000:3.0:1786562718.006082:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654940288:0@lo:400:kworker.0 00000100:00080000:3.0:1786562718.016163:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1786562718.135222:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2917 committed 00000001:00080000:3.0:1786562718.135249:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950842 is committed 00000004:00080000:3.0:1786562718.135255:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2949 committed 00000004:00080000:3.0:1786562718.135262:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2916 committed 00000004:00080000:3.0:1786562718.135710:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2950 committed 00000100:00100000:0.0:1786562718.135826:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654940800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786562718.135858:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654940928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786562718.135963:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562718.136084:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654941056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786562718.136118:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562718.136224:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562718.136231:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654941184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786562718.136255:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562718.136350:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940928 00000100:00100000:2.0:1786562718.136360:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940928 00000100:00100000:2.0:1786562718.136425:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654941056 00000100:00100000:2.0:1786562718.136428:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654941056 00000100:00100000:2.0:1786562718.136455:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17991 00000100:00100000:2.0:1786562718.136467:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654940928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786562718.136513:0:29662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1856 count 1 00010000:00010000:2.0:1786562718.136550:0:29662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136593:0:29662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136605:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x740:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1786562718.136611:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562718.136616:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136663:0:29662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 9 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136679:0:29662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 9 pid: 28861 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562718.136694:0:29662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654941312:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562718.136776:0:29662:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562718.136796:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17992 00000100:00100000:2.0:1786562718.136804:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654941056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786562718.136820:0:8368:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1829 count 1 00010000:00010000:2.0:1786562718.136838:0:8368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136853:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136861:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x725:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1786562718.136864:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562718.136867:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136890:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.136901:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 8 pid: 6659 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562718.136913:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654941440:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562718.136941:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882474480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562718.137937:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654941184 00000100:00100000:0.0:1786562718.137949:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654941184 00000100:00100000:2.0:1786562718.137972:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562718.137999:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654940800 00000100:00100000:0.0:1786562718.138002:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654940800 00000100:00100000:0.0:1786562718.138038:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17993 00000100:00100000:0.0:1786562718.138047:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654941184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786562718.138074:0:29966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1828 count 1 00000100:00100000:3.0:1786562718.138093:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17994 00010000:00010000:0.0:1786562718.138094:0:29966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562718.138103:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654940800:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786562718.138113:0:29966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1786562718.138116:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1855 count 1 00010000:00010000:0.0:1786562718.138122:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x724:0x0].0x0 since=11s v=(0 0) 00010000:00010000:0.0:1786562718.138126:0:29966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562718.138130:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.138131:0:29966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.138142:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 9 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.138149:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x73f:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1786562718.138152:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562718.138155:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.138159:0:29966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 8 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.138171:0:29966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 8 pid: 29963 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.138176:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 9 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.138185:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 9 pid: 6658 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562718.138185:0:29966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654941568:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562718.138195:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654941696:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562718.138232:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:0.0:1786562718.138232:0:29966:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98679c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562718.140988:0:29662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:29662:1873345654941312:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562718.141048:0:29662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562718.143838:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8368:1873345654941440:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562718.143883:0:8368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562718.146578:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562718.147154:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562718.149544:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978432 00000100:00100000:2.0:1786562718.149567:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978432 00010000:00010000:2.0:1786562718.149659:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 10 pid: 28861 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562718.150214:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978560 00000100:00100000:3.0:1786562718.150220:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978560 00000100:00100000:2.0:1786562718.150228:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8790 00000100:00100000:2.0:1786562718.150240:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652978432:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562718.150248:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 9 pid: 6659 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150261:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562718.150269:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 10 pid: 28861 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562718.150271:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8791 00000100:00100000:3.0:1786562718.150279:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652978560:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562718.150286:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 10 pid: 28861 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.150288:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562718.150292:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 9 pid: 6659 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.150302:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 9 pid: 6659 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.150320:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3af784e/0x5c655bf6668a0e37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d8 expref: 9 pid: 6659 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150320:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6456c9/0x5c655bf6668a0e22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5ca expref: 10 pid: 28861 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150342:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562718.150347:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x740:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562718.150354:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.150355:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562718.150359:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x725:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562718.150363:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150366:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.150378:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562718.150407:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562718.150457:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562718.150472:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652978560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 194us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562718.150476:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652978432:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 240us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562718.150482:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8791 00000100:00100000:2.0:1786562718.150547:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8790 00000100:00080000:2.0:1786562718.150611:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562718.150616:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562718.150637:0:8368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150661:0:8368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150674:0:8368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150682:0:8368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562718.150705:0:8368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562718.150705:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562718.150740:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562718.150763:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978816 00000100:00100000:0.0:1786562718.150768:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978816 00010000:00010000:0.0:1786562718.150804:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 8 pid: 29963 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562718.150824:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978688 00000100:00100000:0.0:1786562718.150827:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978688 00010000:00010000:0.0:1786562718.150840:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 9 pid: 6658 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562718.150867:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8792 00000100:00100000:0.0:1786562718.150890:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652978816:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562718.150900:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562718.150905:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 8 pid: 29963 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.150925:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 8 pid: 29963 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.150943:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562718.150946:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x724:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562718.150951:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.150959:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.150973:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562718.151042:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652978816:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 129us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562718.151051:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8792 00000100:00100000:0.0:1786562718.151065:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8793 00000100:00100000:0.0:1786562718.151072:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652978688:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562718.151080:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562718.151085:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 9 pid: 6658 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151095:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 9 pid: 6658 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151108:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562718.151111:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562718.151115:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151123:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151133:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562718.151151:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652978688:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562718.151157:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8793 00010000:00010000:0.0:1786562718.151265:0:29966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a414d928/0x5c655bf6668a0df1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->10485759) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5b5 expref: 7 pid: 29963 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562718.151280:0:29966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:29966:1873345654941568:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562718.151305:0:29966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151315:0:29966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151324:0:29966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151333:0:29966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151340:0:29966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151357:0:29966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786562718.151687:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786562718.151696:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151705:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562718.151710:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151721:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151735:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151743:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc1385b/0x5c655bf6668a0f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151765:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562718.151768:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151775:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562718.151777:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151785:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151793:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151800:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076346e48/0x5c655bf6668a0f8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151812:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.151813:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.151815:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.151833:0:29662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151842:0:29662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151856:0:29662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151863:0:29662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.151881:0:29662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786562718.152463:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654940928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15995us (16498us total) trans 21474843664 rc 0/0 00000100:00100000:0.0:1786562718.152474:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17991 00010000:00010000:0.0:1786562718.152508:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562718.152514:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.152523:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562718.152526:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.152536:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.152551:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.152558:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a0f80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.152576:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.152578:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.152579:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786562718.152615:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a99f8380/2, rc 0, transno 21474843664 00000100:00100000:0.0:1786562718.152623:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654940928:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786562718.152814:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562718.152834:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654941056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16029us (16713us total) trans 17179876147 rc 0/0 00000100:00100000:2.0:1786562718.152843:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17992 00000004:00080000:3.0:1786562718.152844:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a99f9880/2, rc 0, transno 17179876147 00000100:00100000:3.0:1786562718.152849:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654941056:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786562718.155999:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a0e30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd5d1 expref: 8 pid: 6658 timeout: 1250 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562718.156098:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654941696:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562718.156134:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562718.156149:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562718.156156:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562718.156169:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562718.156177:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562718.156205:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786562718.156762:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786562718.156773:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.156796:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562718.156802:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.156815:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.156843:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.157087:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a0f95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562718.157115:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.157117:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562718.157119:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562718.158095:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654941184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20042us (21831us total) trans 17179876148 rc 0/0 00000100:00100000:0.0:1786562718.158109:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17993 00000100:00100000:1.0:1786562718.158477:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654940800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20375us (20504us total) trans 21474843665 rc 0/0 00000100:00100000:1.0:1786562718.158487:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17994 00000004:00080000:0.0:1786562718.158586:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a99faa00/2, rc 0, transno 21474843665 00000100:00100000:0.0:1786562718.158595:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654940800:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786562718.158732:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a99fad80/2, rc 0, transno 17179876148 00000100:00100000:3.0:1786562718.158739:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654941184:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786562718.195241:0:40041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1150637231134ns, next at 1151432168614ns, rc = 0 00000004:00080000:3.0:1786562718.195391:0:40041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1150637384753ns, next at 1151434097826ns, rc = 0 00000004:00080000:2.0:1786562718.241251:0:40035:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2951 committed 00000004:00080000:2.0:1786562718.241277:0:40035:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2918 committed 00010000:00010000:0.0:1786562718.501245:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562719.526209:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562720.549901:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562721.573113:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562722.107168:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562722.107228:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562722.107263:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562722.107297:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562722.107635:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979200 00000100:00100000:0.0:1786562722.107646:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979200 00000100:00100000:0.0:1786562722.107718:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979328 00000100:00100000:0.0:1786562722.107721:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979328 00000100:00100000:0.0:1786562722.107764:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 540 00000100:00100000:0.0:1786562722.107777:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652979200:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562722.107974:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652979200:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 199us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562722.107983:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 540 00000100:00100000:0.0:1786562722.108002:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 541 00000100:00100000:0.0:1786562722.108035:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652979328:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562722.108067:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652979328:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562722.108074:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 541 00000100:00080000:3.0:1786562722.108292:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562722.108297:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562722.108842:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979072 00000100:00100000:1.0:1786562722.108848:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979072 00000100:00100000:1.0:1786562722.108906:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 413 00000100:00100000:1.0:1786562722.108915:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652979072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562722.108958:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652979072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562722.108965:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 413 00000100:00100000:2.0:1786562722.109107:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652978944 00000100:00100000:2.0:1786562722.109112:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652978944 00000100:00100000:2.0:1786562722.109153:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 326 00000100:00100000:2.0:1786562722.109161:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652978944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562722.109190:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345652978944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562722.109197:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 326 00000100:00080000:3.0:1786562722.109906:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786562722.597330:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562723.111950:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654941824:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112075:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562723.112135:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654942336:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112168:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562723.112200:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786562723.112207:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654941952:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112238:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562723.112257:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654942464:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112280:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562723.112312:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654942080:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112338:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562723.112360:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562723.112365:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654942208:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112387:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562723.112423:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654941824 00000100:00100000:1.0:1786562723.112432:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654941824 00000100:00100000:1.0:1786562723.112494:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1786562723.112505:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654941824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112579:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654941824:12345-0@lo:400:kworker.0 Request processed in 75us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562723.112588:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1786562723.112632:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942336 00000100:00100000:1.0:1786562723.112635:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942336 00000100:00100000:1.0:1786562723.112679:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942208 00000100:00100000:1.0:1786562723.112682:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942208 00000100:00100000:1.0:1786562723.112706:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1786562723.112711:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654942336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112746:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654942336:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562723.112753:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1786562723.112766:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1786562723.112771:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654942208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112805:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654942208:12345-0@lo:400:kworker.0 Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562723.112811:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1786562723.112831:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654941952 00000100:00100000:1.0:1786562723.112835:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654941952 00000100:00100000:1.0:1786562723.112864:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942464 00000100:00100000:1.0:1786562723.112867:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942464 00000100:00100000:1.0:1786562723.112883:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942080 00000100:00100000:1.0:1786562723.112886:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942080 00000100:00100000:1.0:1786562723.112912:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1786562723.112919:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654941952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.112953:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654941952:12345-0@lo:400:kworker.0 Request processed in 35us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562723.112960:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1786562723.112972:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1786562723.112978:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654942464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.113031:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654942464:12345-0@lo:400:kworker.0 Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562723.113038:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1786562723.113051:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1786562723.113056:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654942080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.113083:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654942080:12345-0@lo:400:kworker.0 Request processed in 28us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562723.113088:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:1.0:1786562723.113122:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562723.113128:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562723.113130:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562723.113534:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654942208:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.113548:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654942080:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.114065:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654941952:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.114079:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654942464:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.114090:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654941824:0@lo:400:kworker.0 00000100:00100000:1.0:1786562723.114102:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654942336:0@lo:400:kworker.0 00000100:00100000:0.0:1786562723.115676:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562723.115703:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654942592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562723.115793:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562723.115867:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942592 00000100:00100000:0.0:1786562723.115876:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942592 00000100:00100000:0.0:1786562723.115964:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1786562723.115974:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654942592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562723.116037:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3836739584 avail 3834642432 00000100:00100000:0.0:1786562723.116093:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654942592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562723.116101:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1786562723.116157:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654942592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562723.126562:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562723.126595:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654942720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562723.126699:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562723.126773:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942720 00000100:00100000:0.0:1786562723.126783:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942720 00000100:00100000:0.0:1786562723.126842:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1786562723.126853:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654942720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562723.128073:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562723.128203:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654942720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1347us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562723.128216:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1786562723.128306:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654942720:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786562723.203289:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843664 is committed 00000001:00080000:3.0:1786562723.203313:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843665 is committed 00000001:00080000:0.0:1786562723.206706:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876148 is committed 00010000:00010000:1.0:1786562723.633035:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562724.645262:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562725.670405:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562726.694042:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562727.226198:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562727.226254:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562727.226290:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562727.226336:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562727.226395:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979712 00000100:00100000:3.0:1786562727.226409:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979840 00000100:00100000:0.0:1786562727.226412:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979712 00000100:00100000:3.0:1786562727.226420:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979840 00000100:00100000:1.0:1786562727.226563:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979456 00000100:00100000:1.0:1786562727.226568:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979456 00000100:00100000:2.0:1786562727.226615:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979584 00000100:00100000:1.0:1786562727.226623:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 328 00000100:00100000:2.0:1786562727.226625:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979584 00000100:00100000:1.0:1786562727.226638:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652979456:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562727.226691:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 417 00000100:00100000:2.0:1786562727.226707:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652979584:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562727.226771:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652979456:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 135us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562727.226782:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 328 00000100:00100000:2.0:1786562727.226797:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2348:x1873345652979584:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (502us total) trans 0 rc 0/0 00000100:00080000:1.0:1786562727.226833:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562727.226841:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562727.226844:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562727.226846:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 417 00000100:00100000:0.0:1786562727.229167:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 544 00000100:00100000:0.0:1786562727.229192:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652979840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562727.229281:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652979840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562727.229289:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 544 00000100:00100000:0.0:1786562727.229318:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 545 00000100:00100000:0.0:1786562727.229325:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652979712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562727.229364:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652979712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562727.229371:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 545 00010000:00010000:1.0:1786562727.717486:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562728.229359:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654942848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562728.229470:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562728.229582:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942848 00000100:00100000:0.0:1786562728.229592:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942848 00000100:00100000:3.0:1786562728.229767:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654942976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562728.229803:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562728.229838:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654942976 00000100:00100000:3.0:1786562728.229842:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654942976 00000100:00100000:0.0:1786562728.229905:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1786562728.229930:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654942848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562728.229976:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562728.230051:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654942848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562728.230059:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1786562728.231914:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654943232:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.231989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562728.232063:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562728.232070:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654943104:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.232104:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562728.232142:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943232 00000100:00100000:2.0:1786562728.232149:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943232 00000100:00100000:2.0:1786562728.232208:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1786562728.232218:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654943232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.232275:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654943232:12345-0@lo:400:kworker.0 Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562728.232283:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1786562728.232314:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943104 00000100:00100000:2.0:1786562728.232317:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943104 00000100:00100000:2.0:1786562728.232347:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1786562728.232353:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654943104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.232384:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654943104:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562728.232391:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1786562728.232436:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654943488:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.232478:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562728.232501:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562728.232507:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bd1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654943360:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.232529:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562728.232556:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943488 00000100:00100000:2.0:1786562728.232560:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943488 00000100:00100000:2.0:1786562728.232584:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943360 00000100:00100000:2.0:1786562728.232587:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943360 00000100:00100000:3.0:1786562728.233841:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1786562728.233861:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654942976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562728.233911:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562728.233992:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654942976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562728.234000:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1786562728.234097:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843665 gen 2 00000004:00080000:3.0:1786562728.234104:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a99f8380, transno 21474843664 00000004:00080000:3.0:1786562728.234116:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a99faa00, transno 21474843665 00000100:00100000:3.0:1786562728.234133:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654942848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562728.234786:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1786562728.234800:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654943488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.234855:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654943488:12345-0@lo:400:kworker.0 Request processed in 60us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562728.234863:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1786562728.234880:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1786562728.234887:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654943360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.234918:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654943360:12345-0@lo:400:kworker.0 Request processed in 32us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562728.234924:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1786562728.234974:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654943360:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.234989:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654943488:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.235002:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876148 gen 2 00000004:00080000:2.0:1786562728.235023:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a99f9880, transno 17179876147 00000004:00080000:2.0:1786562728.235033:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a99fad80, transno 17179876148 00000100:00100000:2.0:1786562728.235043:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654942976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562728.235380:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654943104:0@lo:400:kworker.0 00000100:00100000:2.0:1786562728.235396:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654943232:0@lo:400:kworker.0 00000100:00080000:0.0:1786562728.235540:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562728.235548:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562728.235552:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786562728.744498:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562729.765801:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562730.789308:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562731.814288:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562732.347555:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562732.347602:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562732.347641:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562732.347651:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980096 00000100:00100000:2.0:1786562732.347661:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980096 00000100:00100000:3.0:1786562732.347665:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562732.347726:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 421 00000100:00100000:2.0:1786562732.347738:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652980096:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562732.347923:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652979968 00000100:00100000:1.0:1786562732.347928:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652979968 00000100:00100000:2.0:1786562732.347931:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652980096:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 195us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562732.347939:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 421 00000100:00100000:1.0:1786562732.347958:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 330 00000100:00100000:1.0:1786562732.347964:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652979968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562732.347993:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652979968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562732.347999:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 330 00000100:00100000:1.0:1786562732.348067:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980352 00000100:00100000:1.0:1786562732.348072:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980352 00000100:00100000:0.0:1786562732.348132:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980224 00000100:00100000:0.0:1786562732.348136:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980224 00000100:00100000:0.0:1786562732.348169:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 546 00000100:00100000:0.0:1786562732.348177:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652980352:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562732.348209:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652980352:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562732.348215:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 546 00000100:00100000:0.0:1786562732.348228:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 547 00000100:00100000:0.0:1786562732.348234:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652980224:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562732.348269:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652980224:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562732.348274:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 547 00000100:00080000:0.0:1786562732.348291:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562732.348295:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562732.348298:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562732.837239:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562733.349921:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654943616:0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350026:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562733.350035:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654943744:0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350078:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562733.350087:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654944128:0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350119:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562733.350138:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654944256:0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350168:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943616 00000100:00100000:2.0:1786562733.350169:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562733.350178:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943616 00000100:00100000:2.0:1786562733.350205:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654944000:0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350226:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1786562733.350234:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562733.350240:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654943616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350254:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562733.350261:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654943872:0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350298:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562733.350305:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654943616:12345-0@lo:400:kworker.0 Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562733.350315:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1786562733.350333:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943744 00000100:00100000:2.0:1786562733.350338:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943744 00000100:00100000:1.0:1786562733.350373:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944128 00000100:00100000:1.0:1786562733.350379:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944128 00000100:00100000:2.0:1786562733.350395:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944256 00000100:00100000:2.0:1786562733.350400:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944256 00000100:00100000:1.0:1786562733.350415:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944000 00000100:00100000:1.0:1786562733.350420:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944000 00000100:00100000:2.0:1786562733.350426:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654943872 00000100:00100000:2.0:1786562733.350431:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654943872 00000100:00100000:1.0:1786562733.350454:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1786562733.350461:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1786562733.350466:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654944128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350472:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654943744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350510:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654944128:12345-0@lo:400:kworker.0 Request processed in 48us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562733.350518:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1786562733.350528:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654943744:12345-0@lo:400:kworker.0 Request processed in 57us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562733.350534:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1786562733.350548:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654944000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350549:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1786562733.350571:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1786562733.350580:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654944256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350592:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654944000:12345-0@lo:400:kworker.0 Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562733.350600:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1786562733.350622:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654944256:12345-0@lo:400:kworker.0 Request processed in 43us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562733.350630:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1786562733.350644:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654943616:0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350650:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1786562733.350659:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654943872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350665:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654944128:0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350695:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654943872:12345-0@lo:400:kworker.0 Request processed in 38us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562733.350703:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1786562733.350745:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654943872:0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350763:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654943744:0@lo:400:kworker.0 00000100:00100000:2.0:1786562733.350764:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654944000:0@lo:400:kworker.0 00000100:00100000:1.0:1786562733.350785:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654944256:0@lo:400:kworker.0 00000100:00080000:0.0:1786562733.351085:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562733.351090:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562733.351093:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562733.353039:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654944384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562733.353106:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562733.353641:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654944512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562733.353675:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562733.354276:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944384 00000100:00100000:0.0:1786562733.354284:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944384 00000100:00100000:3.0:1786562733.354319:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944512 00000100:00100000:3.0:1786562733.354326:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944512 00000100:00100000:0.0:1786562733.354338:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1786562733.354361:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654944384:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562733.354369:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1786562733.354382:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654944512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562733.354400:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00002000:00000024:3.0:1786562733.354407:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562733.354456:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654944384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562733.354464:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1786562733.354478:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654944512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562733.354486:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1786562733.354518:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654944384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562733.354594:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654944512:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786562733.861270:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562734.885226:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562735.909429:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562736.934349:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562737.471954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562737.472000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562737.472062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562737.472102:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562737.472170:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980864 00000100:00100000:1.0:1786562737.472187:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980864 00000100:00100000:1.0:1786562737.472254:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980736 00000100:00100000:1.0:1786562737.472258:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980736 00000100:00100000:1.0:1786562737.472302:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 550 00000100:00100000:1.0:1786562737.472313:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652980864:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562737.472403:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652980864:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562737.472411:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 550 00000100:00100000:1.0:1786562737.472430:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 551 00000100:00100000:1.0:1786562737.472437:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652980736:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562737.472464:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652980736:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562737.472470:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 551 00000100:00080000:0.0:1786562737.472547:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562737.472552:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562737.472866:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980480 00000100:00100000:3.0:1786562737.472872:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980480 00000100:00100000:3.0:1786562737.472911:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 332 00000100:00100000:3.0:1786562737.472919:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652980480:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562737.472962:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652980480:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 43us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562737.472969:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 332 00000100:00100000:2.0:1786562737.473466:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980608 00000100:00100000:2.0:1786562737.473473:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980608 00000100:00100000:2.0:1786562737.473528:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 425 00000100:00100000:2.0:1786562737.473536:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652980608:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562737.473596:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652980608:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 60us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562737.473602:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 425 00000100:00080000:0.0:1786562737.473663:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562737.959096:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562738.469210:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654944640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562738.469305:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562738.469380:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944640 00000100:00100000:1.0:1786562738.469387:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944640 00000100:00100000:1.0:1786562738.469450:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1786562738.469460:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654944640:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786562738.469465:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1786562738.469493:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00000100:00100000:1.0:1786562738.469556:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654944640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562738.469564:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1786562738.469961:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654945024:0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.469996:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562738.470045:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562738.470051:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654944896:0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.470073:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562738.470098:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945024 00000100:00100000:2.0:1786562738.470102:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945024 00000100:00100000:2.0:1786562738.470133:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944896 00000100:00100000:2.0:1786562738.470136:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944896 00000100:00100000:2.0:1786562738.470154:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1786562738.470160:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654945024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.470197:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654945024:12345-0@lo:400:kworker.0 Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562738.470203:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1786562738.470218:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1786562738.470223:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654944896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.470279:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654944896:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562738.470286:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1786562738.470337:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654944896:0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.470347:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654945024:0@lo:400:kworker.0 00000100:00100000:0.0:1786562738.470709:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654945408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562738.470744:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786562738.470783:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562738.470792:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654944768:0@lo:400:kworker.0 00000100:00100000:0.0:1786562738.470820:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562738.470842:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654945280:0@lo:400:kworker.0 00000100:00100000:0.0:1786562738.470863:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562738.470879:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562738.470884:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654945152:0@lo:400:kworker.0 00000100:00100000:0.0:1786562738.470905:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562738.470950:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654944640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562738.471039:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945280 00000100:00100000:3.0:1786562738.471044:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945280 00000100:00100000:3.0:1786562738.471074:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1786562738.471081:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654945280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562738.471122:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654945280:12345-0@lo:400:kworker.0 Request processed in 41us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562738.471128:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1786562738.471147:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945152 00000100:00100000:3.0:1786562738.471150:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945152 00000100:00100000:3.0:1786562738.471178:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1786562738.471184:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654945152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562738.471216:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654945152:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562738.471226:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00080000:0.0:1786562738.471863:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562738.471891:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654945152:0@lo:400:kworker.0 00000100:00100000:0.0:1786562738.471906:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654945280:0@lo:400:kworker.0 00000100:00100000:1.0:1786562738.472174:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654944768 00000100:00100000:1.0:1786562738.472180:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654944768 00000100:00100000:1.0:1786562738.472220:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1786562738.472229:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654944768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.472264:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945408 00000100:00100000:2.0:1786562738.472268:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945408 00000100:00100000:1.0:1786562738.472292:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654944768:12345-0@lo:400:kworker.0 Request processed in 64us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562738.472299:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1786562738.472303:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1786562738.472310:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654945408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562738.472334:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562738.472335:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654944768:0@lo:400:kworker.0 00000100:00100000:2.0:1786562738.472373:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654945408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562738.472379:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1786562738.472386:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654945408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786562738.983643:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562740.006361:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562741.037209:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562742.053133:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562742.600274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562742.600312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562742.600343:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562742.600368:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562742.600395:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652980992 00000100:00100000:2.0:1786562742.600403:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652980992 00000100:00100000:2.0:1786562742.600449:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 334 00000100:00100000:2.0:1786562742.600458:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652980992:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562742.600524:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652980992:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562742.600531:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 334 00000100:00100000:3.0:1786562742.601905:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981376 00000100:00100000:3.0:1786562742.601917:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981376 00000100:00100000:3.0:1786562742.601971:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981248 00000100:00100000:3.0:1786562742.601975:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981248 00000100:00100000:3.0:1786562742.602024:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 553 00000100:00100000:3.0:1786562742.602035:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652981376:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562742.602103:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652981376:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 70us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562742.602111:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 553 00000100:00100000:3.0:1786562742.602128:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 554 00000100:00100000:3.0:1786562742.602135:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652981248:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562742.602172:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652981248:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562742.602178:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 554 00000100:00100000:0.0:1786562742.607778:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981120 00000100:00100000:0.0:1786562742.607793:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981120 00000100:00100000:0.0:1786562742.607880:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 429 00000100:00100000:0.0:1786562742.607891:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652981120:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562742.607987:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+17:2349:x1873345652981120:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (7719us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562742.607995:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 429 00000100:00080000:0.0:1786562742.608181:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562742.608186:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562742.608189:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562743.077755:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562743.589563:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654945536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562743.589838:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562743.589961:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945536 00000100:00100000:0.0:1786562743.589971:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945536 00000100:00100000:0.0:1786562743.590078:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1786562743.590089:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654945536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562743.590135:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562743.590207:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654945536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562743.590216:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00080000:0.0:1786562743.590248:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562743.590299:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654945536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562743.592230:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654945664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562743.592308:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562743.594088:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654945920:0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.594211:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562743.594291:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562743.594300:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654946048:0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.594413:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562743.594974:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654945792:0@lo:400:kworker.0 00000100:00100000:1.0:1786562743.595081:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562743.596002:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945792 00000100:00100000:3.0:1786562743.596028:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945792 00000100:00100000:3.0:1786562743.596099:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1786562743.596112:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.596151:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654946176:0@lo:400:kworker.0 00000100:00100000:2.0:1786562743.596668:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945664 00000100:00100000:2.0:1786562743.596675:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945664 00000100:00100000:2.0:1786562743.596721:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1786562743.596729:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654945664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562743.596759:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562743.597631:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654945792:12345-0@lo:400:kworker.0 Request processed in 1516us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562743.597853:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1786562743.599123:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562743.599642:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654945920 00000100:00100000:0.0:1786562743.599654:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654945920 00000100:00100000:0.0:1786562743.599865:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946048 00000100:00100000:0.0:1786562743.599869:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946048 00000100:00100000:0.0:1786562743.599898:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946176 00000100:00100000:0.0:1786562743.599901:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946176 00000100:00100000:0.0:1786562743.599927:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1786562743.599940:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654945920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.600157:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654945920:12345-0@lo:400:kworker.0 Request processed in 218us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562743.600166:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1786562743.600189:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1786562743.600196:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654946048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.600230:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654946048:12345-0@lo:400:kworker.0 Request processed in 36us (5817us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562743.600237:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1786562743.600250:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1786562743.600256:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654946176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.600423:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654946176:12345-0@lo:400:kworker.0 Request processed in 167us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562743.600430:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1786562743.600506:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654946048:0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.600524:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654945920:0@lo:400:kworker.0 00000100:00100000:2.0:1786562743.602879:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654945664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6140us (10560us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562743.602896:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:2.0:1786562743.603357:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562743.603366:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562743.604615:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654946176:0@lo:400:kworker.0 00000100:00100000:0.0:1786562743.604655:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654945664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562743.604887:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654945792:0@lo:400:kworker.0 00010000:00010000:0.0:1786562744.101498:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562745.126084:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562746.160140:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562747.173322:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562747.703530:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562747.703574:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562747.703611:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562747.703637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562747.703718:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981888 00000100:00100000:1.0:1786562747.703728:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981888 00000100:00100000:0.0:1786562747.703739:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981760 00000100:00100000:0.0:1786562747.703742:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981760 00000100:00100000:2.0:1786562747.703802:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981632 00000100:00100000:2.0:1786562747.703806:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981632 00000100:00100000:1.0:1786562747.703885:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 555 00000100:00100000:1.0:1786562747.703896:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652981888:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562747.703986:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345652981888:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 93us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562747.703995:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 555 00000100:00100000:1.0:1786562747.704075:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652981504 00000100:00100000:1.0:1786562747.704079:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652981504 00000100:00100000:1.0:1786562747.704105:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 336 00000100:00100000:1.0:1786562747.704112:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652981504:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562747.704139:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652981504:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562747.704145:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 336 00000100:00100000:0.0:1786562747.711726:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 556 00000100:00100000:0.0:1786562747.711747:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652981760:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562747.711826:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652981760:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 88us (8187us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562747.711832:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 556 00000100:00100000:2.0:1786562747.713850:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 433 00000100:00100000:2.0:1786562747.714459:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652981632:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562747.714549:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+17:2351:x1873345652981632:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 687us (11028us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562747.714559:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 433 00000100:00080000:3.0:1786562747.715178:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562747.715185:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562747.715189:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562748.199378:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562748.710249:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562748.710273:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654946304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562748.710377:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562748.710460:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946304 00000100:00100000:0.0:1786562748.710468:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946304 00000100:00100000:0.0:1786562748.710536:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1786562748.711496:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654946304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562748.711538:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562748.711591:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654946304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1047us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.711958:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654946816:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.711996:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562748.712062:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562748.712069:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654946688:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712095:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562748.712155:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946688 00000100:00100000:3.0:1786562748.712161:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946688 00000100:00100000:3.0:1786562748.712201:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1786562748.712210:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654946688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712259:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654946688:12345-0@lo:400:kworker.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.712267:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1786562748.712290:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654946560:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712333:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562748.712352:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786562748.712357:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654946432:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712384:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562748.712404:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654946944:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712423:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562748.712449:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946432 00000100:00100000:3.0:1786562748.712452:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946432 00000100:00100000:3.0:1786562748.712478:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1786562748.712484:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654946432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712515:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654946432:12345-0@lo:400:kworker.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.712522:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:3.0:1786562748.712545:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562748.712549:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562748.712573:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654946432:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712604:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654946688:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712625:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946560 00000100:00100000:3.0:1786562748.712628:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946560 00000100:00100000:3.0:1786562748.712653:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946944 00000100:00100000:3.0:1786562748.712656:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946944 00000100:00100000:3.0:1786562748.712672:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1786562748.712678:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654946560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712891:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654946560:12345-0@lo:400:kworker.0 Request processed in 212us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.712898:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1786562748.712912:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1786562748.712918:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654946944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712946:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654946944:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.712952:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:3.0:1786562748.712974:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562748.712989:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654946944:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.712998:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654946560:0@lo:400:kworker.0 00000100:00100000:3.0:1786562748.713087:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654946304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562748.714122:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654946816 00000100:00100000:1.0:1786562748.714129:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654946816 00000100:00100000:1.0:1786562748.714173:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1786562748.714182:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654946816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562748.714252:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654946816:12345-0@lo:400:kworker.0 Request processed in 72us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562748.714260:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1786562748.714281:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562748.714292:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654947072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562748.714372:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786562748.714424:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562748.714446:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654946816:0@lo:400:kworker.0 00000100:00100000:2.0:1786562748.714561:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947072 00000100:00100000:2.0:1786562748.714566:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947072 00000100:00100000:2.0:1786562748.714587:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1786562748.714595:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654947072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562748.717593:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562748.717716:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654947072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3118us (3339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562748.717727:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1786562748.717958:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654947072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562748.718051:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1786562748.832683:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562748.832750:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562748.832970:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982016 00000100:00100000:0.0:1786562748.832981:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982016 00000100:00100000:2.0:1786562748.833000:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982272 00000100:00100000:2.0:1786562748.833050:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982272 00000100:00100000:0.0:1786562748.833195:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17423 00000100:00100000:0.0:1786562748.833206:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652982016:12345-192.168.204.29@tcp:41:mkdir.0 00000004:00000024:0.0:1786562748.833270:0:34450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2260205568 avail 2258108416 00000100:00100000:0.0:1786562748.833364:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345652982016:12345-192.168.204.29@tcp:41:mkdir.0 Request processed in 160us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562748.833378:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17423 00000100:00100000:0.0:1786562748.833411:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17424 00000100:00100000:0.0:1786562748.833422:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+17:70692:x1873345652982272:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:0.0:1786562748.833462:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562748.833489:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a0b82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd4f8 expref: 17 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.833510:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332100) 00010000:00010000:0.0:1786562748.833522:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562748.833836:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.833856:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.833865:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.833884:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.833895:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.833907:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562748.836578:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 512 00010000:00010000:0.0:1786562748.836596:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.836606:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.836614:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.836620:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562748.836624:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.836631:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.836646:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562748.836650:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562748.836653:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.836659:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0f9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562748.836681:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b9903f0 reply state 000000007c9e60a3 transno 8589950843 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562748.836691:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562748.837585:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:70692:x1873345652982272:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 4159us (4830us total) trans 8589950843 rc 0/0 00000100:00100000:0.0:1786562748.837601:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17424 00010000:00010000:1.0:1786562748.845684:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.845705:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.845713:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.845735:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562748.845740:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.845747:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.845765:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa25ad81b (ffff90e9b46ab300) 00010000:00010000:1.0:1786562748.845768:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562748.845772:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.845778:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a0fa3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562748.892841:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562748.892990:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982400 00000100:00100000:3.0:1786562748.893002:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982400 00000100:00100000:3.0:1786562748.893127:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17425 00000100:00100000:3.0:1786562748.893150:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+17:70695:x1873345652982400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562748.893437:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562748.893544:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd617 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.893627:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.893643:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.893655:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562748.895637:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1786562748.895646:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 43 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562748.895829:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.895865:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd617 expref: 19 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.895887:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd617 expref: 18 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.895896:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562748.895899:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562748.895903:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267400, rc 0) 00000100:00100000:3.0:1786562748.895987:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:70695:x1873345652982400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2849us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.895995:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17425 00000100:00100000:3.0:1786562748.901319:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562748.901429:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982528 00000100:00100000:0.0:1786562748.901439:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982528 00000100:00100000:0.0:1786562748.901517:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17426 00000100:00100000:0.0:1786562748.901529:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:70695:x1873345652982528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562748.901550:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562748.901571:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0fb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd61e expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901652:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901667:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901678:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901693:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901700:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901707:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901831:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0fcd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901843:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0fcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901850:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0fcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562748.901882:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 512 00000004:00200000:0.0:1786562748.901885:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562748.901909:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0fcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901922:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901928:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901934:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901940:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562748.901944:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901952:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901964:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:0.0:1786562748.901968:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562748.901973:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901984:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.901997:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902327:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902335:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902341:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562748.902344:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902351:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902361:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa25ad81b (ffff90e9b46abf00) 00010000:00010000:0.0:1786562748.902364:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562748.902367:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902374:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0fc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa25ad81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902411:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd61e expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902431:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269800/0x5c655bf6668a0fcd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd61e expref: 19 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.902438:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562748.902441:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786562748.902443:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269800, rc 0) 00000100:00100000:0.0:1786562748.902570:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:70695:x1873345652982528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1042us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562748.902579:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17426 00000100:00100000:1.0:1786562748.908078:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562748.908185:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982656 00000100:00100000:3.0:1786562748.908195:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982656 00000100:00100000:3.0:1786562748.908260:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17427 00000100:00100000:3.0:1786562748.908272:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:70695:x1873345652982656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562748.908295:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562748.908316:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0fd4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd625 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.908385:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.908399:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.908412:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912220:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912246:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912262:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912424:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912433:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912441:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912447:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562748.912451:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912459:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912473:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562748.912476:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562748.912480:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912486:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a0fdb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912498:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912504:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912512:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912517:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562748.912521:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912528:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912535:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1800) 00010000:00010000:3.0:1786562748.912537:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562748.912540:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912545:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a0fe2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912603:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0fd4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd625 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912615:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562748.912617:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562748.912620:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0fd4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd625 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.912629:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562748.912714:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:70695:x1873345652982656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4443us (4645us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562748.912726:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17427 00000100:00100000:1.0:1786562748.917847:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562748.917946:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982784 00000100:00100000:0.0:1786562748.917957:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982784 00000100:00100000:0.0:1786562748.918157:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17428 00000100:00100000:0.0:1786562748.918169:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:70695:x1873345652982784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562748.918208:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562748.918230:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0fe9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd62c expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918317:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918332:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918342:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918358:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918366:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918373:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918443:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918464:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918472:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918479:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562748.918483:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918491:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918504:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562748.918507:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562748.918512:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918519:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a0ff0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918530:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918537:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918543:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918547:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562748.918551:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918556:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918563:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46abf00) 00010000:00010000:0.0:1786562748.918566:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562748.918569:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918574:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a0ff7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918609:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0fe9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd62c expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918619:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562748.918622:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562748.918625:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a0fe9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd62c expref: 20 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.918640:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562748.918703:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+19:70695:x1873345652982784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 537us (867us total) trans 0 rc 301/301 00000100:00100000:0.0:1786562748.918711:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17428 00000100:00100000:0.0:1786562748.927113:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562748.927425:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652982912 00000100:00100000:3.0:1786562748.927435:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652982912 00000100:00100000:3.0:1786562748.927506:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17429 00000100:00100000:3.0:1786562748.927518:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:70695:x1873345652982912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562748.927537:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562748.927559:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd633 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.927644:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1005 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.927658:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1005 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.927669:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1005 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562748.927728:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 512 00000004:00200000:3.0:1786562748.927733:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562748.927756:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1005 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.927781:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a0ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd633 expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.927800:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1005 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd633 expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.927813:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562748.927815:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562748.927818:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267c00, rc 0) 00000100:00100000:3.0:1786562748.927869:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:70695:x1873345652982912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 354us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562748.927876:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17429 00000100:00100000:2.0:1786562748.937844:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562748.937939:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652983040 00000100:00100000:0.0:1786562748.937949:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652983040 00000100:00100000:0.0:1786562748.938055:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17430 00000100:00100000:0.0:1786562748.938066:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:70695:x1873345652983040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562748.938089:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562748.938110:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a100c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd63a expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.938182:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.938197:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.938208:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.938223:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.938242:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.938253:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939161:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939177:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939184:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939191:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562748.939195:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939207:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939221:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562748.939224:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562748.939229:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939292:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1013 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939369:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939377:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939383:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939388:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562748.939391:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939398:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939407:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46abf00) 00010000:00010000:1.0:1786562748.939409:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562748.939412:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939418:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a101a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939541:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a100c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd63a expref: 21 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939551:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562748.939553:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562748.939557:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a100c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd63a expref: 21 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562748.939567:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:1.0:1786562748.940101:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:70695:x1873345652983040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2035us (2266us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562748.940111:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17430 00000100:00100000:1.0:1786562748.945139:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562748.945467:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652983296 00000100:00100000:3.0:1786562748.945477:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652983296 00000100:00100000:3.0:1786562748.945537:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17431 00000100:00100000:3.0:1786562748.945548:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:70695:x1873345652983296:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562748.945569:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562748.945573:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562748.945602:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1005 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd633 expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.945622:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562748.945627:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562748.945639:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1021 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd641 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.947765:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.947791:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.947803:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.947819:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.947827:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.947833:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948621:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948631:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948639:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562748.948649:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 0 00010000:00010000:3.0:1786562748.948675:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948683:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948690:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948696:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562748.948700:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948713:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948725:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562748.948728:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562748.948733:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948739:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1028 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562748.948751:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d16f82b8 reply state 00000000f839a77b transno 8589950844 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562748.948760:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786562748.948794:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1021 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948809:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.948817:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562748.948819:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562748.948822:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267a00, rc 0) 00000100:00100000:3.0:1786562748.948899:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:70695:x1873345652983296:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3351us (3770us total) trans 8589950844 rc 0/0 00000100:00100000:3.0:1786562748.948908:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17431 00010000:00010000:3.0:1786562748.951992:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.952172:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.952180:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.952187:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562748.952192:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.952200:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.952216:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1800) 00010000:00010000:3.0:1786562748.952219:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562748.952224:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.952670:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a102f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562748.963561:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562748.963671:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652983552 00000100:00100000:0.0:1786562748.963681:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652983552 00000100:00100000:0.0:1786562748.963835:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17432 00000100:00100000:0.0:1786562748.963847:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:70695:x1873345652983552:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562748.963873:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562748.963893:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1044 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd648 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.963995:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.964053:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.964064:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.964321:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562748.964338:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 22 pid: 33115 timeout: 1281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562748.964353:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654947200:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562748.964457:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562748.967662:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345654947200:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562748.967693:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562748.976262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562748.976721:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652983680 00000100:00100000:2.0:1786562748.976731:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652983680 00010000:00010000:2.0:1786562748.976774:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 23 pid: 33115 timeout: 1281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562748.976819:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8794 00000100:00100000:2.0:1786562748.976830:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345652983680:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562748.976845:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562748.976853:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 23 pid: 33115 timeout: 1281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562748.976868:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 23 pid: 33115 timeout: 1281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562748.976891:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a1036 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd641 expref: 23 pid: 33115 timeout: 1281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562748.976908:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:2.0:1786562748.976914:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562748.976923:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562748.976930:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562748.976959:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562748.977029:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.977051:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562748.977077:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 0 00000100:00100000:2.0:1786562748.977077:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345652983680:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562748.977097:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8794 00000004:00080000:3.0:1786562748.977876:0:34450:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x741:0x0], index 0: 0 00000004:00080000:3.0:1786562748.977898:0:34450:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x742:0x0], index 0: 0 00010000:00010000:3.0:1786562748.978098:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978108:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978115:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978121:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562748.978126:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978133:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978146:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e999bb1100) 00010000:00010000:3.0:1786562748.978150:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562748.978153:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978160:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a104b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978780:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1044 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd648 expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978801:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562748.978804:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562748.978807:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1044 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd648 expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562748.978818:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:3.0:1786562748.978933:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:70695:x1873345652983552:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 15087us (15381us total) trans 8589950845 rc 301/301 00000100:00100000:3.0:1786562748.978942:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17432 00000100:00100000:1.0:1786562748.986974:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562748.988295:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652983936 00000100:00100000:3.0:1786562748.988309:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652983936 00000100:00100000:3.0:1786562748.988452:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6346 00000100:00100000:3.0:1786562748.988463:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70695:x1873345652983936:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562748.989378:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:70695:x1873345652983936:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 913us (2409us total) trans 8589950846 rc 0/0 00000100:00100000:3.0:1786562748.989520:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6346 00000100:00100000:0.0:1786562749.005957:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562749.006168:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652984192 00000100:00100000:2.0:1786562749.006179:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652984192 00000100:00100000:2.0:1786562749.006264:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6347 00000100:00100000:2.0:1786562749.006275:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:70695:x1873345652984192:12345-192.168.204.29@tcp:35:lfs.0 00000100:00080000:1.0:1786562749.006474:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562749.006945:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:70695:x1873345652984192:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 670us (995us total) trans 8589950847 rc 0/0 00000100:00100000:2.0:1786562749.006955:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6347 00000100:00100000:1.0:1786562749.042973:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562749.044537:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652984448 00000100:00100000:2.0:1786562749.044555:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652984448 00000100:00100000:2.0:1786562749.044690:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17433 00000100:00100000:2.0:1786562749.044703:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:70696:x1873345652984448:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562749.044740:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562749.045283:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1059 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd64f expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045398:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045412:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045423:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045438:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045444:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045449:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045553:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045561:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045567:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045577:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562749.045581:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045588:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045600:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562749.045603:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562749.045608:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045614:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1060 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045628:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045634:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045640:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045645:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562749.045648:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045654:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045678:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332500) 00010000:00010000:2.0:1786562749.045681:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562749.045684:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.045690:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1067 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.046260:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1059 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd64f expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.046275:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562749.046277:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562749.046281:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1059 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd64f expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562749.046293:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfcc00, rc 0) 00000100:00100000:2.0:1786562749.046684:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:70696:x1873345652984448:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1982us (3719us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562749.046693:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17433 00000100:00100000:1.0:1786562749.053607:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562749.053808:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652984704 00000100:00100000:3.0:1786562749.053820:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652984704 00000100:00100000:3.0:1786562749.054140:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17434 00000100:00100000:3.0:1786562749.054152:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:70696:x1873345652984704:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562749.054175:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562749.054197:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a106e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd656 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562749.054345:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 512 00010000:00010000:3.0:1786562749.054491:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a106e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd656 expref: 25 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.054508:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562749.054511:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562749.054517:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a106e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd656 expref: 25 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.054535:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267800, rc 0) 00000100:00100000:3.0:1786562749.054613:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:70696:x1873345652984704:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 464us (1019us total) trans 8589950848 rc 301/301 00000100:00100000:3.0:1786562749.054621:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17434 00000100:00100000:1.0:1786562749.061412:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562749.061495:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652984832 00000100:00100000:3.0:1786562749.061505:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652984832 00000100:00100000:3.0:1786562749.061569:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17435 00000100:00100000:3.0:1786562749.061580:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:70696:x1873345652984832:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562749.061660:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061686:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061699:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061726:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061733:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061741:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061846:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061855:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061862:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562749.061898:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 0 00000004:00200000:3.0:1786562749.061902:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562749.061914:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061927:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061934:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061956:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061963:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562749.061967:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061975:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.061990:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562749.061994:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562749.061998:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062052:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a107c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062067:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062073:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062079:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062085:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562749.062088:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062094:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062102:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1100) 00010000:00010000:3.0:1786562749.062105:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562749.062108:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062114:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a1083 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062130:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062137:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062143:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062148:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562749.062151:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062157:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062164:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e999bb1800) 00010000:00010000:3.0:1786562749.062166:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562749.062169:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562749.062175:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a108a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562749.062245:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:70696:x1873345652984832:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 666us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562749.062254:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17435 00000100:00100000:0.0:1786562749.068208:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562749.068489:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985088 00000100:00100000:2.0:1786562749.068500:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985088 00000100:00100000:2.0:1786562749.068560:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6348 00000100:00100000:2.0:1786562749.068570:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881db4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:70696:x1873345652985088:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562749.068853:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881db4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:70696:x1873345652985088:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 284us (656us total) trans 8589950849 rc 0/0 00000100:00100000:2.0:1786562749.068864:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6348 00010000:00010000:0.0:1786562749.222099:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562749.293841:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950843 is committed 00000001:00080000:0.0:1786562749.293858:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950849 is committed 00010000:00010000:0.0:1786562750.245389:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562751.272785:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562752.293252:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562752.827699:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562752.827746:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562752.827786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562752.827822:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562752.827853:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985600 00000100:00100000:1.0:1786562752.827873:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985600 00000100:00100000:1.0:1786562752.827925:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985472 00000100:00100000:1.0:1786562752.827927:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985472 00000100:00100000:1.0:1786562752.827947:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 558 00000100:00100000:1.0:1786562752.827967:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652985600:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562752.828068:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652985600:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562752.828075:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 558 00000100:00100000:1.0:1786562752.828092:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 559 00000100:00100000:1.0:1786562752.828098:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652985472:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562752.828125:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652985472:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562752.828131:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 559 00000100:00080000:1.0:1786562752.828145:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562752.828148:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562752.828416:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985216 00000100:00100000:3.0:1786562752.828421:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985216 00000100:00100000:3.0:1786562752.828461:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 338 00000100:00100000:3.0:1786562752.828468:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652985216:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562752.828508:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652985216:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 41us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562752.828515:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 338 00000100:00100000:2.0:1786562752.828824:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985344 00000100:00100000:2.0:1786562752.828829:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985344 00000100:00100000:2.0:1786562752.828889:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 437 00000100:00100000:2.0:1786562752.828897:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652985344:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562752.828932:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652985344:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562752.828938:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 437 00000100:00080000:3.0:1786562752.829094:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562753.317273:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562753.829330:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562753.829357:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654947328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562753.829431:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562753.829728:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654947840:0@lo:400:kworker.0 00000100:00100000:3.0:1786562753.829773:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562753.829805:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786562753.829811:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654947456:0@lo:400:kworker.0 00000100:00100000:3.0:1786562753.829838:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562753.829862:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654947968:0@lo:400:kworker.0 00000100:00100000:3.0:1786562753.829887:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562753.829924:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654947712:0@lo:400:kworker.0 00000100:00100000:3.0:1786562753.829957:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562753.829974:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562753.829979:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654947584:0@lo:400:kworker.0 00000100:00100000:3.0:1786562753.830000:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562753.830048:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947456 00000100:00100000:3.0:1786562753.830055:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947456 00000100:00100000:3.0:1786562753.830101:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1786562753.830110:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654947456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830274:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947840 00000100:00100000:2.0:1786562753.830278:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947840 00000100:00100000:2.0:1786562753.830324:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786562753.830331:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654947840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830376:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654947840:12345-0@lo:400:kworker.0 Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562753.830383:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786562753.830407:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947968 00000100:00100000:2.0:1786562753.830410:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947968 00000100:00100000:2.0:1786562753.830434:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947712 00000100:00100000:2.0:1786562753.830436:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947712 00000100:00100000:2.0:1786562753.830451:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947584 00000100:00100000:2.0:1786562753.830453:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947584 00000100:00100000:2.0:1786562753.830471:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1786562753.830477:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654947968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830511:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654947968:12345-0@lo:400:kworker.0 Request processed in 35us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562753.830517:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1786562753.830529:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1786562753.830534:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654947712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830563:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654947712:12345-0@lo:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562753.830569:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1786562753.830580:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1786562753.830586:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654947584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830612:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654947584:12345-0@lo:400:kworker.0 Request processed in 27us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562753.830618:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00080000:2.0:1786562753.830635:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562753.830640:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562753.830670:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654947968:0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830682:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654947840:0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830771:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88317bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654947584:0@lo:400:kworker.0 00000100:00100000:2.0:1786562753.830782:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654947712:0@lo:400:kworker.0 00000100:00100000:3.0:1786562753.830911:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654947456:12345-0@lo:400:kworker.0 Request processed in 802us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562753.830919:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1786562753.831266:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654947456:0@lo:400:kworker.0 00000100:00100000:1.0:1786562753.831378:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654948096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562753.831413:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562753.831993:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654947328 00000100:00100000:2.0:1786562753.832001:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654947328 00000100:00100000:2.0:1786562753.832076:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948096 00000100:00100000:2.0:1786562753.832080:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948096 00000100:00100000:2.0:1786562753.832096:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1786562753.832104:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654947328:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786562753.832239:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562753.832296:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1786562753.832305:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654948096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562753.832328:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562753.832492:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654948096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562753.832499:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00002000:00000024:2.0:1786562753.832543:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562753.832587:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654947328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 484us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562753.832594:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1786562753.832649:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654948096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562753.832721:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654947328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786562754.341203:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562755.367253:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562756.390370:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562757.413217:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562757.943948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562757.943993:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562757.944068:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562757.944103:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562757.944171:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652986112 00000100:00100000:3.0:1786562757.944180:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652986112 00000100:00080000:1.0:1786562757.944240:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562757.944248:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985984 00000100:00100000:3.0:1786562757.944251:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985984 00000100:00100000:1.0:1786562757.944259:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 561 00000100:00100000:1.0:1786562757.944271:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652986112:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562757.944275:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 562 00000100:00100000:3.0:1786562757.944281:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652985984:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562757.944344:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652985984:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562757.944344:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652986112:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562757.944351:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 561 00000100:00080000:1.0:1786562757.944374:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562757.944390:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985728 00000100:00100000:2.0:1786562757.944395:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985728 00000100:00100000:2.0:1786562757.944429:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 340 00000100:00100000:2.0:1786562757.944437:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652985728:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562757.944463:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652985728:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562757.944469:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 340 00000100:00100000:0.0:1786562757.944726:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652985856 00000100:00100000:0.0:1786562757.944730:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652985856 00000100:00100000:0.0:1786562757.944879:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 441 00000100:00100000:0.0:1786562757.944888:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652985856:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562757.944920:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+18:2349:x1873345652985856:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562757.944926:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 441 00000100:00080000:1.0:1786562757.945133:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562757.945703:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 562 00010000:00010000:1.0:1786562758.439663:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562758.949640:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562758.949670:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654948224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562758.949743:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562758.949889:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948224 00000100:00100000:0.0:1786562758.949898:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948224 00000100:00100000:0.0:1786562758.949979:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1786562758.949993:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654948224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562758.950068:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520028160 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562758.950138:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654948224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562758.950146:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1786562758.950300:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654948224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562758.950368:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562758.950379:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654948352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562758.950411:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786562758.950457:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562758.950633:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654948608:0@lo:400:kworker.0 00000100:00100000:1.0:1786562758.950665:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562758.950686:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562758.950692:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654948736:0@lo:400:kworker.0 00000100:00100000:1.0:1786562758.950712:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562758.950859:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654948480:0@lo:400:kworker.0 00000100:00100000:3.0:1786562758.950893:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562758.950924:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562758.950929:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654948864:0@lo:400:kworker.0 00000100:00100000:3.0:1786562758.950952:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562758.951046:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948608 00000100:00100000:2.0:1786562758.951053:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948608 00000100:00100000:2.0:1786562758.951100:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948736 00000100:00100000:2.0:1786562758.951104:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948736 00000100:00100000:2.0:1786562758.951122:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948864 00000100:00100000:2.0:1786562758.951124:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948864 00000100:00100000:2.0:1786562758.951141:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1786562758.951149:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654948608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562758.951194:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654948608:12345-0@lo:400:kworker.0 Request processed in 45us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562758.951201:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1786562758.951214:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1786562758.951220:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562758.951247:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654948736:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562758.951254:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1786562758.951266:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1786562758.951271:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562758.951303:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654948864:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562758.951309:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1786562758.951347:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654948864:0@lo:400:kworker.0 00000100:00100000:2.0:1786562758.951371:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654948736:0@lo:400:kworker.0 00000100:00100000:2.0:1786562758.951380:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654948608:0@lo:400:kworker.0 00000100:00080000:3.0:1786562758.951510:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562758.951686:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948480 00000100:00100000:1.0:1786562758.951691:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948480 00000100:00100000:1.0:1786562758.951725:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1786562758.951731:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654948480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562758.951777:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654948480:12345-0@lo:400:kworker.0 Request processed in 46us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562758.951783:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1786562758.951935:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948352 00000100:00100000:0.0:1786562758.951941:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948352 00000100:00100000:0.0:1786562758.951979:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1786562758.951986:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654948352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562758.952103:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562758.952143:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654948352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562758.952149:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1786562758.952436:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654948480:0@lo:400:kworker.0 00000100:00100000:3.0:1786562758.952455:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654948352:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786562758.952709:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786562759.461287:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562760.485417:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562760.903213:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562760.903314:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652986368 00000100:00100000:2.0:1786562760.903323:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652986368 00000100:00100000:2.0:1786562760.903406:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17436 00000100:00100000:2.0:1786562760.903417:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:70724:x1873345652986368:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562760.903439:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562760.903458:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1091 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd65d expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903535:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903549:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903561:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903579:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903587:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903594:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903960:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903969:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903975:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903981:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562760.903985:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.903992:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904040:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562760.904044:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562760.904048:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904054:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a1098 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904068:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904074:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904079:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904084:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562760.904087:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904093:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904100:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332500) 00010000:00010000:2.0:1786562760.904103:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562760.904106:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904111:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a109f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904148:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1091 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd65d expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904158:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562760.904160:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562760.904164:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1091 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd65d expref: 19 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.904173:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562760.904237:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:70724:x1873345652986368:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 823us (1034us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562760.904245:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17436 00000100:00080000:1.0:1786562760.904313:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562760.913623:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562760.913722:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652986624 00000100:00100000:2.0:1786562760.913731:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652986624 00000100:00100000:2.0:1786562760.913791:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17437 00000100:00100000:2.0:1786562760.913809:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+18:70724:x1873345652986624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562760.913831:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562760.913852:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd664 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562760.914132:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 7680 00010000:00010000:2.0:1786562760.914361:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd664 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.914375:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562760.914378:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562760.914383:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd664 expref: 20 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.914396:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562760.914445:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+19:70724:x1873345652986624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 638us (832us total) trans 8589950850 rc 301/301 00000100:00100000:2.0:1786562760.914452:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17437 00000100:00100000:0.0:1786562760.922691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562760.927239:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652986752 00000100:00100000:2.0:1786562760.927256:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652986752 00000100:00100000:2.0:1786562760.927386:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17438 00000100:00100000:2.0:1786562760.927398:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:70724:x1873345652986752:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562760.927507:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927525:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927539:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927556:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927563:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927570:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927962:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927972:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.927979:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562760.928045:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 0 00000004:00200000:2.0:1786562760.928050:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562760.928071:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928085:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928092:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928099:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928105:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562760.928109:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928117:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928128:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562760.928131:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562760.928135:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928141:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a10b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928151:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928157:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928167:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928172:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562760.928175:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928181:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928187:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332500) 00010000:00010000:2.0:1786562760.928189:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562760.928192:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928197:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928211:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928217:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928222:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928227:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562760.928229:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928239:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928246:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562760.928248:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562760.928251:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562760.928257:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10c2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562760.928351:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+19:70724:x1873345652986752:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 954us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562760.928360:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17438 00000100:00100000:1.0:1786562760.933400:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562760.933486:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652987008 00000100:00100000:3.0:1786562760.933497:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652987008 00000100:00100000:3.0:1786562760.933560:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6349 00000100:00100000:3.0:1786562760.933570:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:70724:x1873345652987008:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562760.934071:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:70724:x1873345652987008:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 500us (680us total) trans 8589950851 rc 0/0 00000100:00100000:3.0:1786562760.934080:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6349 00000100:00100000:1.0:1786562760.978370:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562760.978471:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652987264 00000100:00100000:0.0:1786562760.978482:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652987264 00000100:00100000:0.0:1786562760.978544:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17439 00000100:00100000:0.0:1786562760.978554:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:70725:x1873345652987264:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1786562760.978579:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562760.978601:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a10c9 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd66b expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.984346:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.984368:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.984380:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.984398:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.984405:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.984411:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986185:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a10de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986204:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a10de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986215:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a10de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562760.986231:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 0 00010000:00010000:1.0:1786562760.986345:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986353:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986364:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986370:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562760.986374:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986381:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986392:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562760.986395:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562760.986398:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986404:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a10d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986429:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986434:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986439:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986443:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562760.986445:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986454:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986461:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562760.986463:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562760.986466:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986471:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1600/0x5c655bf6668a10d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986533:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269000/0x5c655bf6668a10c9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd66b expref: 23 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986548:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a10de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd66b expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562760.986555:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:1.0:1786562760.986557:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562760.986560:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1000, rc 0) 00000100:00100000:1.0:1786562760.986707:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:70725:x1873345652987264:12345-192.168.204.29@tcp:101:dd.0 Request processed in 8153us (8350us total) trans 8589950852 rc 0/0 00000100:00100000:1.0:1786562760.986716:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17439 00000100:00100000:1.0:1786562761.007922:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562761.008158:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652987520 00000100:00100000:2.0:1786562761.008168:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652987520 00000100:00100000:2.0:1786562761.008237:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17440 00000100:00100000:2.0:1786562761.008247:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:70725:x1873345652987520:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562761.008271:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562761.008274:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562761.008299:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a10de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd66b expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.008325:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9bc2a2c00) 00010000:00010000:2.0:1786562761.008336:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562761.008351:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10ec lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd672 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.008407:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.008419:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.008428:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786562761.009423:0:33114:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x726:0x0], index 1: 0 00000040:00080000:2.0:1786562761.009596:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4415, 88 off358208 00000004:00080000:2.0:1786562761.009607:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1193451601007ns, next at 1151432168614ns, rc = 0 00000040:00080000:2.0:1786562761.009767:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4416, 88 off358296 00000004:00080000:2.0:1786562761.009773:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1193451767670ns, next at 1151432168614ns, rc = 0 00000040:00080000:2.0:1786562761.010498:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4449, 88 off361256 00000004:00080000:2.0:1786562761.010508:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1193452501958ns, next at 1151434097826ns, rc = 0 00010000:00010000:2.0:1786562761.041589:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd672 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.041607:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562761.041610:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562761.041631:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a10ec lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd672 expref: 24 pid: 33114 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.041650:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd672 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.041688:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562761.041690:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1786562761.041692:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfce00, rc 0) 00000100:00100000:2.0:1786562761.041766:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:70725:x1873345652987520:12345-192.168.204.29@tcp:101:dd.0 Request processed in 33519us (33852us total) trans 8589950853 rc 0/0 00000100:00100000:2.0:1786562761.041776:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17440 00000001:00080000:0.0:1786562761.042114:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950852 is committed 00000001:00080000:0.0:1786562761.042126:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950853 is committed 00000004:00080000:0.0:1786562761.042130:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2952 committed 00000004:00080000:0.0:1786562761.042145:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2920 committed 00000004:00080000:0.0:1786562761.042155:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2919 committed 00000100:00100000:0.0:1786562761.042245:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654948992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562761.042296:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562761.042354:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786562761.042362:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bade5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654949120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562761.042386:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562761.042414:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654948992 00000100:00100000:0.0:1786562761.042421:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654948992 00000100:00100000:0.0:1786562761.042464:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949120 00000100:00100000:0.0:1786562761.042467:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949120 00000100:00100000:0.0:1786562761.042485:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17995 00000100:00100000:0.0:1786562761.042493:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654948992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562761.042762:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654948992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (464us total) trans 21474843666 rc 0/0 00000100:00100000:0.0:1786562761.042769:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17995 00000100:00100000:0.0:1786562761.042786:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17996 00000100:00100000:0.0:1786562761.042804:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654949120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562761.042923:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654949120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (534us total) trans 21474843667 rc 0/0 00000100:00100000:0.0:1786562761.042930:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17996 00000100:00080000:0.0:1786562761.042951:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1786562761.042984:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bade5500/2, rc 0, transno 21474843667 00000100:00100000:0.0:1786562761.042990:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654949120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1786562761.043048:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bade4700/2, rc 0, transno 21474843666 00000100:00100000:0.0:1786562761.043053:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bade4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654948992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562761.044488:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562761.044505:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654949248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562761.044555:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562761.044638:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949248 00000100:00100000:1.0:1786562761.044646:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949248 00000100:00100000:1.0:1786562761.044711:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17997 00000100:00100000:1.0:1786562761.044720:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654949248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562761.045048:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654949248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 328us (493us total) trans 17179876149 rc 0/0 00000100:00100000:1.0:1786562761.045056:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17997 00000100:00080000:2.0:1786562761.045873:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1786562761.045919:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883179500/2, rc 0, transno 17179876149 00000100:00100000:2.0:1786562761.045928:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654949248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562761.053892:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562761.053945:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562761.055314:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652987776 00000100:00100000:1.0:1786562761.055326:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652987776 00000100:00080000:0.0:1786562761.055476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562761.055785:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652987648 00000100:00100000:1.0:1786562761.055801:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652987648 00000100:00100000:2.0:1786562761.055835:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11663 00000100:00100000:2.0:1786562761.055850:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652987776:12345-192.168.204.29@tcp:4:dd.0 00002000:00010000:2.0:1786562761.055902:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786562761.055911:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.055927:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=1193s v=(0 0) 00010000:00010000:2.0:1786562761.055932:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562761.055939:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.055956:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562761.056487:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11664 00000100:00100000:1.0:1786562761.056499:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652987648:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1786562761.056521:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562761.056532:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562761.056536:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562761.056541:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562761.056552:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562761.157217:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843667 is committed 00000001:00080000:1.0:1786562761.157239:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843668 is committed 00002000:00010000:2.0:1786562761.157674:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1786562761.157680:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb mtime from disk: 0 -> 1786562760 00002000:00010000:2.0:1786562761.157683:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb ctime from disk: 0 -> 1786562760 00002000:00010000:2.0:1786562761.157685:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1786562761.157699:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.157712:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.157721:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.157728:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562761.157732:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.157740:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.157763:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.157771:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a414d928/0x5c655bf6668a10fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562761.157884:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652987776:12345-192.168.204.29@tcp:4:dd.0 Request processed in 102034us (103997us total) trans 21474843668 rc 0/0 00000100:00100000:2.0:1786562761.157905:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11663 00000001:00080000:3.0:1786562761.216685:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843669 is committed 00002000:00010000:2.0:1786562761.216875:0:16203:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1786562761.216961:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.216976:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.219267:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.219288:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562761.219294:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.219305:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.219328:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562761.219337:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1a893d/0x5c655bf6668a1101 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562761.219630:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345652987648:12345-192.168.204.29@tcp:4:dd.0 Request processed in 163129us (165679us total) trans 21474843669 rc 0/0 00000100:00100000:2.0:1786562761.219641:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11664 00000100:00100000:2.0:1786562761.231274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562761.231349:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988032 00000100:00100000:3.0:1786562761.231361:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988032 00000100:00100000:3.0:1786562761.231418:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6350 00000100:00100000:3.0:1786562761.231429:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:70725:x1873345652988032:12345-192.168.204.29@tcp:35:dd.0 00000001:00080000:3.0:1786562761.231815:0:35899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950854 00000100:00100000:3.0:1786562761.231937:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70725:x1873345652988032:12345-192.168.204.29@tcp:35:dd.0 Request processed in 508us (671us total) trans 8589950855 rc 0/0 00000100:00100000:3.0:1786562761.231946:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6350 00000020:00080000:3.0:1786562761.231951:0:35899:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786562761.510133:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562762.534608:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562763.063439:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562763.063515:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988160 00000100:00100000:1.0:1786562763.063527:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988160 00000100:00100000:1.0:1786562763.063587:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 342 00000100:00100000:1.0:1786562763.063597:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652988160:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562763.063665:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652988160:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562763.063673:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 342 00000100:00100000:1.0:1786562763.066548:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562763.066590:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562763.066614:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562763.066652:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988544 00000100:00100000:1.0:1786562763.066663:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988544 00000100:00100000:1.0:1786562763.066720:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988416 00000100:00100000:1.0:1786562763.066724:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988416 00000100:00100000:1.0:1786562763.066750:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 563 00000100:00100000:1.0:1786562763.066775:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652988544:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562763.066808:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988288 00000100:00100000:3.0:1786562763.066828:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988288 00000100:00100000:1.0:1786562763.066867:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652988544:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562763.066881:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 563 00000100:00100000:3.0:1786562763.066918:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 445 00000100:00100000:1.0:1786562763.066934:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 564 00000100:00100000:3.0:1786562763.066942:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652988288:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562763.066956:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652988416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562763.066990:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652988416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562763.066999:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 564 00000100:00080000:1.0:1786562763.067058:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562763.067066:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562763.067069:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562763.068538:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345652988288:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 258us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562763.068570:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 445 00010000:00010000:1.0:1786562763.560692:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562764.069513:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654949632:0@lo:400:kworker.0 00000100:00100000:3.0:1786562764.069578:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654949888:0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.069596:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562764.069609:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562764.069656:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654950144:0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.069682:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562764.069714:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562764.069720:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654949760:0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.069752:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562764.069785:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949632 00000100:00100000:2.0:1786562764.069791:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949632 00000100:00100000:2.0:1786562764.069846:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950144 00000100:00100000:2.0:1786562764.069849:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950144 00000100:00100000:2.0:1786562764.069864:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949760 00000100:00100000:2.0:1786562764.069866:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949760 00000100:00100000:2.0:1786562764.069898:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1786562764.069908:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654949632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.069969:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654949632:12345-0@lo:400:kworker.0 Request processed in 63us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562764.069977:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1786562764.069995:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1786562764.070156:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654950144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.070188:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654950144:12345-0@lo:400:kworker.0 Request processed in 187us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562764.070195:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1786562764.070208:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1786562764.070214:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.070240:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654949760:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562764.070246:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00080000:2.0:1786562764.070265:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562764.070305:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654949760:0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.070315:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654949632:0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.070323:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654950144:0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.070446:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949888 00000100:00100000:2.0:1786562764.070450:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949888 00000100:00100000:2.0:1786562764.070488:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1786562764.070495:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654949888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.070528:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654949888:12345-0@lo:400:kworker.0 Request processed in 33us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562764.070534:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:2.0:1786562764.070548:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562764.070688:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562764.070703:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654949504:0@lo:400:kworker.0 00000100:00100000:1.0:1786562764.070754:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562764.070780:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654950016:0@lo:400:kworker.0 00000100:00100000:1.0:1786562764.070803:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562764.070821:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654949376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562764.070843:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562764.071078:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654950272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562764.071111:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562764.071143:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949376 00000100:00100000:0.0:1786562764.071148:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949376 00000100:00100000:0.0:1786562764.071184:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950272 00000100:00100000:0.0:1786562764.071187:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950272 00000100:00100000:0.0:1786562764.071200:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1786562764.071207:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654949376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562764.071237:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562764.071273:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654949376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562764.071279:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1786562764.071293:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1786562764.071299:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654950272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562764.071317:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520814592 pending 0 free 3835691008 avail 3833593856 00000100:00100000:0.0:1786562764.071342:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654950272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562764.071347:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00080000:0.0:1786562764.071374:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562764.071392:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843667 gen 2 00000004:00080000:0.0:1786562764.071397:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bade4700, transno 21474843666 00000004:00080000:0.0:1786562764.071405:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bade5500, transno 21474843667 00000100:00100000:0.0:1786562764.071415:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654950272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562764.071913:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950016 00000100:00100000:0.0:1786562764.071919:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950016 00000100:00100000:0.0:1786562764.072314:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1786562764.072323:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654950016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562764.072673:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654949376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562764.072793:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654950016:12345-0@lo:400:kworker.0 Request processed in 471us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562764.072801:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1786562764.073224:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654949504 00000100:00100000:2.0:1786562764.073230:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654949504 00000100:00100000:2.0:1786562764.073272:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1786562764.073280:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654949504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562764.073324:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654949504:12345-0@lo:400:kworker.0 Request processed in 46us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562764.073330:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1786562764.073474:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654949504:0@lo:400:kworker.0 00000100:00100000:1.0:1786562764.073487:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654950016:0@lo:400:kworker.0 00000100:00100000:3.0:1786562764.076718:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654949888:0@lo:400:kworker.0 00010000:00010000:0.0:1786562764.581824:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562765.605349:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562766.159718:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950855 is committed 00000001:00080000:0.0:1786562766.167186:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876149 is committed 00010000:00010000:0.0:1786562766.629886:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562767.653677:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562768.184992:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562768.185110:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562768.185145:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562768.185176:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562768.185220:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652989056 00000100:00100000:2.0:1786562768.185233:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652989056 00000100:00100000:1.0:1786562768.185270:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988672 00000100:00100000:1.0:1786562768.185287:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988672 00000100:00100000:2.0:1786562768.185340:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988928 00000100:00100000:2.0:1786562768.185346:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988928 00000100:00100000:1.0:1786562768.185384:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 344 00000100:00100000:2.0:1786562768.185391:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 567 00000100:00100000:1.0:1786562768.185400:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652988672:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562768.185410:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652989056:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562768.185514:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652988800 00000100:00100000:3.0:1786562768.185519:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652988800 00000100:00100000:3.0:1786562768.185556:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 449 00000100:00100000:3.0:1786562768.185563:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652988800:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562768.185646:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 568 00000100:00100000:0.0:1786562768.185669:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652988928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562768.195873:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345652988672:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 10465us (10713us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562768.195889:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 344 00000100:00080000:1.0:1786562768.196320:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562768.196326:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562768.196329:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562768.198399:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345652988800:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 12817us (13406us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562768.198419:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 449 00000100:00100000:0.0:1786562768.204499:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652988928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 18810us (19298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562768.204521:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 568 00000100:00100000:2.0:1786562768.206220:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345652989056:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 20805us (21095us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562768.206237:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 567 00010000:00010000:1.0:1786562768.678153:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562769.189311:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562769.189415:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562769.189527:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562769.189536:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654950400:0@lo:400:kworker.0 00000100:00100000:1.0:1786562769.189580:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562769.189711:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950528 00000100:00100000:1.0:1786562769.189720:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950528 00000100:00100000:1.0:1786562769.189796:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1786562769.189806:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654950528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562769.189863:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520814592 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562769.189916:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654950528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562769.189923:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1786562769.189954:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950400 00000100:00100000:1.0:1786562769.189958:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950400 00000100:00100000:1.0:1786562769.189993:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1786562769.190000:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654950400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562769.190055:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654950400:12345-0@lo:400:kworker.0 Request processed in 56us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562769.190062:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1786562769.190094:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562769.190126:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654950400:0@lo:400:kworker.0 00000100:00100000:1.0:1786562769.190146:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562769.190194:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562769.190223:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562769.190256:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950656 00000100:00100000:1.0:1786562769.190260:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950656 00000100:00100000:1.0:1786562769.190288:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1786562769.190295:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654950656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562769.190317:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562769.190352:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654950656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562769.190358:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00080000:1.0:1786562769.190371:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562769.190384:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876149 gen 2 00000004:00080000:1.0:1786562769.190391:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179500, transno 17179876149 00000100:00100000:1.0:1786562769.190408:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562769.190907:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654950784:0@lo:400:kworker.0 00000100:00100000:1.0:1786562769.190946:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562769.191068:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654950912:0@lo:400:kworker.0 00000100:00100000:3.0:1786562769.191102:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562769.191711:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950784 00000100:00100000:1.0:1786562769.191719:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950784 00000100:00100000:1.0:1786562769.191764:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654950912 00000100:00100000:1.0:1786562769.191767:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654950912 00000100:00100000:1.0:1786562769.191791:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1786562769.191800:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654950784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562769.192312:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654950784:12345-0@lo:400:kworker.0 Request processed in 511us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562769.192323:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1786562769.192348:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1786562769.192356:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654950912:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786562769.193224:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562769.193429:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654951040:0@lo:400:kworker.0 00000100:00100000:0.0:1786562769.193627:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654950784:0@lo:400:kworker.0 00000100:00100000:2.0:1786562769.193866:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562769.193928:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951040 00000100:00100000:2.0:1786562769.193935:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951040 00000100:00100000:2.0:1786562769.194408:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1786562769.194422:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654951040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562769.194509:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654951040:12345-0@lo:400:kworker.0 Request processed in 90us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562769.194518:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1786562769.194944:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654951040:0@lo:400:kworker.0 00000100:00100000:1.0:1786562769.197002:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654950912:12345-0@lo:400:kworker.0 Request processed in 3233us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562769.197033:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1786562769.197650:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654950912:0@lo:400:kworker.0 00010000:00010000:0.0:1786562769.712708:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562770.728203:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562771.749953:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562772.773646:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562773.307894:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562773.307943:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562773.307981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562773.308047:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562773.308076:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652989440 00000100:00100000:1.0:1786562773.308086:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652989440 00000100:00100000:1.0:1786562773.308141:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652989568 00000100:00100000:1.0:1786562773.308144:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652989568 00000100:00100000:1.0:1786562773.308170:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 569 00000100:00100000:1.0:1786562773.308180:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652989440:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562773.308250:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652989440:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562773.308258:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 569 00000100:00100000:1.0:1786562773.308277:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 570 00000100:00100000:1.0:1786562773.308284:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652989568:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562773.308308:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345652989568:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562773.308314:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 570 00000100:00100000:0.0:1786562773.308643:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652989312 00000100:00100000:0.0:1786562773.308648:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652989312 00000100:00100000:0.0:1786562773.308694:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 453 00000100:00100000:0.0:1786562773.308702:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652989312:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562773.308741:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345652989312:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562773.308747:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 453 00000100:00080000:0.0:1786562773.308765:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562773.308771:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562773.308784:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562773.308932:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652989184 00000100:00100000:2.0:1786562773.308937:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652989184 00000100:00100000:2.0:1786562773.308976:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 346 00000100:00100000:2.0:1786562773.308983:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652989184:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562773.309037:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345652989184:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 54us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562773.309044:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 346 00000100:00100000:1.0:1786562773.731887:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562773.732899:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652989824 00000100:00100000:2.0:1786562773.732917:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652989824 00000100:00100000:2.0:1786562773.733083:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17441 00000100:00100000:2.0:1786562773.733096:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:70748:x1873345652989824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562773.733125:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562773.733154:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1108 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd679 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733260:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733277:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733293:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733310:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733316:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733324:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733805:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733815:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733823:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733829:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562773.733834:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733842:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733858:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562773.733862:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562773.733867:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733874:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a110f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733890:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733897:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733904:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733909:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562773.733912:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733919:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733927:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562773.733930:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562773.733933:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733938:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1116 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733987:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1108 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd679 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.733999:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562773.734003:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562773.734078:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1108 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd679 expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.734090:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562773.734197:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:70748:x1873345652989824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1099us (2316us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562773.734213:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17441 00000100:00100000:3.0:1786562773.738634:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562773.738857:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652990080 00000100:00100000:2.0:1786562773.738871:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652990080 00000100:00100000:2.0:1786562773.738958:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17442 00000100:00100000:2.0:1786562773.738972:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:70748:x1873345652990080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562773.739043:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562773.739072:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a111d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd680 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562773.739415:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 7680 00010000:00010000:2.0:1786562773.739697:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a111d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd680 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.739715:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562773.739719:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562773.739725:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a111d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd680 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.739740:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562773.739829:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:70748:x1873345652990080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 860us (1209us total) trans 8589950856 rc 301/301 00000100:00100000:2.0:1786562773.739838:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17442 00000100:00100000:1.0:1786562773.754111:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562773.754249:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652990208 00000100:00100000:0.0:1786562773.754262:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652990208 00000100:00100000:0.0:1786562773.754340:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17443 00000100:00100000:0.0:1786562773.754354:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:70748:x1873345652990208:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562773.754463:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.754484:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.754497:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.754515:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.754522:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.754528:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.755681:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.755698:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.755895:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562773.756081:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:0.0:1786562773.756088:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562773.756106:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756123:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756131:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756138:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756144:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562773.756149:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756157:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756172:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562773.756176:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562773.756181:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756188:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a112b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756204:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756210:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756220:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756226:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562773.756228:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756234:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756240:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46aba00) 00010000:00010000:0.0:1786562773.756243:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562773.756245:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756251:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a1132 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756269:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756275:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756281:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756287:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562773.756289:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756299:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756306:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562773.756308:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562773.756312:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.756317:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1139 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562773.756439:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:70748:x1873345652990208:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2083us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562773.756451:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17443 00000100:00100000:1.0:1786562773.765204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562773.765565:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652990464 00000100:00100000:2.0:1786562773.765577:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652990464 00000100:00100000:2.0:1786562773.765645:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6351 00000100:00100000:2.0:1786562773.765657:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:70748:x1873345652990464:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562773.768228:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:70748:x1873345652990464:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 2560us (3026us total) trans 8589950857 rc 0/0 00000100:00100000:2.0:1786562773.768244:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6351 00010000:00010000:1.0:1786562773.798317:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562773.798995:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562773.801997:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652990720 00000100:00100000:2.0:1786562773.802040:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652990720 00000100:00100000:2.0:1786562773.802153:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17444 00000100:00100000:2.0:1786562773.802166:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:70752:x1873345652990720:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562773.802202:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562773.802232:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1140 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd687 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.802353:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.802373:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.802388:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.802406:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.802414:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.802419:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804285:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804302:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804313:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804319:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562773.804325:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804333:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804352:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562773.804355:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562773.804360:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804366:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1147 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804381:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804387:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804392:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804397:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562773.804400:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804406:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804414:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562773.804417:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562773.804419:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804426:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a114e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804487:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1140 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd687 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804500:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562773.804502:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562773.804506:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1140 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd687 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562773.804515:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562773.806347:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:70752:x1873345652990720:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3501us (6680us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562773.806364:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17444 00000100:00100000:1.0:1786562773.811787:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562773.815915:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652990976 00000100:00100000:0.0:1786562773.815939:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652990976 00000100:00100000:0.0:1786562773.816117:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17445 00000100:00100000:0.0:1786562773.816131:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70752:x1873345652990976:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562773.816160:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562773.816189:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd68e expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.816569:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a115c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.816587:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a115c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.816606:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a115c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562773.816620:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ec:0x0]: returning size 7680 00010000:00010000:0.0:1786562773.819221:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd68e expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.819259:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268200/0x5c655bf6668a115c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd68e expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.819270:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562773.819274:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786562773.819278:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268200, rc 0) 00000100:00100000:0.0:1786562773.819470:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:70752:x1873345652990976:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3340us (7697us total) trans 8589950858 rc 0/0 00000100:00100000:0.0:1786562773.819481:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17445 00000100:00100000:3.0:1786562773.824678:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562773.824762:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652991104 00000100:00100000:0.0:1786562773.824775:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652991104 00000100:00100000:0.0:1786562773.824861:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17446 00000100:00100000:0.0:1786562773.824873:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:70752:x1873345652991104:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562773.824977:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825000:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825035:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825052:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825061:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825067:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825471:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825481:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825489:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562773.825532:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:0.0:1786562773.825547:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562773.825564:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825581:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825588:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825594:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825605:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562773.825610:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825618:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825632:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562773.825635:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562773.825640:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825646:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a116a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825660:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825666:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825672:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825678:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562773.825680:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825685:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825694:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46aba00) 00010000:00010000:0.0:1786562773.825697:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562773.825699:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825705:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268c00/0x5c655bf6668a1171 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825723:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825730:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825736:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825741:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562773.825744:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825750:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825758:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562773.825760:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562773.825763:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562773.825769:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1178 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562773.830198:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:70752:x1873345652991104:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 5304us (5523us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562773.830219:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17446 00000100:00100000:1.0:1786562773.884430:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562773.884477:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652991360 00000100:00100000:1.0:1786562773.884487:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652991360 00000100:00100000:1.0:1786562773.884561:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17447 00000100:00100000:1.0:1786562773.884573:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:70760:x1873345652991360:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562773.884600:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562773.884625:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a117f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd695 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.884744:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.884761:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.884774:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.884792:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.884800:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.884818:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885292:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885301:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885309:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885315:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562773.885320:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885333:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885348:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562773.885352:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562773.885356:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885362:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1186 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885394:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885401:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885407:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885412:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562773.885415:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885420:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885426:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562773.885429:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562773.885431:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885438:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a118d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885492:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a117f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd695 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885503:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562773.885505:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562773.885508:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a117f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd695 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.885519:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1e00, rc 0) 00000100:00100000:1.0:1786562773.885613:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:70760:x1873345652991360:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1042us (1197us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562773.885623:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17447 00000100:00100000:1.0:1786562773.888426:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562773.889658:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652991488 00000100:00100000:3.0:1786562773.889685:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652991488 00000100:00100000:3.0:1786562773.889770:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17448 00000100:00100000:3.0:1786562773.889781:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:70760:x1873345652991488:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562773.889879:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.889901:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.889916:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.889934:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.889941:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.889947:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890374:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890385:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890393:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562773.890435:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:3.0:1786562773.890441:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562773.890454:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890469:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890481:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890489:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890496:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.890500:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890508:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890522:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562773.890525:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.890529:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890548:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1194 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890563:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890570:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890577:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890582:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.890586:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890592:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890599:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1a00) 00010000:00010000:3.0:1786562773.890601:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.890604:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890610:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a119b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890623:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890630:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890636:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890641:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.890644:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890649:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890655:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562773.890658:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.890661:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.890666:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562773.890772:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:70760:x1873345652991488:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 990us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562773.890781:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17448 00000100:00100000:0.0:1786562773.917795:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562773.918283:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652991744 00000100:00100000:3.0:1786562773.918298:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652991744 00000100:00100000:3.0:1786562773.918387:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17449 00000100:00100000:3.0:1786562773.918400:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:70763:x1873345652991744:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562773.918430:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562773.918458:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd69c expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.918576:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.918593:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.918607:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.918625:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.918633:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.918645:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919145:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919155:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919162:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919169:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.919174:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919182:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919198:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562773.919202:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.919208:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919215:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919229:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919236:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919244:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919249:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.919252:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919259:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919266:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1a00) 00010000:00010000:3.0:1786562773.919268:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.919271:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919278:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919321:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd69c expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919334:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562773.919336:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562773.919341:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd69c expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.919350:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562773.919443:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:70763:x1873345652991744:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1044us (1662us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562773.919456:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17449 00000100:00100000:3.0:1786562773.927217:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562773.927704:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652991872 00000100:00100000:1.0:1786562773.927718:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652991872 00000100:00100000:1.0:1786562773.927793:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17450 00000100:00100000:1.0:1786562773.927805:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:70763:x1873345652991872:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562773.927907:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.927930:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.927944:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.927963:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.927971:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.927977:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928455:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928465:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928473:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562773.928517:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:1.0:1786562773.928522:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562773.928551:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928567:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928575:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928582:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928593:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562773.928599:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928608:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928624:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:1.0:1786562773.928627:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562773.928633:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928640:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a11be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928673:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928680:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928687:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928692:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562773.928694:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928700:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928713:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562773.928717:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562773.928720:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928726:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a11c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928744:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928751:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928757:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928762:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562773.928766:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928772:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928778:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:1.0:1786562773.928781:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562773.928784:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562773.928789:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a11cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562773.928926:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:70763:x1873345652991872:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1120us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562773.928937:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17450 00000100:00100000:0.0:1786562773.965630:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562773.968841:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652992128 00000100:00100000:3.0:1786562773.968861:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652992128 00000100:00100000:3.0:1786562773.971915:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17451 00000100:00100000:3.0:1786562773.971944:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:70765:x1873345652992128:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562773.971979:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562773.972024:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6a3 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972133:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972150:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972164:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972181:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972189:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972196:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972643:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972653:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972661:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972669:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.972674:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972683:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972697:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562773.972701:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.972707:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972714:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a11da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972727:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972734:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972740:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972745:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.972749:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972755:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972763:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1a00) 00010000:00010000:3.0:1786562773.972767:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.972770:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972776:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a11e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972820:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11d3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6a3 expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972831:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562773.972834:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562773.972837:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a11d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6a3 expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.972847:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562773.972944:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:70765:x1873345652992128:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1012us (7325us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562773.972955:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17451 00000100:00100000:1.0:1786562773.981938:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562773.982255:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652992256 00000100:00100000:3.0:1786562773.982267:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652992256 00000100:00100000:3.0:1786562773.982338:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17452 00000100:00100000:3.0:1786562773.982351:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:70765:x1873345652992256:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562773.982445:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982466:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982479:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982495:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982503:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982509:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982965:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982977:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.982985:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562773.983063:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:3.0:1786562773.983068:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562773.983083:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983099:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983107:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983114:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983121:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.983125:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983132:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983146:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562773.983149:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.983155:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983161:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a11e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983176:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983182:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983188:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983193:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.983197:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983202:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983209:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1f00) 00010000:00010000:3.0:1786562773.983212:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.983214:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983219:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a11ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983236:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983242:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983249:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983253:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562773.983256:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983261:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983266:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562773.983268:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562773.983272:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562773.983278:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a11f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562773.983389:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:70765:x1873345652992256:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1038us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562773.983401:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17452 00000100:00100000:2.0:1786562774.009703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.009763:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652992384 00000100:00100000:2.0:1786562774.009776:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652992384 00000100:00100000:2.0:1786562774.009848:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17453 00000100:00100000:2.0:1786562774.009862:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:70768:x1873345652992384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.009889:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.009916:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a11fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6aa expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010031:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010048:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010060:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010077:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010085:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010091:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010504:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010515:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010523:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562774.010586:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:2.0:1786562774.010592:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562774.010618:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010633:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010643:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010650:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010657:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010665:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.010670:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010679:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010694:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.010698:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.010703:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010709:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1204 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010726:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010733:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010738:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010743:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.010746:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010752:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010759:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562774.010762:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.010765:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010771:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a120b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010811:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a11fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6aa expref: 25 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010826:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6aa expref: 24 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.010840:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562774.010842:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562774.010845:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc600, rc 0) 00000100:00100000:2.0:1786562774.010931:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:70768:x1873345652992384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1072us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.010941:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17453 00000100:00100000:1.0:1786562774.018949:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.019018:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652992512 00000100:00100000:1.0:1786562774.019031:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652992512 00000100:00100000:1.0:1786562774.019101:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17998 00000100:00100000:1.0:1786562774.019114:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652992512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562774.019139:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562774.019165:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6b1 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562774.019201:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x741:0x0] initial LVB size: 2097152, mtime: 0x6a7cc8c8, atime: 0x0, ctime: 0x6a7cc8c8, blocks: 0x1007 00010000:00010000:1.0:1786562774.019227:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=1206s v=(0 0) 00010000:00010000:1.0:1786562774.019233:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562774.019248:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.019270:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.019287:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0600, rc 0) 00000100:00100000:1.0:1786562774.019365:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652992512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 253us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562774.019378:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17998 00000100:00100000:0.0:1786562774.032023:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.033139:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652992768 00000100:00100000:2.0:1786562774.033155:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652992768 00000100:00100000:2.0:1786562774.033237:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17454 00000100:00100000:2.0:1786562774.033248:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:70768:x1873345652992768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.033277:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.033303:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1220 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6b8 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.033438:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1227 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.033455:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1227 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.033471:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1227 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562774.033483:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00010000:00010000:2.0:1786562774.033655:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1220 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b8 expref: 27 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.033682:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1227 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b8 expref: 26 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.033691:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562774.033695:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562774.033699:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562774.033793:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:70768:x1873345652992768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 546us (1798us total) trans 8589950859 rc 0/0 00000100:00100000:2.0:1786562774.033802:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17454 00000100:00100000:1.0:1786562774.039356:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.040271:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652992896 00000100:00100000:0.0:1786562774.040288:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652992896 00000100:00100000:0.0:1786562774.040372:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 996 00000100:00100000:0.0:1786562774.040383:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345652992896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562774.040407:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562774.040443:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1227 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b8 expref: 26 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.040462:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562774.040469:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562774.040555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652992896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 174us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.040564:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 996 00000100:00100000:0.0:1786562774.040652:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.040774:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652993152 00000100:00100000:0.0:1786562774.040779:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652993152 00000100:00100000:0.0:1786562774.040826:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17455 00000100:00100000:0.0:1786562774.040834:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+25:70768:x1873345652993152:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562774.040862:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562774.040882:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1235 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6bf expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.041043:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a123c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.041061:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a123c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.041073:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a123c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562774.041089:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00010000:00010000:0.0:1786562774.041255:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1235 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6bf expref: 28 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.041271:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a123c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6bf expref: 27 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.043522:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562774.043530:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786562774.043544:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269c00, rc 0) 00000100:00100000:0.0:1786562774.043680:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+27:70768:x1873345652993152:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2840us (3021us total) trans 8589950860 rc 0/0 00000100:00100000:0.0:1786562774.043692:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17455 00000100:00100000:3.0:1786562774.047769:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.047872:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652993280 00000100:00100000:3.0:1786562774.047885:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652993280 00000100:00100000:3.0:1786562774.047946:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17999 00000100:00100000:3.0:1786562774.047957:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2350:x1873345652993280:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562774.048047:0:28861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.048074:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.048085:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.048090:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.048095:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.048140:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.048162:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 9 pid: 6659 timeout: 1306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.048181:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654951168:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562774.048290:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf88d180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562774.050275:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28861:1873345654951168:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562774.050312:0:28861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.050882:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.051115:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652993408 00000100:00100000:3.0:1786562774.051124:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652993408 00010000:00010000:3.0:1786562774.051173:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 10 pid: 6659 timeout: 1306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.051224:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8795 00000100:00100000:3.0:1786562774.051235:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652993408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562774.051255:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562774.051286:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 10 pid: 6659 timeout: 1306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051302:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 10 pid: 6659 timeout: 1306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051340:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1219 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6b1 expref: 10 pid: 6659 timeout: 1306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051383:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.051388:0:35896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.051397:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051408:0:35896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051438:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562774.051495:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652993408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 262us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.051504:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8795 00010000:00010000:3.0:1786562774.051556:0:28861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051566:0:28861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051593:0:28861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051602:0:28861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051612:0:28861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051619:0:28861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562774.051624:0:28861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051634:0:28861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051645:0:28861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.051652:0:28861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a124a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.051705:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345652993280:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 3750us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.051713:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17999 00000100:00100000:3.0:1786562774.054114:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.054185:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652993664 00000100:00100000:3.0:1786562774.054197:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652993664 00000100:00100000:3.0:1786562774.054261:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17456 00000100:00100000:3.0:1786562774.054271:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+27:70768:x1873345652993664:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562774.054353:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786562774.054391:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc600/0x5c655bf6668a1212 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6aa expref: 27 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.054419:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a10f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd672 expref: 26 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.054431:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562774.054436:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562774.054478:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.054493:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.054504:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562774.055576:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4417, 88 off358384 00000004:00080000:3.0:1786562774.055590:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1206497584006ns, next at 1151432168614ns, rc = 0 00000040:00080000:3.0:1786562774.055631:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4418, 88 off358472 00000004:00080000:3.0:1786562774.055635:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1206497629516ns, next at 1151432168614ns, rc = 0 00000040:00080000:3.0:1786562774.055691:0:36756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4450, 88 off361344 00000004:00080000:3.0:1786562774.055697:0:36756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1206497690869ns, next at 1151434097826ns, rc = 0 00000001:00080000:0.0:1786562774.094657:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950860 is committed 00000001:00080000:0.0:1786562774.094693:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950861 is committed 00000004:00080000:0.0:1786562774.094771:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2953 committed 00000004:00080000:0.0:1786562774.094784:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2922 committed 00000004:00080000:0.0:1786562774.094997:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2921 committed 00000100:00100000:0.0:1786562774.095128:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654951296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562774.095228:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562774.095445:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951296 00000100:00100000:0.0:1786562774.095454:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951296 00000100:00100000:0.0:1786562774.095522:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18000 00000100:00100000:0.0:1786562774.095546:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654951296:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1786562774.095583:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097904d61 reply state 000000003e6f8fda transno 8589950861 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.095600:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786562774.095719:0:36756:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1786562774.095736:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70768:x1873345652993664:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 41465us (41634us total) trans 8589950861 rc 0/0 00000100:00100000:3.0:1786562774.095745:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17456 00000100:00100000:0.0:1786562774.096259:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654951296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 725us (1028us total) trans 17179876150 rc 0/0 00000100:00100000:0.0:1786562774.096268:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18000 00010000:00010000:1.0:1786562774.096292:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562774.096296:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786562774.096307:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.096316:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.096322:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562774.096328:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.096335:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.096356:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:1.0:1786562774.096364:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562774.096369:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.096376:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266800/0x5c655bf6668a1251 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562774.097944:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654951552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562774.098057:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786562774.098113:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e882962300/2, rc 0, transno 17179876150 00000100:00100000:3.0:1786562774.098122:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654951296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562774.098123:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951552 00000100:00100000:2.0:1786562774.098129:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951552 00000100:00100000:3.0:1786562774.098131:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562774.098136:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654951424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562774.098168:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.098187:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951424 00000100:00100000:2.0:1786562774.098190:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951424 00000100:00100000:2.0:1786562774.098215:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18001 00000100:00100000:3.0:1786562774.098223:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18002 00000100:00100000:2.0:1786562774.098224:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654951552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562774.098230:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654951424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562774.099403:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654951552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1176us (1342us total) trans 21474843670 rc 0/0 00000100:00100000:2.0:1786562774.099415:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18001 00000100:00080000:2.0:1786562774.099465:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562774.104246:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.105074:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652993792 00000100:00100000:1.0:1786562774.105088:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652993792 00000100:00100000:1.0:1786562774.105165:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17457 00000100:00100000:1.0:1786562774.105178:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+20:70768:x1873345652993792:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562774.105218:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562774.105246:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6c6 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.105326:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 21 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.105344:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 21 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.105368:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:1.0:1786562774.105373:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562774.105378:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1e00, rc 0) 00000100:00100000:1.0:1786562774.105617:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:70768:x1873345652993792:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 440us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562774.105625:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17457 00000004:00080000:0.0:1786562774.105867:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9887ec700/2, rc 0, transno 21474843670 00000100:00100000:0.0:1786562774.105878:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654951552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562774.106052:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654951424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7822us (7882us total) trans 21474843671 rc 0/0 00000100:00100000:1.0:1786562774.106061:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18002 00000004:00080000:0.0:1786562774.106074:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e883179500/2, rc 0, transno 21474843671 00000100:00100000:0.0:1786562774.106079:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654951424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562774.112310:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.112891:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652993920 00000100:00100000:3.0:1786562774.112905:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652993920 00000100:00100000:3.0:1786562774.112976:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17458 00000100:00100000:3.0:1786562774.112987:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:70768:x1873345652993920:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562774.113034:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562774.113061:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a125f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6cd expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.113172:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a1266 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.113191:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a1266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.113203:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a1266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562774.113239:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097153 00000004:00200000:3.0:1786562774.113244:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562774.113265:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a1266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.113296:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a125f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6cd expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.113313:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a1266 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6cd expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.113323:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562774.113327:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562774.113331:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267800, rc 0) 00000100:00100000:3.0:1786562774.113405:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:70768:x1873345652993920:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 420us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.113413:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17458 00000100:00100000:3.0:1786562774.116413:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.116591:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994048 00000100:00100000:1.0:1786562774.116605:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994048 00000100:00100000:1.0:1786562774.116745:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18003 00000100:00100000:1.0:1786562774.116758:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652994048:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562774.116782:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562774.116818:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6d4 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562774.116859:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x741:0x0] initial LVB size: 2097152, mtime: 0x6a7cc8c8, atime: 0x0, ctime: 0x6a7cc8c8, blocks: 0x1007 00010000:00010000:1.0:1786562774.116888:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=1206s v=(0 0) 00010000:00010000:1.0:1786562774.116894:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562774.116907:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 9 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.116928:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 9 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.116945:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:1.0:1786562774.117039:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652994048:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 284us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562774.117048:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18003 00000100:00100000:1.0:1786562774.202883:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.203054:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994176 00000100:00100000:0.0:1786562774.203071:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994176 00000100:00100000:0.0:1786562774.203150:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18004 00000100:00100000:0.0:1786562774.203162:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652994176:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:3.0:1786562774.271746:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843670 is committed 00000001:00080000:3.0:1786562774.271766:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843671 is committed 00000100:00100000:3.0:1786562774.296201:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345652994176:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 93031us (93316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.296217:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18004 00000100:00100000:3.0:1786562774.299769:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.299874:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994304 00000100:00100000:2.0:1786562774.299884:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994304 00000100:00100000:2.0:1786562774.299945:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18005 00000100:00100000:2.0:1786562774.299955:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652994304:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:2.0:1786562774.300103:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652994304:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 148us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.300111:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18005 00000100:00100000:2.0:1786562774.309641:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654951680:0@lo:400:kworker.0 00000100:00100000:2.0:1786562774.309733:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.309805:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562774.309813:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654952064:0@lo:400:kworker.0 00000100:00100000:2.0:1786562774.310177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.310346:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654952064 00000100:00100000:2.0:1786562774.310354:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654952064 00000100:00100000:2.0:1786562774.310401:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1786562774.310412:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654952064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562774.310473:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654952064:12345-0@lo:400:kworker.0 Request processed in 61us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.310481:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1786562774.310677:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654952064:0@lo:400:kworker.0 00000100:00100000:3.0:1786562774.310772:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951680 00000100:00100000:3.0:1786562774.310777:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951680 00000100:00100000:3.0:1786562774.310808:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1786562774.310816:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654951680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562774.310858:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654951680:12345-0@lo:400:kworker.0 Request processed in 43us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.310864:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1786562774.310959:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654951808:0@lo:400:kworker.0 00000100:00100000:2.0:1786562774.310965:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654951680:0@lo:400:kworker.0 00000100:00100000:0.0:1786562774.311139:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562774.311197:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951808 00000100:00100000:0.0:1786562774.311198:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562774.311209:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654951936:0@lo:400:kworker.0 00000100:00100000:0.0:1786562774.311237:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.311360:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654951936 00000100:00100000:2.0:1786562774.311367:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951936 00000100:00100000:2.0:1786562774.311410:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1786562774.311419:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654951936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562774.311476:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654951808 00000100:00100000:3.0:1786562774.311510:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1786562774.311518:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654951808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562774.311736:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562774.311749:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654952192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562774.315027:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654951936:12345-0@lo:400:kworker.0 Request processed in 3585us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.315043:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:2.0:1786562774.315136:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562774.317095:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654951808:12345-0@lo:400:kworker.0 Request processed in 5571us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.317110:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1786562774.319349:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562774.319381:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654952320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562774.319454:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.319637:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654951936:0@lo:400:kworker.0 00000100:00100000:2.0:1786562774.319656:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654951808:0@lo:400:kworker.0 00000100:00100000:3.0:1786562774.320727:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654952320 00000100:00100000:3.0:1786562774.320738:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654952320 00000100:00100000:3.0:1786562774.320797:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1786562774.320807:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654952320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562774.320847:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520814592 pending 0 free 3835691008 avail 3833593856 00000100:00100000:3.0:1786562774.320925:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654952320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562774.320932:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1786562774.321036:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843671 gen 2 00000004:00080000:2.0:1786562774.321043:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9887ec700, transno 21474843670 00000004:00080000:2.0:1786562774.321058:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e883179500, transno 21474843671 00000100:00100000:2.0:1786562774.321071:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654952320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562774.323601:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.323668:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994432 00000100:00100000:3.0:1786562774.323682:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994432 00000100:00100000:0.0:1786562774.323705:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.323761:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994560 00000100:00100000:3.0:1786562774.323766:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994560 00000100:00100000:3.0:1786562774.323799:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11665 00000100:00100000:3.0:1786562774.323808:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652994432:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562774.323845:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.323857:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11666 00000100:00100000:0.0:1786562774.323882:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652994560:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:3.0:1786562774.323883:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.323899:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.323907:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.323922:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.323932:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.323949:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562774.323954:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562774.323960:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.324082:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562774.326537:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562774.326758:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654952192 00000100:00100000:1.0:1786562774.326768:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654952192 00000100:00100000:1.0:1786562774.326845:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1786562774.326859:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654952192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562774.326915:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562774.326993:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654952192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562774.327051:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1786562774.327198:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654952192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562774.372236:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.372259:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.372269:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.372276:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562774.372280:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.372289:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.372381:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.372394:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218c2281/0x5c655bf6668a1274 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374712:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374733:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374743:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374750:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562774.374755:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374764:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374789:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.374797:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076346e48/0x5c655bf6668a127b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.375109:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345652994432:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 51295us (51513us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786562774.375121:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11665 00000100:00100000:0.0:1786562774.378918:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345652994560:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 55032us (55199us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786562774.378936:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11666 00000100:00100000:3.0:1786562774.402323:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.402591:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994688 00000100:00100000:1.0:1786562774.402602:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994688 00000100:00100000:1.0:1786562774.402679:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11667 00000100:00100000:1.0:1786562774.402690:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652994688:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:1.0:1786562774.402744:0:29463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562774.402754:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.402770:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=1206s v=(0 0) 00010000:00010000:1.0:1786562774.402775:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562774.402781:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.402795:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562774.407578:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.407745:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652994816 00000100:00100000:2.0:1786562774.407755:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652994816 00000100:00100000:2.0:1786562774.407823:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11668 00000100:00100000:2.0:1786562774.407840:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652994816:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:2.0:1786562774.407880:0:16007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.407899:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562774.407904:0:16007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562774.407911:0:16007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.407926:0:16007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562774.528453:0:16007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1786562774.528468:0:16007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb mtime from disk: 0 -> 1786562773 00002000:00010000:0.0:1786562774.528471:0:16007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb ctime from disk: 0 -> 1786562773 00002000:00010000:0.0:1786562774.528473:0:16007:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1786562774.528493:0:16007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.528510:0:16007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.528946:0:16007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.528986:0:16007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562774.528991:0:16007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.529068:0:16007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.529101:0:16007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.529110:0:16007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013ae3e8b/0x5c655bf6668a1289 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.529223:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cae43410-29f4-4da8-9608-d4626744ead5+15:2348:x1873345652994816:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 121381us (121654us total) trans 21474843673 rc 0/0 00000100:00100000:0.0:1786562774.529232:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11668 00010000:00010000:0.0:1786562774.533519:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.533549:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.533566:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.533574:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562774.533580:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.533588:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.533610:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.533617:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000575e6a31/0x5c655bf6668a1282 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.533792:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+13:2348:x1873345652994688:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 131099us (131479us total) trans 21474843672 rc 0/0 00000100:00100000:0.0:1786562774.533803:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11667 00000001:00080000:3.0:1786562774.538550:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843673 is committed 00000100:00100000:0.0:1786562774.568819:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.568934:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995072 00000100:00100000:3.0:1786562774.568945:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995072 00000100:00100000:0.0:1786562774.573544:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17459 00000100:00100000:0.0:1786562774.573564:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:70768:x1873345652995072:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562774.573624:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562774.573684:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267800/0x5c655bf6668a1266 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6cd expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.573705:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562774.573711:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562774.574136:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.574151:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.574159:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562774.574215:0:33115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950862 00000004:00010000:0.0:1786562774.574240:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008899fe67 reply state 00000000acaa6f2b transno 8589950863 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.574249:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562774.574351:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:70768:x1873345652995072:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 792us (5539us total) trans 8589950863 rc 0/0 00000100:00100000:0.0:1786562774.574359:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17459 00000020:00080000:0.0:1786562774.574364:0:33115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786562774.575760:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.575774:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.575781:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.575787:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562774.575792:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.575799:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.575812:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562774.575815:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562774.575818:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.575825:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1290 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.581043:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.581172:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995200 00000100:00100000:1.0:1786562774.581183:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995200 00000100:00100000:1.0:1786562774.581245:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18006 00000100:00100000:1.0:1786562774.581256:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+9:70768:x1873345652995200:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562774.581276:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562774.581299:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6db expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786562774.581334:0:37002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x742:0x0] initial LVB size: 2097152, mtime: 0x6a7cc8d5, atime: 0x0, ctime: 0x6a7cc8d5, blocks: 0x1007 00010000:00010000:1.0:1786562774.581355:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=1207s v=(0 0) 00010000:00010000:1.0:1786562774.581360:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562774.581370:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.581389:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 10 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.581402:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557e00, rc 0) 00000100:00100000:1.0:1786562774.581509:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+10:70768:x1873345652995200:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 253us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562774.581535:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18006 00000100:00100000:2.0:1786562774.589693:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.591057:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995328 00000100:00100000:0.0:1786562774.591068:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995328 00000100:00100000:0.0:1786562774.591139:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18007 00000100:00100000:0.0:1786562774.591150:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+7:70768:x1873345652995328:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562774.591168:0:29965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562774.591189:0:29965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6e2 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562774.591216:0:29965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562774.591238:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x726:0x0].0x0 since=1207s v=(0 0) 00010000:00010000:0.0:1786562774.591242:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562774.591253:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.591272:0:29965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 8 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.591292:0:29965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269200, rc 0) 00000100:00100000:0.0:1786562774.591360:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:70768:x1873345652995328:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 211us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.591368:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18007 00000100:00100000:1.0:1786562774.596156:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.596267:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.596787:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995456 00000100:00100000:0.0:1786562774.596797:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995456 00000100:00100000:2.0:1786562774.596890:0:29462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995584 00000100:00100000:2.0:1786562774.596895:0:29462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995584 00002000:00010000:0.0:1786562774.597045:0:13913:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1858 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562774.597051:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e7800 with x1873345652995456 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562774.597061:0:13913:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b46e7800. 00000100:00100000:0.0:1786562774.597089:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11669 00000100:00100000:0.0:1786562774.597100:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345652995456:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:2.0:1786562774.597444:0:29462:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1830 (0->18446744073709551615) 00002000:00100000:2.0:1786562774.597449:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e4000 with x1873345652995584 ext(0->18446744073709551615) 00002000:00010000:2.0:1786562774.597456:0:29462:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b46e4000. 00000100:00100000:2.0:1786562774.597549:0:29462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11670 00000100:00100000:2.0:1786562774.597558:0:29462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345652995584:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562774.599044:0:13913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562774.599052:0:13913:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb mtime from disk: 1786562773 -> 1786562773 00002000:00010000:0.0:1786562774.599055:0:13913:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562774.599057:0:13913:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb ctime from disk: 1786562773 -> 1786562773 00002000:00010000:0.0:1786562774.599060:0:13913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562774.599142:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345652995456:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 2040us (2991us total) trans 21474843674 rc 0/0 00000100:00100000:0.0:1786562774.599154:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11669 00002000:00010000:0.0:1786562774.599160:0:13913:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/1858 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562774.599163:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e7800 with x1873345652995456 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562774.599169:0:13913:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e9b46e7800. 00002000:00010000:2.0:1786562774.600274:0:29462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786562774.600281:0:29462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb mtime from disk: 0 -> 1786562773 00002000:00010000:2.0:1786562774.600283:0:29462:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562774.600285:0:29462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb ctime from disk: 0 -> 1786562773 00002000:00010000:2.0:1786562774.600286:0:29462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786562774.600347:0:29462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345652995584:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 2787us (4076us total) trans 17179876151 rc 0/0 00000100:00100000:2.0:1786562774.600357:0:29462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11670 00002000:00010000:2.0:1786562774.600361:0:29462:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1830 (0->18446744073709551615) 00002000:00100000:2.0:1786562774.600364:0:29462:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9b46e4000 with x1873345652995584 ext(0->18446744073709551615) 00002000:00010000:2.0:1786562774.600369:0:29462:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9b46e4000. 00000100:00100000:1.0:1786562774.608926:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.609279:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995840 00000100:00100000:2.0:1786562774.609289:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995840 00000100:00100000:2.0:1786562774.609356:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17460 00000100:00100000:2.0:1786562774.609367:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:70768:x1873345652995840:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562774.609491:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.609509:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.609535:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562774.609672:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000badecb09 reply state 0000000019964679 transno 8589950864 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562774.609681:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562774.609774:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:70768:x1873345652995840:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 408us (856us total) trans 8589950864 rc 0/0 00000100:00100000:2.0:1786562774.609782:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17460 00010000:00010000:2.0:1786562774.613506:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.613536:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.613543:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.613549:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.613553:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.613560:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.613578:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562774.613581:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.613584:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.613595:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12a5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562774.618994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.620051:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652995968 00000100:00100000:2.0:1786562774.620063:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652995968 00000100:00100000:2.0:1786562774.620143:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18008 00000100:00100000:2.0:1786562774.620155:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+11:70768:x1873345652995968:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.620174:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.620193:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6e9 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.620225:0:28862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.620235:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786562774.620239:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562774.620245:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->104857599] (req 0->104857599) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 12 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.620285:0:28862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 12 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.620300:0:28862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 12 pid: 29662 timeout: 1307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562774.620315:0:28862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654952448:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562774.620413:0:28862:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f612a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562774.626846:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.626923:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652996096 00000100:00100000:3.0:1786562774.626933:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652996096 00010000:00010000:3.0:1786562774.626977:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 13 pid: 29662 timeout: 1307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562774.626994:0:28862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28862:1873345654952448:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562774.627055:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8796 00010000:00010000:2.0:1786562774.627055:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->104857599] (req 0->104857599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 13 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.627069:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+13:2349:x1873345652996096:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562774.627079:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfda00, rc 0) 00010000:00010000:3.0:1786562774.627086:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562774.627111:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 13 pid: 29662 timeout: 1307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.627126:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 13 pid: 29662 timeout: 1307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562774.627136:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+13:70768:x1873345652995968:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6981us (8149us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.627146:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18008 00010000:00010000:3.0:1786562774.627154:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aba97145/0x5c655bf6668a126d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6d4 expref: 13 pid: 29662 timeout: 1307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.627181:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.627186:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562774.627194:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.627210:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.627245:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 11 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.627261:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654952576:192.168.204.29@tcp:105: 00000100:00100000:3.0:1786562774.627320:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f840 going to sleep for 11 seconds 00000100:00100000:1.0:1786562774.631361:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.631630:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652996224 00000100:00100000:0.0:1786562774.631642:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652996224 00000100:00100000:0.0:1786562774.631702:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18009 00000100:00100000:2.0:1786562774.631877:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873345654952576:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562774.631901:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562774.631960:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345652996096:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4893us (5123us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.631970:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8796 00000100:00100000:0.0:1786562774.632933:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+11:2350:x1873345652996224:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:0.0:1786562774.634472:0:29967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562774.634479:0:29967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb mtime from disk: 1786562760 -> 1786562760 00002000:00010000:0.0:1786562774.634482:0:29967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb atime from disk: 0 -> 1786562748 00002000:00010000:0.0:1786562774.634485:0:29967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb ctime from disk: 1786562760 -> 1786562773 00002000:00010000:0.0:1786562774.634487:0:29967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562774.634567:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+12:2350:x1873345652996224:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 2852us (3211us total) trans 21474843675 rc 0/0 00000100:00100000:0.0:1786562774.634579:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18009 00000100:00100000:1.0:1786562774.638871:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.639566:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652996480 00000100:00100000:2.0:1786562774.639580:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652996480 00000100:00100000:2.0:1786562774.640362:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6352 00000100:00100000:2.0:1786562774.640378:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:70768:x1873345652996480:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1786562774.640445:0:34647:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4ed:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a123c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6bf expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.640496:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.640510:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.640534:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.640573:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.640595:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 24 pid: 35929 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562774.640611:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654952704:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562774.641108:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baeb6240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562774.649170:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654952704:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562774.649214:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562774.649890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.649972:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652996608 00000100:00100000:0.0:1786562774.649980:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652996608 00010000:00010000:0.0:1786562774.650054:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 25 pid: 35929 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.650096:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8797 00000100:00100000:0.0:1786562774.650105:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345652996608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562774.650120:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562774.650127:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 25 pid: 35929 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.650138:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 25 pid: 35929 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.650162:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1258 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6c6 expref: 25 pid: 35929 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.650195:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562774.650201:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.650210:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.650218:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.650247:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562774.650290:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345652996608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 186us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.650299:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8797 00010000:00010000:3.0:1786562774.650463:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.650471:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562774.651206:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4419, 88 off358560 00000004:00080000:3.0:1786562774.651215:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1207093208455ns, next at 1151432168614ns, rc = 0 00000040:00080000:3.0:1786562774.651254:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4420, 88 off358648 00000004:00080000:3.0:1786562774.651258:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1207093252738ns, next at 1151432168614ns, rc = 0 00000040:00080000:3.0:1786562774.651305:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4451, 88 off361432 00000004:00080000:3.0:1786562774.651310:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1207093304078ns, next at 1151434097826ns, rc = 0 00000001:00080000:2.0:1786562774.709704:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950863 is committed 00000001:00080000:2.0:1786562774.709731:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950864 is committed 00000001:00080000:2.0:1786562774.709737:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950865 is committed 00000004:00080000:2.0:1786562774.709741:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2954 committed 00000004:00080000:2.0:1786562774.709757:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2924 committed 00000004:00080000:2.0:1786562774.709767:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2923 committed 00000100:00100000:2.0:1786562774.709865:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654952832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562774.709930:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.709977:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654952960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562774.710001:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562774.710058:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654952832 00000100:00100000:2.0:1786562774.710065:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654952832 00000100:00100000:2.0:1786562774.710105:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654952960 00000100:00100000:2.0:1786562774.710108:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654952960 00000100:00100000:2.0:1786562774.710132:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18010 00000100:00100000:2.0:1786562774.710141:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654952832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562774.710347:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562774.710351:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb mtime from disk: 1786562760 -> 1786562760 00002000:00010000:2.0:1786562774.710354:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb atime from disk: 1786562748 -> 1786562748 00002000:00010000:2.0:1786562774.710356:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb ctime from disk: 1786562773 -> 1786562773 00002000:00010000:2.0:1786562774.710358:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x741:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562774.710408:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3290:x1873345654952832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (476us total) trans 21474843676 rc 0/0 00000100:00100000:2.0:1786562774.710417:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18010 00000100:00100000:2.0:1786562774.710432:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18011 00000100:00100000:2.0:1786562774.710438:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654952960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1786562774.710518:0:29662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1786562774.710531:0:29662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb mtime from disk: 1786562773 -> 1786562773 00002000:00010000:2.0:1786562774.710534:0:29662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786562774.710536:0:29662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb ctime from disk: 1786562773 -> 1786562773 00002000:00010000:2.0:1786562774.710538:0:29662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x742:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1786562774.710569:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654952960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (566us total) trans 21474843677 rc 0/0 00000100:00100000:2.0:1786562774.710574:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18011 00000004:00080000:2.0:1786562774.710611:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b7ed180/2, rc 0, transno 21474843677 00000100:00100000:2.0:1786562774.710617:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654952960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1786562774.710758:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b7ef800/2, rc 0, transno 21474843676 00000100:00100000:1.0:1786562774.710764:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654952832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786562774.710938:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562774.710947:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654953088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562774.710977:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562774.711066:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953088 00000100:00100000:0.0:1786562774.711071:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953088 00000100:00100000:0.0:1786562774.711108:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18012 00000100:00100000:0.0:1786562774.711116:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654953088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562774.711231:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786562774.711234:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb mtime from disk: 1786562773 -> 1786562773 00002000:00010000:0.0:1786562774.711236:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562774.711239:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb ctime from disk: 1786562773 -> 1786562773 00002000:00010000:0.0:1786562774.711241:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x726:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786562774.711276:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654953088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (298us total) trans 17179876152 rc 0/0 00000100:00100000:0.0:1786562774.711283:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18012 00000004:00080000:0.0:1786562774.711311:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e889f55880/2, rc 0, transno 17179876152 00000100:00100000:0.0:1786562774.711317:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654953088:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1786562774.711391:0:34647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8de776c reply state 00000000b9a4beac transno 8589950865 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562774.711403:0:34647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786562774.711410:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562774.711414:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562774.711422:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269c00/0x5c655bf6668a123c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6bf expref: 20 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1786562774.711518:0:34647:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1786562774.711540:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:70768:x1873345652996480:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 71168us (72677us total) trans 8589950865 rc 0/0 00000100:00100000:3.0:1786562774.711549:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6352 00010000:00010000:3.0:1786562774.711578:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.711586:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.711593:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.711600:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562774.711604:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.711611:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.711625:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562774.711627:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562774.711631:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.711636:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a12b3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562774.715473:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.715914:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652996736 00000100:00100000:2.0:1786562774.715923:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652996736 00000100:00100000:2.0:1786562774.715983:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17461 00000100:00100000:2.0:1786562774.715993:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+19:70768:x1873345652996736:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.716052:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.716077:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a12ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6f0 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.716136:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a12ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6f0 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.716151:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a12ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6f0 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.716171:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:2.0:1786562774.716174:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562774.716178:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562774.716228:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:70768:x1873345652996736:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 238us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562774.716235:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17461 00000100:00100000:1.0:1786562774.719756:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.719891:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652996992 00000100:00100000:3.0:1786562774.719901:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652996992 00000100:00100000:3.0:1786562774.719953:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6353 00000100:00100000:3.0:1786562774.719963:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e999bb4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+20:70768:x1873345652996992:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562774.720279:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e999bb4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70768:x1873345652996992:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 317us (531us total) trans 8589950866 rc 0/0 00000100:00100000:3.0:1786562774.720287:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6353 00000100:00100000:0.0:1786562774.739353:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562774.739609:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652997248 00000100:00100000:3.0:1786562774.739618:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652997248 00000100:00100000:3.0:1786562774.739691:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17462 00000100:00100000:3.0:1786562774.739701:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:70769:x1873345652997248:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562774.739734:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562774.739755:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a12c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6f7 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.739841:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.739856:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.739867:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.739882:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.739890:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.739896:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740268:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740277:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740284:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740290:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562774.740294:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740301:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740313:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562774.740316:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562774.740333:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740339:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a12c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740351:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740357:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740362:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740367:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562774.740370:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740376:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740382:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1100) 00010000:00010000:3.0:1786562774.740384:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562774.740387:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740392:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a12cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740424:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a12c1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6f7 expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740433:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562774.740435:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562774.740438:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a12c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6f7 expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562774.740447:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562774.740515:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:70769:x1873345652997248:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 815us (1173us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562774.740535:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17462 00000100:00100000:1.0:1786562774.745485:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.745644:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652997376 00000100:00100000:0.0:1786562774.745654:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652997376 00000100:00100000:0.0:1786562774.745732:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17463 00000100:00100000:0.0:1786562774.745743:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:70769:x1873345652997376:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562774.745824:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.745842:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.745853:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.745869:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.745877:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.745884:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746360:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746370:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746377:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562774.746410:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:0.0:1786562774.746415:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562774.746427:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746440:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746446:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746582:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746589:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.746593:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746601:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746614:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562774.746617:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.746621:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746628:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a12d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746640:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746651:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746657:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746662:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.746831:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746840:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746848:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46ab500) 00010000:00010000:0.0:1786562774.746851:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.746854:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746859:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a12dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.746876:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.748082:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.748092:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.748097:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.748102:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.748109:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.748121:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:0.0:1786562774.748124:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.748128:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.748133:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a12e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.748325:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:70769:x1873345652997376:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2579us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.748336:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17463 00000100:00100000:1.0:1786562774.807186:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.807296:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652997632 00000100:00100000:2.0:1786562774.807306:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652997632 00000100:00100000:2.0:1786562774.807366:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17464 00000100:00100000:2.0:1786562774.807377:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:70774:x1873345652997632:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.807398:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.807418:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a12eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd6fe expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.807506:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.807533:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.807545:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.807562:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.807569:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.807576:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808192:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808201:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808208:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808214:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.808219:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808229:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808242:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.808245:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.808249:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808256:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a12f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808269:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808275:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808281:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808286:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.808289:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808295:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808304:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562774.808307:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.808310:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808317:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a12f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808351:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a12eb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6fe expref: 22 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808360:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.808362:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562774.808365:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a12eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6fe expref: 22 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.808375:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562774.808445:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+21:70774:x1873345652997632:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1070us (1268us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562774.808453:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17464 00000100:00100000:3.0:1786562774.813643:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562774.814233:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652997760 00000100:00100000:1.0:1786562774.814243:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652997760 00000100:00100000:1.0:1786562774.814303:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17465 00000100:00100000:1.0:1786562774.814313:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70774:x1873345652997760:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562774.814380:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.814397:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.814408:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.814422:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.814428:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562774.814435:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816205:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816223:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816234:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562774.816273:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:0.0:1786562774.816279:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562774.816293:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816305:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816312:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816319:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816325:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.816329:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816337:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816349:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562774.816352:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.816356:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816361:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1300 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816372:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816378:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816383:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816388:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.816391:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816398:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816405:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9bc2a2e00) 00010000:00010000:0.0:1786562774.816407:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.816410:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816415:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a1307 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816429:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816434:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816440:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816444:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.816447:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816526:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816535:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:0.0:1786562774.816537:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.816541:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.816546:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a130e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.816755:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70774:x1873345652997760:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2438us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.816766:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17465 00010000:00010000:0.0:1786562774.825652:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562774.882825:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.883371:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652998016 00000100:00100000:2.0:1786562774.883382:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652998016 00000100:00100000:2.0:1786562774.883454:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17466 00000100:00100000:2.0:1786562774.883465:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70780:x1873345652998016:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.883488:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.883528:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1315 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd705 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.883771:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.883786:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.883797:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.883813:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.883821:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.883828:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884191:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884200:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884206:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884212:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.884217:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884224:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884237:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.884241:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.884244:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884323:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a131c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884340:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884345:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884351:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884357:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.884360:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884395:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884404:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562774.884406:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.884410:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884416:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1323 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884455:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1315 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd705 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884471:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.884474:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562774.884477:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1315 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd705 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.884486:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562774.884718:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70780:x1873345652998016:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1253us (1900us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562774.884726:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17466 00000100:00100000:1.0:1786562774.893124:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.894479:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652998144 00000100:00100000:0.0:1786562774.894492:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652998144 00000100:00100000:0.0:1786562774.894568:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17467 00000100:00100000:0.0:1786562774.894578:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:70780:x1873345652998144:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562774.894657:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.894673:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.894684:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.894701:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.894708:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.894714:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895094:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895104:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895111:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562774.895147:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:0.0:1786562774.895152:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562774.895164:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895177:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895183:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895190:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895197:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.895201:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895209:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895220:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562774.895224:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.895229:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895236:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a132a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895248:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895255:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895261:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895266:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.895269:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895275:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895282:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46ab500) 00010000:00010000:0.0:1786562774.895284:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.895287:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895293:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a1331 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895309:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895316:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895328:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895334:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.895337:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895342:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895350:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:0.0:1786562774.895353:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.895356:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.895362:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1338 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.895436:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:70780:x1873345652998144:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 857us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.895444:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17467 00000100:00100000:3.0:1786562774.956211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562774.956422:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652998400 00000100:00100000:2.0:1786562774.956432:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652998400 00000100:00100000:2.0:1786562774.956501:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17468 00000100:00100000:2.0:1786562774.956512:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:70787:x1873345652998400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562774.956545:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562774.956567:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a133f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd70c expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.956641:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.956656:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.956667:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.956683:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.956691:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.956697:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957302:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957313:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957320:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957327:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.957332:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957339:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957351:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.957354:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.957358:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957364:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1346 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957376:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957384:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957389:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957393:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562774.957396:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957402:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957409:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562774.957412:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562774.957414:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957419:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a134d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957467:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a133f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd70c expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957478:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562774.957481:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562774.957484:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a133f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd70c expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562774.957499:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562774.957810:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:70787:x1873345652998400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1297us (1607us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562774.957818:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17468 00000100:00100000:1.0:1786562774.966327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562774.966428:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652998528 00000100:00100000:0.0:1786562774.966438:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652998528 00000100:00100000:0.0:1786562774.966524:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17469 00000100:00100000:0.0:1786562774.966535:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70787:x1873345652998528:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562774.966608:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.966625:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.966638:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.966653:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.966661:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.966667:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967359:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967371:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967378:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562774.967413:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:0.0:1786562774.967418:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562774.967430:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967443:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967453:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967476:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967481:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.967485:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967492:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967505:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:0.0:1786562774.967508:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.967511:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967527:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1354 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967539:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967545:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967550:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967555:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.967559:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967565:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967571:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b46ab500) 00010000:00010000:0.0:1786562774.967573:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.967576:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967581:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a135b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967594:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967599:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967605:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967609:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562774.967611:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967616:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967622:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:0.0:1786562774.967625:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562774.967628:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562774.967633:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269600/0x5c655bf6668a1362 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562774.967945:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70787:x1873345652998528:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1402us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562774.967956:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17469 00000100:00100000:1.0:1786562775.013342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562775.014119:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652998784 00000100:00100000:2.0:1786562775.014130:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652998784 00000100:00100000:2.0:1786562775.014211:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17470 00000100:00100000:2.0:1786562775.014222:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70795:x1873345652998784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562775.014242:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562775.014263:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1369 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd713 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014342:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014356:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014368:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014384:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014391:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014399:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014871:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014880:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014887:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014894:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.014898:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014906:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014919:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562775.014923:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.014928:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014934:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1370 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014947:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014954:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014959:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014965:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.014968:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014974:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014982:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562775.014984:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.014986:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.014992:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1377 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.015848:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1369 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd713 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.015862:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562775.015865:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562775.015868:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1369 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd713 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.015879:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562775.015980:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:70795:x1873345652998784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1759us (2647us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562775.015989:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17470 00000100:00080000:0.0:1786562775.016306:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562775.022909:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562775.022984:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652998912 00000100:00100000:2.0:1786562775.023044:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652998912 00000100:00100000:2.0:1786562775.023096:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17471 00000100:00100000:2.0:1786562775.023105:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:70795:x1873345652998912:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562775.023172:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023188:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023199:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023214:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023222:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023228:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023568:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023577:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023585:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562775.023617:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:2.0:1786562775.023621:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562775.023633:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023646:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023652:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023659:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023665:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.023669:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023676:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023688:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562775.023691:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.023696:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023702:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a137e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023713:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023719:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023729:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023919:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.023922:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023928:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023937:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562775.023940:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.023942:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023948:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1385 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023961:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023966:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023971:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023975:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.023978:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023987:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.023993:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:2.0:1786562775.023995:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.023998:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.024002:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a138c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562775.024197:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:70795:x1873345652998912:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1090us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562775.024207:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17471 00000100:00100000:1.0:1786562775.079266:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562775.079374:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999168 00000100:00100000:2.0:1786562775.079384:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999168 00000100:00100000:2.0:1786562775.079466:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17472 00000100:00100000:2.0:1786562775.079476:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:70798:x1873345652999168:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562775.079497:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562775.079526:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1393 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd71a expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.079604:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.079618:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.079629:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.079645:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.079652:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.079659:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080200:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080208:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080214:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080221:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.080225:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080233:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080245:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562775.080250:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.080254:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080260:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a139a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080273:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080280:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080286:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080292:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562775.080294:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080299:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080307:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e9b6332600) 00010000:00010000:2.0:1786562775.080309:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562775.080312:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080318:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a13a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080357:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1393 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd71a expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080367:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562775.080370:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562775.080374:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1393 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd71a expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562775.080384:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562775.080466:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:70798:x1873345652999168:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 992us (1209us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562775.080474:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17472 00000100:00100000:1.0:1786562775.084241:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562775.088618:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999296 00000100:00100000:3.0:1786562775.088635:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999296 00000100:00100000:3.0:1786562775.088720:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17473 00000100:00100000:3.0:1786562775.088732:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70798:x1873345652999296:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562775.089223:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.089240:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.089252:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.089268:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.089275:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.089282:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.090724:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.090752:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.090762:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562775.090939:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:3.0:1786562775.090944:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562775.090958:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.090973:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.090980:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.090987:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091179:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562775.091186:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091196:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091210:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562775.091213:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562775.091217:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091224:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091240:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091251:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091257:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091262:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562775.091265:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091271:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091278:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1100) 00010000:00010000:3.0:1786562775.091281:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562775.091284:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091289:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091305:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091311:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091317:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091322:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562775.091325:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091331:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091337:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:3.0:1786562775.091340:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562775.091343:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562775.091349:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562775.092664:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:70798:x1873345652999296:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3926us (8424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562775.092678:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17473 00010000:00010000:1.0:1786562775.845524:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562776.507217:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876152 is committed 00000001:00080000:2.0:1786562776.507234:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876151 is committed 00010000:00010000:1.0:1786562776.872451:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562777.894029:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562778.434087:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562778.434303:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999424 00000100:00100000:0.0:1786562778.434316:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999424 00000100:00100000:0.0:1786562778.437078:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 348 00000100:00100000:0.0:1786562778.437104:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652999424:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562778.437192:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345652999424:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562778.437201:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 348 00000100:00100000:3.0:1786562778.443798:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562778.443859:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562778.443891:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562778.443928:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999680 00000100:00100000:3.0:1786562778.443941:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999680 00000100:00100000:3.0:1786562778.444051:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999808 00000100:00100000:3.0:1786562778.444055:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999808 00000100:00100000:3.0:1786562778.444531:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 571 00000100:00100000:3.0:1786562778.444550:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652999680:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562778.445771:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 572 00000100:00100000:0.0:1786562778.446083:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999552 00000100:00100000:0.0:1786562778.446093:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999552 00000100:00100000:0.0:1786562778.446223:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 457 00000100:00100000:0.0:1786562778.446236:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:2351:x1873345652999552:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562778.446760:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:2351:x1873345652999552:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 527us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562778.446770:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 457 00000100:00080000:0.0:1786562778.446797:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562778.446802:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562778.446805:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562778.446955:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652999808:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562778.447033:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345652999808:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1248us (3140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562778.447041:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 572 00000100:00100000:3.0:1786562778.450929:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345652999680:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 5495us (6178us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562778.450947:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 571 00010000:00010000:1.0:1786562778.917698:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562779.429279:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654953216:0@lo:400:kworker.0 00000100:00100000:2.0:1786562779.429287:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654953472:0@lo:400:kworker.0 00000100:00100000:0.0:1786562779.429367:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654953344:0@lo:400:kworker.0 00000100:00100000:1.0:1786562779.429503:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654953600:0@lo:400:kworker.0 00000100:00100000:3.0:1786562779.437386:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562779.437386:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562779.437473:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654953728:0@lo:400:kworker.0 00000100:00100000:2.0:1786562779.437473:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654953984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562779.437508:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562779.437508:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562779.437548:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953216 00000100:00100000:3.0:1786562779.437555:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953472 00000100:00100000:2.0:1786562779.437555:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953216 00000100:00100000:3.0:1786562779.437558:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953472 00000100:00100000:2.0:1786562779.437609:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1786562779.437618:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654953216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562779.437675:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654953216:12345-0@lo:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562779.437694:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1786562779.437703:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1786562779.437710:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562779.437736:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953984 00000100:00100000:2.0:1786562779.437739:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953984 00000100:00100000:3.0:1786562779.437750:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654953472:12345-0@lo:400:kworker.0 Request processed in 41us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562779.437757:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1786562779.437764:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1786562779.437770:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654953984:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562779.437800:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654953216:0@lo:400:kworker.0 00002000:00000024:2.0:1786562779.437800:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3833593856 avail 3831496704 00000100:00100000:2.0:1786562779.437830:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654953984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562779.437837:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1786562779.437850:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654953984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562779.437861:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654953472:0@lo:400:kworker.0 00000100:00100000:2.0:1786562779.437864:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953728 00000100:00100000:2.0:1786562779.437867:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953728 00000100:00100000:2.0:1786562779.437890:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1786562779.437898:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654953728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562779.437933:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654953728:12345-0@lo:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562779.437939:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1786562779.437966:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876152 gen 2 00000004:00080000:2.0:1786562779.437970:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e882962300, transno 17179876150 00000004:00080000:2.0:1786562779.437980:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e889f55880, transno 17179876152 00000100:00100000:2.0:1786562779.437985:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654953728:0@lo:400:kworker.0 00000100:00080000:2.0:1786562779.438440:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562779.438444:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562779.438447:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562779.438848:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562779.438878:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654953856:0@lo:400:kworker.0 00000100:00100000:0.0:1786562779.438905:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562779.438946:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953344 00000100:00100000:0.0:1786562779.438950:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953344 00000100:00100000:0.0:1786562779.438985:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953856 00000100:00100000:0.0:1786562779.438989:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953856 00000100:00100000:0.0:1786562779.439022:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1786562779.439030:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654953344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562779.439071:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654953344:12345-0@lo:400:kworker.0 Request processed in 41us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562779.439078:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1786562779.439091:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1786562779.439097:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654953856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562779.439125:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654953856:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562779.439131:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00080000:0.0:1786562779.439150:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562779.439168:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654953344:0@lo:400:kworker.0 00000100:00100000:0.0:1786562779.439178:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654953856:0@lo:400:kworker.0 00000100:00100000:1.0:1786562779.439288:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562779.439310:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654954112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562779.439334:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562779.439364:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954112 00000100:00100000:1.0:1786562779.439367:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954112 00000100:00100000:1.0:1786562779.439394:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1786562779.439400:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654954112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562779.439438:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562779.439476:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654954112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562779.439483:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1786562779.439517:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654954112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562779.439818:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654953600 00000100:00100000:0.0:1786562779.439823:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654953600 00000100:00100000:0.0:1786562779.439897:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1786562779.439906:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562779.439955:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345654953600:12345-0@lo:400:kworker.0 Request processed in 50us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562779.439962:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1786562779.440035:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654953600:0@lo:400:kworker.0 00010000:00010000:0.0:1786562779.941209:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786562780.013155:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950866 is committed 00000001:00080000:3.0:1786562780.037876:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843675 is committed 00000001:00080000:3.0:1786562780.037897:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843677 is committed 00000100:00100000:1.0:1786562780.887548:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562780.888867:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345652999936 00000100:00100000:3.0:1786562780.888880:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345652999936 00000100:00100000:3.0:1786562780.888955:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17474 00000100:00100000:3.0:1786562780.888966:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:71217:x1873345652999936:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:3.0:1786562780.888985:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562780.889020:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13bd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd721 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889084:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889099:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889111:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889165:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889174:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889181:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889806:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889817:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889837:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562780.889877:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ed:0x0]: returning size 2097152 00000004:00200000:3.0:1786562780.889881:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562780.889901:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889913:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889925:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889930:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889936:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889943:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562780.889947:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889953:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889965:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:3.0:1786562780.889968:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562780.889972:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889977:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889987:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889993:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.889998:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890018:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562780.890022:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890028:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890035:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1500) 00010000:00010000:3.0:1786562780.890037:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562780.890040:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890045:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890077:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13bd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd721 expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890090:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd721 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.890097:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:3.0:1786562780.890099:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562780.890101:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267a00, rc 0) 00000100:00100000:3.0:1786562780.890163:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:71217:x1873345652999936:12345-192.168.204.29@tcp:101:rm.0 Request processed in 1198us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562780.890171:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17474 00000100:00080000:1.0:1786562780.890681:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562780.909335:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562780.909412:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000192 00000100:00100000:3.0:1786562780.909425:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000192 00000100:00100000:3.0:1786562780.909497:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17475 00000100:00100000:3.0:1786562780.909509:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:71217:x1873345653000192:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:3.0:1786562780.909589:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786562780.913882:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267a00/0x5c655bf6668a13d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd721 expref: 21 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.913927:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a12ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6f0 expref: 20 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.913942:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e9b6332800) 00010000:00010000:3.0:1786562780.913962:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562780.913998:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.914035:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.914048:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.914070:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.914080:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.914088:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.916903:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.916932:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.916947:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786562780.919432:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4421, 64 off358712 00000004:00080000:3.0:1786562780.919451:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1213361444912ns, next at 1214361441026ns, rc = 0 00000040:00080000:3.0:1786562780.919474:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4422, 64 off358776 00000040:00080000:3.0:1786562780.919529:0:33114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4452, 64 off361496 00000004:00080000:3.0:1786562780.919537:0:33114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1213361530942ns, next at 1214361528772ns, rc = 0 00010000:00010000:3.0:1786562780.920069:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.920093:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.920107:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.920118:0:33114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.920125:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.920132:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562780.920227:0:33114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562780.920315:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920331:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920337:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920344:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562780.920348:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920359:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920376:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e999bb1a00) 00010000:00010000:2.0:1786562780.920379:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786562780.920384:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920390:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a13e7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920797:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920805:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920812:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920817:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562780.920820:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920826:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920835:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x0 (ffff90e9b46ab900) 00010000:00010000:2.0:1786562780.920838:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562780.920841:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562780.920851:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a13d9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ec:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562780.920864:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065ecc9da reply state 000000003ef07b24 transno 8589950867 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562780.920872:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562780.920982:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+21:71217:x1873345653000192:12345-192.168.204.29@tcp:36:rm.0 Request processed in 11472us (11660us total) trans 8589950867 rc 0/0 00000100:00100000:2.0:1786562780.920992:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17475 00010000:00010000:1.0:1786562780.924143:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562780.924163:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924177:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562780.924183:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924195:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924219:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ed:0x0].0x0 (ffff90e999bb1a00) 00010000:00010000:1.0:1786562780.924223:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786562780.924229:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924237:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a13ee lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924267:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562780.924269:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562780.924271:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562780.924889:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924902:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924908:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924920:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562780.924925:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924932:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924944:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ec:0x0].0x526f614a (ffff90e999bb1500) 00010000:00010000:1.0:1786562780.924948:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562780.924952:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.924958:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a13e0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ec:0x0].0x526f614a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562780.965235:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562781.994343:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786562782.625823:0:41060:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 204f: FLR write/stale/resync sel w/forced extension ========================================================== 15:26:20 (1786562780) 00010000:00010000:1.0:1786562783.014864:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562783.543141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562783.543178:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562783.543204:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562783.543225:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562783.543253:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000448 00000100:00100000:3.0:1786562783.543263:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000448 00000100:00100000:3.0:1786562783.543321:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 461 00000100:00100000:3.0:1786562783.543331:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345653000448:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562783.543421:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345653000448:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562783.543429:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 461 00000100:00100000:3.0:1786562783.543454:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000704 00000100:00100000:3.0:1786562783.543458:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000704 00000100:00100000:3.0:1786562783.543481:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000576 00000100:00100000:3.0:1786562783.543483:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000576 00000100:00100000:3.0:1786562783.543503:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 575 00000100:00100000:3.0:1786562783.543509:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653000704:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562783.543538:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653000704:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562783.543552:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 575 00000100:00100000:3.0:1786562783.543564:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 576 00000100:00100000:3.0:1786562783.543570:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653000576:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562783.543595:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653000576:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562783.543603:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 576 00000100:00080000:3.0:1786562783.543622:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562783.543625:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562783.543628:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562783.543771:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000320 00000100:00100000:0.0:1786562783.543776:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000320 00000100:00100000:0.0:1786562783.543814:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 350 00000100:00100000:0.0:1786562783.543821:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653000320:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562783.543852:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653000320:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 32us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562783.543859:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 350 00010000:00010000:0.0:1786562784.037295:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786562784.551922:0:33136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1216993914258ns, next at 1217993912197ns, rc = 0 00000100:00100000:2.0:1786562784.551964:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654954240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562784.552049:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562784.552113:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954240 00000100:00100000:2.0:1786562784.552119:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954240 00000100:00100000:2.0:1786562784.552165:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1786562784.552173:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654954240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562784.552208:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3833593856 avail 3831496704 00000100:00100000:2.0:1786562784.552249:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654954240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562784.552257:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00080000:2.0:1786562784.552278:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562784.552301:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843677 gen 2 00000004:00080000:2.0:1786562784.552305:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b7ef800, transno 21474843676 00000004:00080000:2.0:1786562784.552312:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b7ed180, transno 21474843677 00000100:00100000:2.0:1786562784.552334:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654954240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562784.552755:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654954496:0@lo:400:kworker.0 00000100:00100000:3.0:1786562784.552787:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562784.552812:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562784.552817:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654954624:0@lo:400:kworker.0 00000100:00100000:3.0:1786562784.552835:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562784.552999:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654954368:0@lo:400:kworker.0 00000100:00100000:3.0:1786562784.553055:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654954752:0@lo:400:kworker.0 00000100:00100000:3.0:1786562784.553082:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562784.553109:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954752 00000100:00100000:3.0:1786562784.553113:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954752 00000100:00100000:3.0:1786562784.553145:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1786562784.553151:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654954752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562784.553188:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654954752:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562784.553195:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1786562784.553221:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654954752:0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556085:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562784.556131:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654954880:0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556156:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562784.556196:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954496 00000100:00100000:2.0:1786562784.556203:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954496 00000100:00100000:2.0:1786562784.556243:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954624 00000100:00100000:2.0:1786562784.556246:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954624 00000100:00100000:2.0:1786562784.556261:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954880 00000100:00100000:2.0:1786562784.556263:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954880 00000100:00100000:2.0:1786562784.556279:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1786562784.556288:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654954496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556347:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654954496:12345-0@lo:400:kworker.0 Request processed in 60us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562784.556354:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1786562784.556370:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1786562784.556375:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654954624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556399:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654954624:12345-0@lo:400:kworker.0 Request processed in 25us (3563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562784.556404:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1786562784.556415:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1786562784.556420:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654954880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556443:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654954880:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562784.556448:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00080000:2.0:1786562784.556461:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786562784.556465:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562784.556474:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654954368 00000100:00100000:2.0:1786562784.556476:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654954368 00000100:00100000:2.0:1786562784.556497:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1786562784.556502:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654954368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556528:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654954368:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562784.556534:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1786562784.556582:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654954624:0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.556764:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654954496:0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.557066:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654954368:0@lo:400:kworker.0 00000100:00100000:2.0:1786562784.557077:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654954880:0@lo:400:kworker.0 00000004:00080000:2.0:1786562784.559037:0:33139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1217001028802ns, next at 1218001025865ns, rc = 0 00000100:00100000:2.0:1786562784.559056:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562784.559074:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654955008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562784.559132:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562784.559172:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654955008 00000100:00100000:2.0:1786562784.559179:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654955008 00000100:00100000:2.0:1786562784.559219:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1786562784.559228:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654955008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562784.559263:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562784.559305:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654955008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562784.559312:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1786562784.559378:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654955008:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1786562784.776776:0:41157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1217218768288ns, next at 1217993912197ns, rc = 0 00000004:00080000:3.0:1786562784.802466:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2927 committed 00000004:00080000:3.0:1786562784.802494:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2956 committed 00000004:00080000:3.0:1786562784.802510:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2926 committed 00000001:00080000:3.0:1786562784.802528:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950867 is committed 00000004:00080000:3.0:1786562784.802533:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2955 committed 00000004:00080000:3.0:1786562784.802535:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2925 committed 00000100:00100000:1.0:1786562784.802764:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562784.802787:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654955136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562784.802858:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562784.802923:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654955264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562784.802944:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562784.802976:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654955136 00000100:00100000:1.0:1786562784.802983:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654955136 00000100:00100000:1.0:1786562784.803057:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654955264 00000100:00100000:1.0:1786562784.803061:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654955264 00000100:00100000:1.0:1786562784.803082:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18013 00000100:00100000:1.0:1786562784.803090:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654955136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562784.803117:0:37002:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1857 count 1 00010000:00010000:1.0:1786562784.803146:0:37002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803170:0:37002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803258:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x741:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1786562784.803263:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562784.803268:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803299:0:37002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803312:0:37002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562784.803337:0:37002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654955392:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562784.803395:0:37002:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786562784.803412:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18014 00000100:00100000:1.0:1786562784.803420:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654955264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786562784.803437:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1858 count 1 00010000:00010000:1.0:1786562784.803449:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803467:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 9 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803474:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x742:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1786562784.803477:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562784.803481:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803501:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 9 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.803511:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 9 pid: 37002 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562784.803537:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654955520:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562784.803561:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562784.804819:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654955648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562784.804870:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562784.804974:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654955648 00000100:00100000:0.0:1786562784.804981:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654955648 00000100:00100000:0.0:1786562784.805051:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18015 00000100:00100000:0.0:1786562784.805060:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654955648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786562784.805081:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1830 count 1 00010000:00010000:0.0:1786562784.805102:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.805122:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 7 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.805130:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x726:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1786562784.805134:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x726:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562784.805138:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.805168:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 7 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.805190:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 7 pid: 29965 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562784.805202:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e886c1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654955776:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562784.805252:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd46b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562784.806651:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b42f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654955520:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562784.806681:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562784.806791:0:37002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:37002:1873345654955392:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562784.806805:0:37002:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562784.808432:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e886c1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6660:1873345654955776:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562784.808456:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562784.813416:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562784.813470:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000960 00000100:00100000:3.0:1786562784.813481:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000960 00010000:00010000:3.0:1786562784.813529:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 10 pid: 37002 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562784.813565:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8798 00000100:00100000:3.0:1786562784.813575:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+10:2351:x1873345653000960:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562784.813588:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562784.813593:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 10 pid: 37002 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813607:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 10 pid: 37002 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813631:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf839e8/0x5c655bf6668a1297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6db expref: 10 pid: 37002 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813648:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562784.813653:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x742:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562784.813659:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813668:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813700:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562784.813804:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562784.813812:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345653000960:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 238us (408us total) trans 0 rc 0/0 00010000:00010000:2.0:1786562784.813814:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562784.813824:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8798 00010000:00010000:2.0:1786562784.813825:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.813832:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.813851:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786562784.813862:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562784.813868:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813875:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562784.813878:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813886:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813897:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813903:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b090e0/0x5c655bf6668a13fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.813919:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562784.813921:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562784.813922:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786562784.814878:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bbfa2300/2, rc 0, transno 21474843678 00000100:00100000:3.0:1786562784.814893:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654955264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562784.815787:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562784.815840:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562784.815864:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653000832 00000100:00100000:3.0:1786562784.815871:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653000832 00010000:00010000:3.0:1786562784.815906:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562784.815943:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001088 00000100:00100000:3.0:1786562784.815946:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001088 00010000:00010000:3.0:1786562784.815962:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 8 pid: 29965 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562784.815984:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8799 00000100:00100000:3.0:1786562784.815992:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653000832:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562784.816033:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562784.816039:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.816051:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.816073:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030480dc9/0x5c655bf6668a12ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e9 expref: 9 pid: 28862 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562784.816082:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8800 00010000:00010000:3.0:1786562784.816089:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1786562784.816091:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653001088:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562784.816093:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x741:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562784.816099:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.816100:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562784.816105:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 8 pid: 29965 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.816109:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.816115:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 8 pid: 29965 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.816131:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca2a7e50/0x5c655bf6668a129e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 67108864->134217727) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd6e2 expref: 8 pid: 29965 timeout: 1317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562784.816141:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562784.816142:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x726:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562784.816144:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x726:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786562784.816149:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.816156:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.816171:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562784.816174:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b42f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653000832:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 183us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562784.816188:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653001088:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 99us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562784.816195:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8800 00010000:00010000:1.0:1786562784.816222:0:37002:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562784.816303:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8799 00000100:00100000:2.0:1786562784.816628:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3289:x1873345654955264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13207us (13680us total) trans 21474843678 rc 0/0 00000100:00100000:2.0:1786562784.816639:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18014 00010000:00010000:1.0:1786562784.817086:0:37002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.817102:0:37002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.817110:0:37002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562784.817127:0:37002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786562784.817157:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.817166:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.817174:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.817442:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562784.817448:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.817462:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557c00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562784.817466:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.817476:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.817494:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.817502:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c2e4a97/0x5c655bf6668a13f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.818371:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562784.818375:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562784.818377:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562784.818429:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562784.818461:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562784.818865:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562784.818872:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.818880:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562784.818884:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.818893:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.818910:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.818917:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f71bff1e/0x5c655bf6668a1403 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562784.818934:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562784.818936:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562784.818938:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562784.819364:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3291:x1873345654955136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16263us (16494us total) trans 21474843679 rc 0/0 00000100:00100000:1.0:1786562784.819374:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18013 00000004:00080000:2.0:1786562784.819577:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bbfa2a00/2, rc 0, transno 21474843679 00000100:00100000:2.0:1786562784.819870:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654955136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786562784.820467:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654955648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15406us (15595us total) trans 17179876153 rc 0/0 00000100:00100000:0.0:1786562784.820477:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18015 00000004:00080000:1.0:1786562784.820507:0:41157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1217262500025ns, next at 1218001025865ns, rc = 0 00000004:00080000:2.0:1786562784.821948:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e88b7ed180/2, rc 0, transno 17179876153 00000100:00100000:2.0:1786562784.822037:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654955648:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786562784.837709:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2957 committed 00010000:00010000:1.0:1786562785.069796:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562785.097325:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843679 is committed 00010000:00010000:0.0:1786562786.086362:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562786.660158:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876153 is committed 00010000:00010000:3.0:1786562787.109311:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562788.136606:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562788.667249:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562788.667299:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562788.667411:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001216 00000100:00100000:3.0:1786562788.667420:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001216 00000100:00100000:3.0:1786562788.667495:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 352 00000100:00100000:3.0:1786562788.667504:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653001216:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562788.667578:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653001216:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562788.667585:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 352 00000100:00100000:1.0:1786562788.668579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562788.668607:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562788.668669:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001344 00000100:00100000:3.0:1786562788.668676:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001344 00000100:00100000:3.0:1786562788.668748:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 465 00000100:00100000:3.0:1786562788.668758:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345653001344:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562788.668833:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345653001344:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562788.668841:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 465 00000100:00080000:0.0:1786562788.669373:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562788.681995:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001472 00000100:00100000:2.0:1786562788.682027:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001472 00000100:00100000:2.0:1786562788.682199:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001600 00000100:00100000:2.0:1786562788.682204:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001600 00000100:00080000:1.0:1786562788.682266:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562788.682272:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562788.682589:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 578 00000100:00100000:0.0:1786562788.682603:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653001472:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562788.682703:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653001472:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 104us (15402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562788.682711:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 578 00000100:00100000:0.0:1786562788.682744:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 579 00000100:00100000:0.0:1786562788.682751:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653001600:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562788.682779:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653001600:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (14171us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562788.682785:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 579 00010000:00010000:2.0:1786562789.159050:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562789.669338:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562789.669363:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654955904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562789.669436:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562789.669602:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654955904 00000100:00100000:2.0:1786562789.669611:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654955904 00000100:00100000:2.0:1786562789.669672:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1786562789.669683:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654955904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562789.669718:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562789.669769:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654955904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562789.669780:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00080000:0.0:1786562789.669853:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562789.669885:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876153 gen 2 00000004:00080000:0.0:1786562789.669890:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e88b7ed180, transno 17179876153 00000100:00100000:0.0:1786562789.670103:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654955904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562789.673469:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654956416:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.673544:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562789.673605:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786562789.673613:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654956032:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.673645:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562789.673669:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654956544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562789.673693:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562789.673724:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956416 00000100:00100000:1.0:1786562789.673731:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956416 00000100:00100000:1.0:1786562789.673787:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1786562789.673797:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654956416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.673849:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654956416:12345-0@lo:400:kworker.0 Request processed in 53us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562789.673856:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1786562789.673883:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956032 00000100:00100000:1.0:1786562789.673886:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956032 00000100:00100000:1.0:1786562789.673910:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1786562789.673916:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654956032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.673943:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654956032:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562789.673948:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1786562789.673976:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956544 00000100:00100000:1.0:1786562789.673980:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956544 00000100:00100000:1.0:1786562789.674028:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1786562789.674036:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654956544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562789.674064:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:1.0:1786562789.674096:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654956544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562789.674102:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1786562789.674158:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654956032:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.674170:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843679 gen 2 00000004:00080000:1.0:1786562789.674175:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bbfa2300, transno 21474843678 00000004:00080000:1.0:1786562789.674184:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bbfa2a00, transno 21474843679 00000100:00100000:1.0:1786562789.674195:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654956544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562789.674204:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654956416:0@lo:400:kworker.0 00000100:00080000:1.0:1786562789.674674:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562789.674699:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654956288:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.674733:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562789.674759:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562789.674765:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654956160:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.674787:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562789.674815:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956288 00000100:00100000:1.0:1786562789.674820:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956288 00000100:00100000:1.0:1786562789.674854:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956160 00000100:00100000:1.0:1786562789.674857:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956160 00000100:00100000:1.0:1786562789.674877:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1786562789.674884:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654956288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.674923:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654956288:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562789.674929:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1786562789.674942:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786562789.674948:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654956160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.674974:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654956160:12345-0@lo:400:kworker.0 Request processed in 26us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562789.674979:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00080000:1.0:1786562789.675000:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562789.675040:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654956160:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.675050:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9887ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654956288:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.676711:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562789.676729:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654956672:0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.676787:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562789.676848:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956672 00000100:00100000:1.0:1786562789.676855:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956672 00000100:00100000:1.0:1786562789.676892:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786562789.676900:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654956672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562789.676945:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654956672:12345-0@lo:400:kworker.0 Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562789.676951:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786562789.676987:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654956672:0@lo:400:kworker.0 00010000:00010000:3.0:1786562790.182127:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562791.207832:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562792.229253:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562793.253937:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562793.783724:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562793.783775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562793.783805:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562793.783842:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562793.783874:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001984 00000100:00100000:0.0:1786562793.783883:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001984 00000100:00100000:0.0:1786562793.783941:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002112 00000100:00100000:0.0:1786562793.783944:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002112 00000100:00100000:0.0:1786562793.783970:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 581 00000100:00100000:0.0:1786562793.783980:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653001984:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562793.784095:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653001984:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 115us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562793.784103:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 581 00000100:00100000:0.0:1786562793.784121:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 582 00000100:00100000:0.0:1786562793.784127:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653002112:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562793.784165:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653002112:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562793.784171:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 582 00000100:00100000:1.0:1786562793.784270:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001856 00000100:00100000:1.0:1786562793.784275:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001856 00000100:00100000:1.0:1786562793.784317:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 469 00000100:00100000:1.0:1786562793.784324:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345653001856:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562793.784357:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:2348:x1873345653001856:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562793.784366:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 469 00000100:00080000:1.0:1786562793.784390:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786562793.784396:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562793.784399:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562793.784834:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653001728 00000100:00100000:2.0:1786562793.784840:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653001728 00000100:00100000:2.0:1786562793.784881:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 354 00000100:00100000:2.0:1786562793.784889:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653001728:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562793.784924:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653001728:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562793.784930:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 354 00010000:00010000:2.0:1786562794.279054:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562794.789274:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654956928:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789359:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562794.789420:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654957440:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789443:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562794.789473:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562794.789480:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654957056:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789506:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562794.789524:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654956800:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789536:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956928 00000100:00100000:1.0:1786562794.789542:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956928 00000100:00100000:3.0:1786562794.789560:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562794.789583:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654957312:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789590:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957440 00000100:00100000:1.0:1786562794.789593:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957440 00000100:00100000:3.0:1786562794.789609:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562794.789612:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957056 00000100:00100000:1.0:1786562794.789614:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957056 00000100:00100000:3.0:1786562794.789628:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562794.789633:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654957184:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789633:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1786562794.789641:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654956928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562794.789652:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562794.789678:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1786562794.789685:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654957440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789689:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654956928:12345-0@lo:400:kworker.0 Request processed in 49us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562794.789696:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1786562794.789710:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654957440:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562794.789713:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1786562794.789718:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654957056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562794.789728:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1786562794.789744:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bade6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654957056:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562794.789748:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957312 00000100:00100000:1.0:1786562794.789749:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786562794.789751:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957312 00000100:00080000:1.0:1786562794.789770:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562794.789774:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562794.789776:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957184 00000100:00100000:3.0:1786562794.789779:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957184 00000100:00100000:1.0:1786562794.789782:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654956800 00000100:00100000:1.0:1786562794.789784:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654956800 00000100:00100000:3.0:1786562794.789798:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1786562794.789805:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654957312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789820:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1786562794.789826:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654956800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562794.789838:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654957312:12345-0@lo:400:kworker.0 Request processed in 35us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562794.789844:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1786562794.789850:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654956800:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562794.789856:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1786562794.789861:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654957184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789868:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1786562794.789887:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654957184:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562794.789892:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00080000:1.0:1786562794.789900:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562794.789921:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654957184:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789921:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654957056:0@lo:400:kworker.0 00000100:00100000:3.0:1786562794.789930:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654956800:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789931:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654956928:0@lo:400:kworker.0 00000100:00100000:3.0:1786562794.789939:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654957312:0@lo:400:kworker.0 00000100:00100000:1.0:1786562794.789939:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654957440:0@lo:400:kworker.0 00000100:00100000:0.0:1786562794.791566:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654957568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562794.791627:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562794.791958:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562794.791968:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654957696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562794.792001:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562794.792063:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957568 00000100:00100000:3.0:1786562794.792068:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957568 00000100:00100000:3.0:1786562794.792107:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957696 00000100:00100000:3.0:1786562794.792111:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957696 00000100:00100000:3.0:1786562794.792137:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1786562794.792145:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654957568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562794.792182:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:3.0:1786562794.792233:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654957568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562794.792240:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1786562794.792256:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1786562794.792262:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654957696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562794.792282:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562794.792325:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654957696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562794.792331:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1786562794.794379:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654957568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562794.794667:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654957696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562795.302024:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786562796.325251:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562797.353599:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562798.373417:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562798.903350:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562798.903397:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562798.903493:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562798.903593:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562798.904461:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002240 00000100:00100000:1.0:1786562798.904473:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002240 00000100:00100000:1.0:1786562798.904532:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 356 00000100:00100000:1.0:1786562798.904542:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345653002240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562798.904615:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345653002240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 74us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562798.904622:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 356 00000100:00100000:2.0:1786562798.905676:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002368 00000100:00100000:2.0:1786562798.905686:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002368 00000100:00100000:2.0:1786562798.905765:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 473 00000100:00100000:2.0:1786562798.905775:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345653002368:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562798.905839:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:2351:x1873345653002368:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 66us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562798.905847:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 473 00000100:00080000:1.0:1786562798.906034:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562798.913188:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002496 00000100:00100000:1.0:1786562798.913204:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002496 00000100:00100000:3.0:1786562798.913251:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002624 00000100:00100000:3.0:1786562798.913258:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002624 00000100:00100000:1.0:1786562798.913288:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 585 00000100:00100000:1.0:1786562798.913301:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345653002496:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562798.913386:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345653002496:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 88us (9987us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562798.913394:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 585 00000100:00100000:1.0:1786562798.913418:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 586 00000100:00100000:1.0:1786562798.913426:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345653002624:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562798.913459:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345653002624:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (9866us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562798.913470:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 586 00000100:00080000:0.0:1786562798.913622:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562798.913628:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562799.400960:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562799.909501:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562799.909527:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654957824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562799.909607:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562799.909989:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654958080:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.910051:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562799.910076:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786562799.910082:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654957952:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.910125:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562799.910144:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654958464:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.910167:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562799.910204:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654958208:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.910227:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562799.910245:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562799.910250:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654958336:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.910274:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562799.910516:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562799.910527:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654958592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562799.910558:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562799.910603:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958080 00000100:00100000:1.0:1786562799.910612:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958080 00000100:00100000:1.0:1786562799.910664:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958464 00000100:00100000:1.0:1786562799.910668:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958464 00000100:00100000:1.0:1786562799.910684:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958208 00000100:00100000:1.0:1786562799.910687:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958208 00000100:00100000:1.0:1786562799.910708:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786562799.910718:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654958080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562799.910766:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654958080:12345-0@lo:400:kworker.0 Request processed in 50us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562799.910774:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786562799.910794:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1786562799.910801:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654958464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562799.910831:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654958464:12345-0@lo:400:kworker.0 Request processed in 30us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562799.910837:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1786562799.910849:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1786562799.910855:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654958208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562799.910890:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654958208:12345-0@lo:400:kworker.0 Request processed in 35us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562799.910896:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1786562799.910913:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957952 00000100:00100000:1.0:1786562799.910917:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957952 00000100:00100000:1.0:1786562799.910941:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1786562799.910948:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654957952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562799.910978:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654957952:12345-0@lo:400:kworker.0 Request processed in 30us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562799.910985:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1786562799.911050:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958336 00000100:00100000:1.0:1786562799.911054:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958336 00000100:00100000:1.0:1786562799.911083:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1786562799.911090:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654958336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562799.911266:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654957824 00000100:00100000:2.0:1786562799.911271:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654957824 00000100:00100000:2.0:1786562799.911300:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958592 00000100:00100000:2.0:1786562799.911304:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958592 00000100:00100000:2.0:1786562799.911317:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1786562799.911323:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654957824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562799.911351:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:2.0:1786562799.911387:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654957824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562799.911393:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1786562799.911406:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1786562799.911411:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654958592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562799.911428:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562799.911456:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654958592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562799.911462:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1786562799.911507:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654958592:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786562799.911558:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562799.911562:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562799.911565:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562799.911594:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654958208:0@lo:400:kworker.0 00000100:00100000:2.0:1786562799.911608:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654957824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562799.911698:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654958336:12345-0@lo:400:kworker.0 Request processed in 608us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562799.911705:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1786562799.911765:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654958336:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.911825:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654957952:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.911836:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654958464:0@lo:400:kworker.0 00000100:00100000:0.0:1786562799.911845:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654958080:0@lo:400:kworker.0 00010000:00010000:3.0:1786562800.421247:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562801.445436:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562802.473168:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562803.494535:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562804.024085:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562804.024118:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562804.024152:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562804.024179:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562804.024469:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002880 00000100:00100000:2.0:1786562804.024478:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002880 00000100:00100000:2.0:1786562804.024539:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 477 00000100:00100000:2.0:1786562804.024550:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345653002880:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562804.024625:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2350:x1873345653002880:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 77us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562804.024633:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 477 00000100:00100000:2.0:1786562804.024657:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003136 00000100:00100000:2.0:1786562804.024661:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003136 00000100:00100000:2.0:1786562804.024687:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003008 00000100:00100000:2.0:1786562804.024690:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003008 00000100:00100000:2.0:1786562804.024712:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 588 00000100:00100000:2.0:1786562804.024719:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345653003136:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562804.024748:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+7:2350:x1873345653003136:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562804.024754:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 588 00000100:00100000:2.0:1786562804.024765:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 589 00000100:00100000:2.0:1786562804.024770:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345653003008:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562804.024794:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+8:2350:x1873345653003008:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562804.024799:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 589 00000100:00100000:2.0:1786562804.024816:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653002752 00000100:00100000:2.0:1786562804.024820:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653002752 00000100:00100000:2.0:1786562804.024842:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 358 00000100:00100000:2.0:1786562804.024849:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345653002752:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562804.024873:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2350:x1873345653002752:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562804.024879:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 358 00000100:00080000:2.0:1786562804.024906:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562804.024910:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562804.024913:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786562804.525225:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562805.029348:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654958720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562805.029420:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562805.029497:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958720 00000100:00100000:2.0:1786562805.029505:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958720 00000100:00100000:2.0:1786562805.029644:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1786562805.029656:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654958720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562805.032719:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:2.0:1786562805.032832:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654958720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3175us (3408us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562805.032844:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00080000:2.0:1786562805.032884:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562805.033020:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654958720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562805.033866:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654959232:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.033931:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562805.033976:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786562805.033983:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654958848:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034029:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562805.034050:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654959360:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034076:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562805.034100:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654958976:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034123:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562805.034141:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562805.034145:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654959104:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034165:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562805.034192:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958848 00000100:00100000:2.0:1786562805.034198:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958848 00000100:00100000:2.0:1786562805.034239:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1786562805.034248:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654958848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034291:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654958848:12345-0@lo:400:kworker.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562805.034299:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1786562805.034328:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959360 00000100:00100000:2.0:1786562805.034332:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959360 00000100:00100000:2.0:1786562805.034355:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654958976 00000100:00100000:2.0:1786562805.034357:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654958976 00000100:00100000:2.0:1786562805.034378:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959104 00000100:00100000:2.0:1786562805.034381:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959104 00000100:00100000:2.0:1786562805.034399:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1786562805.034405:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654959360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034436:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654959360:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562805.034443:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1786562805.034458:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786562805.034464:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654958976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034496:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654958976:12345-0@lo:400:kworker.0 Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562805.034503:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786562805.034512:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1786562805.034518:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654959104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034541:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654959104:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562805.034702:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1786562805.034737:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654958848:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034749:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654959360:0@lo:400:kworker.0 00000100:00080000:2.0:1786562805.034773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562805.034792:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654959104:0@lo:400:kworker.0 00000100:00100000:2.0:1786562805.034802:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654958976:0@lo:400:kworker.0 00000100:00100000:1.0:1786562805.035039:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959232 00000100:00100000:1.0:1786562805.035044:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959232 00000100:00100000:1.0:1786562805.035090:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1786562805.035097:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654959232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562805.035143:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654959232:12345-0@lo:400:kworker.0 Request processed in 47us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562805.035150:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00080000:1.0:1786562805.035181:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562805.035199:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654959232:0@lo:400:kworker.0 00000100:00100000:1.0:1786562805.035243:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654959488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562805.035271:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562805.035411:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959488 00000100:00100000:3.0:1786562805.035416:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959488 00000100:00100000:3.0:1786562805.035441:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1786562805.035447:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654959488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562805.035473:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562805.035564:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654959488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562805.035571:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1786562805.039671:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654959488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562805.541280:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562806.565259:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562807.589185:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562808.232504:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562808.232619:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562808.235588:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003264 00000100:00100000:3.0:1786562808.235606:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003264 00000100:00080000:0.0:1786562808.235723:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562808.235880:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003520 00000100:00100000:2.0:1786562808.235885:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003520 00000100:00100000:2.0:1786562808.235984:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17476 00000100:00100000:2.0:1786562808.235996:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345653003264:12345-192.168.204.29@tcp:41:mkdir.0 00000004:00000024:2.0:1786562808.236066:0:33115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2260205568 avail 2258108416 00000100:00100000:2.0:1786562808.236145:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345653003264:12345-192.168.204.29@tcp:41:mkdir.0 Request processed in 152us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562808.236153:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17476 00000100:00100000:2.0:1786562808.236491:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17477 00000100:00100000:2.0:1786562808.236500:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+19:71770:x1873345653003520:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:2.0:1786562808.236554:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562808.236623:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a0fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd617 expref: 19 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.236644:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562808.236655:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562808.237048:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.237063:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.237074:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.237105:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.237113:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.237121:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562808.243240:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ef:0x0]: returning size 512 00010000:00010000:2.0:1786562808.243265:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.243276:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.243284:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.243296:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562808.243301:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.243308:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.243389:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332600) 00010000:00010000:2.0:1786562808.243394:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562808.243401:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.243407:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd000/0x5c655bf6668a140a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562808.243429:0:33115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018a5e2cf reply state 00000000102ce261 transno 8589950868 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562808.243438:0:33115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562808.243657:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+20:71770:x1873345653003520:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 7153us (11033us total) trans 8589950868 rc 0/0 00000100:00100000:2.0:1786562808.243667:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17477 00010000:00010000:2.0:1786562808.252791:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.252810:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.252818:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.252825:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562808.252830:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.252837:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.252865:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4b5033f (ffff90e9b6332d00) 00010000:00010000:2.0:1786562808.252869:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562808.252873:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562808.252880:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a1411 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562808.618278:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786562809.123470:0:41627:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe1e3e7b30 20000000:00000080:1.0:1786562809.123487:0:41627:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90e88c690800 uarg=0000000000000000 00000040:00100000:1.0:1786562809.128536:0:41627:0:(llog.c:1072:llog_reverse_process()) index 41 : idx 1 00000040:00080000:1.0:1786562809.128907:0:41627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 224 off15448 20000000:01000000:1.0:1786562809.128927:0:41627:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre test_204f (null) (null) 00000040:00080000:1.0:1786562809.128961:0:41627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 112 off15560 00000040:00080000:1.0:1786562809.128997:0:41627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15784 00000040:00080000:1.0:1786562809.130321:0:41627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 224 off14712 20000000:01000000:1.0:1786562809.130340:0:41627:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre test_204f (null) (null) 00000040:00080000:1.0:1786562809.130377:0:41627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 120 off14832 00000040:00080000:1.0:1786562809.130426:0:41627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off15056 10000000:01000000:1.0:1786562809.130516:0:41627:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786562809.130538:0:41627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130556:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf66683993b expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130564:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668399ea expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130574:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130581:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130593:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf666839a5a expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130600:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf666839a68 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130606:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130612:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf666839abc expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130618:0:41627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf666839b10 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130624:0:41627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130666:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf666839b10 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.130680:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf666839b10 expref: 18 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.130693:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654959616:0@lo:104: 00000100:00100000:1.0:1786562809.131319:0:41627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562809.131504:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf666839abc expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.131519:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf666839abc expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.131530:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88720ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654959744:0@lo:104: 00000100:00100000:1.0:1786562809.131557:0:41627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562809.131755:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.131764:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.131773:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654959872:0@lo:104: 00000100:00100000:1.0:1786562809.131799:0:41627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.131870:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959616 00000100:00100000:2.0:1786562809.131878:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959616 00000100:00100000:2.0:1786562809.131931:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959744 00000100:00100000:2.0:1786562809.131934:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959744 00000100:00100000:2.0:1786562809.131948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786562809.131957:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41627:x1873345654959616:12345-0@lo:104: 00010000:00010000:2.0:1786562809.131971:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132063:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786562809.132069:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41627:x1873345654959616:12345-0@lo:104: Request processed in 114us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.132077:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786562809.132095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786562809.132101:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:41627:x1873345654959744:12345-0@lo:104: 00010000:00010000:2.0:1786562809.132110:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132154:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786562809.132160:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:41627:x1873345654959744:12345-0@lo:104: Request processed in 59us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.132165:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1786562809.132184:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786562809.132190:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132198:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e881f0d000 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.132203:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132222:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.132230:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.132236:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.132269:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132276:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.132295:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132301:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e881f0d000/0x5c655bf666839b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839b1e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132314:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562809.132317:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132322:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af81c000 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.132325:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132335:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.132340:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.132344:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.132355:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132361:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.132373:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132380:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9af81c000/0x5c655bf666839abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839ac3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132388:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.132390:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.132391:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.132397:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562809.132416:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654960000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.132459:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.132494:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654960128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.132517:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.132549:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654960000 00000100:00100000:2.0:1786562809.132553:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654960000 00010000:00010000:2.0:1786562809.132573:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839b10 expref: 19 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.132596:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654960128 00000100:00100000:2.0:1786562809.132600:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654960128 00010000:00010000:2.0:1786562809.132611:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839abc expref: 20 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.132629:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8801 00000100:00100000:2.0:1786562809.132635:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+20:3292:x1873345654960000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.132645:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.132650:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839b10 expref: 20 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132660:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf666839b10 expref: 20 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132675:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.132702:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+20:3292:x1873345654960000:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.132708:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8801 00000100:00100000:2.0:1786562809.132722:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8802 00000100:00100000:2.0:1786562809.132728:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654960128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.132735:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.132739:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839abc expref: 19 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132748:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf666839abc expref: 19 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.132758:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.132784:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654960128:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.132789:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8802 00000100:00100000:2.0:1786562809.132826:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654960128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.132863:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654960000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562809.133699:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf666839a68 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.133714:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf666839a68 expref: 18 pid: 33109 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.133725:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960256:0@lo:104: 00010000:00010000:1.0:1786562809.133759:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf666839a5a expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.133767:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf666839a5a expref: 18 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.133775:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960384:0@lo:104: 00010000:00010000:1.0:1786562809.133803:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.133812:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 9 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.133821:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960512:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562809.133957:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.133966:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 9 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.133976:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960640:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562809.134038:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668399ea expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.134047:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668399ea expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.134056:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960768:0@lo:104: 00010000:00010000:1.0:1786562809.134083:0:41627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf66683993b expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.134091:0:41627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf66683993b expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.134099:0:41627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960896:0@lo:104: 00000100:00100000:1.0:1786562809.134200:0:41627:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611e40 going to sleep for 11 seconds 00010000:00010000:1.0:1786562809.134300:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9af81c600/0x5c655bf666839b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf666839b10 expref: 18 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.134313:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9baa16680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654959616:0@lo:104: 00010000:00010000:1.0:1786562809.134324:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e881f0c200/0x5c655bf666839ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf666839abc expref: 17 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.134331:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88720ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654959744:0@lo:104: 00000100:00100000:2.0:1786562809.134428:0:5852:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786562809.134461:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.134481:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.134491:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.134499:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.134507:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654959872 00000100:00100000:2.0:1786562809.134512:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654959872 00000100:00100000:2.0:1786562809.134544:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654960256 00000100:00100000:2.0:1786562809.134547:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654960256 00000100:00100000:2.0:1786562809.134557:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654960384 00000100:00100000:2.0:1786562809.134559:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654960384 00000100:00100000:2.0:1786562809.134568:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654960768 00000100:00100000:2.0:1786562809.134570:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654960768 00000100:00100000:2.0:1786562809.134579:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654960896 00000100:00100000:2.0:1786562809.134581:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654960896 00000100:00100000:2.0:1786562809.134592:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786562809.134600:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88280fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+7:41627:x1873345654959872:12345-0@lo:104: 00010000:00010000:2.0:1786562809.134612:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.134658:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786562809.134663:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88280fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+7:41627:x1873345654959872:12345-0@lo:104: Request processed in 65us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.134670:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786562809.134723:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786562809.134730:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+6:41627:x1873345654960256:12345-0@lo:104: 00010000:00010000:2.0:1786562809.134740:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.134771:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786562809.134776:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+6:41627:x1873345654960256:12345-0@lo:104: Request processed in 48us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.134781:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786562809.134793:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786562809.134798:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+5:41627:x1873345654960384:12345-0@lo:104: 00010000:00010000:2.0:1786562809.134804:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.134845:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786562809.134850:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+5:41627:x1873345654960384:12345-0@lo:104: Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.134856:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786562809.134867:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786562809.134873:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41627:x1873345654960768:12345-0@lo:104: 00010000:00010000:2.0:1786562809.134880:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.134911:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1786562809.134916:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41627:x1873345654960768:12345-0@lo:104: Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.134922:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786562809.134935:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786562809.134941:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:41627:x1873345654960896:12345-0@lo:104: 00010000:00010000:2.0:1786562809.134948:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.134980:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1786562809.134985:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:41627:x1873345654960896:12345-0@lo:104: Request processed in 45us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.134991:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1786562809.135034:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1786562809.135040:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135048:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af81d000 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.135052:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135060:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.135066:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.135072:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.135102:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135109:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.135137:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135146:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9af81d000/0x5c655bf666839aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839aae expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135158:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1786562809.135161:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135166:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e881f0ca00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.135169:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135175:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.135180:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.135184:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.135197:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135202:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.135228:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135234:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e881f0ca00/0x5c655bf666839a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839a6f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135243:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786562809.135247:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135252:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9a98a7c00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.135255:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135261:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.135266:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.135272:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.135284:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135290:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.135295:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135301:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9a98a7c00/0x5c655bf666839a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839a61 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135309:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786562809.135312:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135317:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266a00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.135320:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135331:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.135336:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.135341:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.135351:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135356:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.135362:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135368:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9b4266a00/0x5c655bf6668399ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668399f1 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135378:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562809.135380:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135385:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9af81d800 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562809.135388:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135394:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562809.135399:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562809.135404:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562809.135415:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135421:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562809.135425:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135431:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9af81d800/0x5c655bf66683993b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf666839942 expref: -99 pid: 33104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135445:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.135447:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.135448:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.135456:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562809.135472:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562809.135484:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654961024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.135519:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.135541:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654961536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.135562:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.135583:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562809.135589:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654961408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.135626:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.135656:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961024 00000100:00100000:2.0:1786562809.135662:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961024 00010000:00010000:2.0:1786562809.135681:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 17 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.135704:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961536 00000100:00100000:2.0:1786562809.135707:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961536 00010000:00010000:2.0:1786562809.135718:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf66683993b expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.135732:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961408 00000100:00100000:2.0:1786562809.135734:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961408 00010000:00010000:2.0:1786562809.135744:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668399ea expref: 19 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.135755:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8803 00000100:00100000:2.0:1786562809.135762:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654961024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.135772:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.135777:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 19 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135788:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 19 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135803:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.135829:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654961024:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.135848:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8803 00000100:00100000:2.0:1786562809.135885:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8804 00000100:00100000:2.0:1786562809.135891:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+18:3290:x1873345654961536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.135898:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.135902:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf66683993b expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135915:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf66683993b expref: 18 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135924:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.135943:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+18:3290:x1873345654961536:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.135949:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8804 00000100:00100000:2.0:1786562809.135962:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8805 00000100:00100000:2.0:1786562809.135967:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+17:3290:x1873345654961408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.135974:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.135978:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668399ea expref: 17 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135986:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668399ea expref: 17 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.135995:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.136039:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+17:3290:x1873345654961408:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.136045:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8805 00000100:00100000:2.0:1786562809.136067:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bae95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654961152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.136090:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.136107:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562809.136112:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654961280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.136130:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562809.136153:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961152 00000100:00100000:2.0:1786562809.136156:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961152 00010000:00010000:2.0:1786562809.136171:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839a68 expref: 17 pid: 33109 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.136185:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961280 00000100:00100000:2.0:1786562809.136187:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961280 00010000:00010000:2.0:1786562809.136196:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839a5a expref: 18 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.136207:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8806 00000100:00100000:2.0:1786562809.136212:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+18:3291:x1873345654961152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.136218:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.136223:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839a68 expref: 18 pid: 33109 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.136231:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf666839a68 expref: 18 pid: 33109 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.136242:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.136268:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+18:3291:x1873345654961152:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.136274:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8806 00000100:00100000:2.0:1786562809.136286:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8807 00000100:00100000:2.0:1786562809.136292:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+17:3291:x1873345654961280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.136299:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.136302:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf666839a5a expref: 17 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.136310:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf666839a5a expref: 17 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.136324:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.136342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+17:3291:x1873345654961280:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.136347:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8807 00010000:00010000:2.0:1786562809.136369:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562809.136389:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654961280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.136398:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bae95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654961152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.136429:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654961408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.136437:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654961024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562809.136444:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654961536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.136461:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562809.137647:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9a98a6c00/0x5c655bf666839aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf666839aa7 expref: 16 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.137665:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654959872:0@lo:104: 00010000:00010000:1.0:1786562809.137679:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9a98a7400/0x5c655bf666839a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf666839a68 expref: 15 pid: 33109 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.137687:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960256:0@lo:104: 00010000:00010000:1.0:1786562809.137695:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e881f0c000/0x5c655bf666839a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf666839a5a expref: 14 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.137703:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960384:0@lo:104: 00010000:00010000:1.0:1786562809.137714:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668399f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668399ea expref: 13 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.137722:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960768:0@lo:104: 00010000:00010000:1.0:1786562809.137731:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266c00/0x5c655bf666839942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf66683993b expref: 12 pid: 33107 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.137737:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960896:0@lo:104: 00000100:00100000:0.0:1786562809.142067:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562809.143800:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003648 00000100:00100000:2.0:1786562809.143814:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003648 00010000:00010000:2.0:1786562809.143872:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 10 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.143912:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8808 00000100:00100000:2.0:1786562809.143923:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653003648:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.143940:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.143947:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 10 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.143959:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 10 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.143984:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.144076:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653003648:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 154us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.144085:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8808 00000100:00100000:3.0:1786562809.145592:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562809.145727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562809.145756:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562809.146058:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004032 00000100:00100000:0.0:1786562809.146068:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004032 00000100:00100000:0.0:1786562809.146131:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003904 00000100:00100000:0.0:1786562809.146135:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003904 00000100:00100000:0.0:1786562809.146159:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 591 00000100:00100000:0.0:1786562809.146169:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653004032:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562809.146242:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653004032:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 74us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562809.146249:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 591 00000100:00100000:0.0:1786562809.146266:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 592 00000100:00100000:0.0:1786562809.146272:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653003904:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562809.146298:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653003904:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562809.146304:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 592 00000100:00100000:2.0:1786562809.147637:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653003776 00000100:00100000:2.0:1786562809.147650:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653003776 00000100:00100000:2.0:1786562809.147707:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 481 00000100:00100000:2.0:1786562809.147717:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345653003776:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562809.147789:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9887ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+19:2349:x1873345653003776:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 74us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.147795:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 481 00000100:00080000:3.0:1786562809.148311:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562809.148318:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562809.151201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562809.151349:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004160 00000100:00100000:2.0:1786562809.151359:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004160 00010000:00010000:2.0:1786562809.151402:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 10 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562809.151447:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8809 00000100:00100000:2.0:1786562809.151457:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653004160:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562809.151472:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562809.151478:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 10 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151491:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 10 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151513:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151522:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151540:0:8413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151548:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151554:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151561:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151567:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562809.151572:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151580:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151590:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.151601:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562809.151651:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653004160:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 195us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562809.151659:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8809 00010000:00010000:1.0:1786562809.157557:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266400/0x5c655bf666839a29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8c5 expref: 9 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.157581:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960640:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562809.157633:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4267200/0x5c655bf666839a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cda8d3 expref: 8 pid: 33108 timeout: 1341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562809.157644:0:41627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41627:1873345654960512:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562809.157712:0:41627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.157723:0:41627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.157729:0:41627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562809.157736:0:41627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990557000/0x5c655bf6668a1418 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562809.640846:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562810.149357:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654961664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562810.149443:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.149638:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786562810.149645:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654961792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562810.149684:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.149714:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961664 00000100:00100000:2.0:1786562810.149721:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961664 00000100:00100000:2.0:1786562810.149770:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1786562810.149780:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654961664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562810.149838:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562810.149885:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654961664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.149893:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1786562810.149911:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961792 00000100:00100000:2.0:1786562810.149914:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961792 00000100:00100000:2.0:1786562810.149932:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1786562810.149938:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654961792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562810.149957:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:2.0:1786562810.149984:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654961792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.149990:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00080000:2.0:1786562810.150030:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562810.150034:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562810.150068:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654961792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562810.150369:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654962304:0@lo:400:kworker.0 00000100:00100000:0.0:1786562810.150403:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562810.150667:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654961920:0@lo:400:kworker.0 00000100:00100000:3.0:1786562810.150728:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.153746:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962304 00000100:00100000:1.0:1786562810.153760:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962304 00000100:00100000:1.0:1786562810.154973:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1786562810.154993:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654962304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562810.155103:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654962304:12345-0@lo:400:kworker.0 Request processed in 117us (4697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.155110:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1786562810.155166:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654961920 00000100:00100000:1.0:1786562810.155171:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654961920 00000100:00100000:1.0:1786562810.155205:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1786562810.155212:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+12:3289:x1873345654961920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562810.155245:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+12:3289:x1873345654961920:12345-0@lo:400:kworker.0 Request processed in 35us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.155252:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1786562810.155470:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654962048:0@lo:400:kworker.0 00000100:00100000:1.0:1786562810.155507:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.155599:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654961664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562810.155647:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654962176:0@lo:400:kworker.0 00000100:00100000:2.0:1786562810.155678:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.155705:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962048 00000100:00100000:2.0:1786562810.155709:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962048 00000100:00100000:2.0:1786562810.155742:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962176 00000100:00100000:2.0:1786562810.155746:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962176 00000100:00100000:2.0:1786562810.156193:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786562810.156205:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654962048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562810.156249:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654962048:12345-0@lo:400:kworker.0 Request processed in 48us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.156256:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786562810.156273:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786562810.156280:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654962176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562810.156308:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654962176:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.156314:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00080000:2.0:1786562810.156333:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562810.156645:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654961920:0@lo:400:kworker.0 00000100:00100000:1.0:1786562810.156710:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654962048:0@lo:400:kworker.0 00000100:00100000:1.0:1786562810.156788:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654962304:0@lo:400:kworker.0 00000100:00100000:2.0:1786562810.161615:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654962176:0@lo:400:kworker.0 00000100:00100000:2.0:1786562810.232667:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562810.232855:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004288 00000100:00100000:0.0:1786562810.232865:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004288 00000100:00100000:0.0:1786562810.232924:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 361 00000100:00100000:0.0:1786562810.232934:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+8:41781:x1873345653004288:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562810.232952:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562810.232973:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd728 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.233050:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.233064:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.233072:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268600, rc 0) 00000100:00100000:0.0:1786562810.233135:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653004288:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 202us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.233143:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 361 00000100:00100000:0.0:1786562810.238690:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562810.239805:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004416 00000100:00100000:2.0:1786562810.239828:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004416 00000100:00100000:2.0:1786562810.239903:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 362 00000100:00100000:2.0:1786562810.239914:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653004416:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.240266:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653004416:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 353us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.240275:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 362 00000100:00100000:2.0:1786562810.250576:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562810.255482:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004544 00000100:00100000:1.0:1786562810.255500:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004544 00000100:00100000:1.0:1786562810.255646:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 363 00000100:00100000:1.0:1786562810.255658:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653004544:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.255952:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653004544:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 295us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.255959:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 363 00000100:00100000:3.0:1786562810.280138:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562810.280346:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004672 00000100:00100000:2.0:1786562810.280356:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004672 00000100:00100000:2.0:1786562810.280420:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 364 00000100:00100000:2.0:1786562810.280432:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:71783:x1873345653004672:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786562810.282052:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:71783:x1873345653004672:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 1614us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.282065:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 364 00000100:00100000:3.0:1786562810.287409:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562810.287485:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004800 00000100:00100000:1.0:1786562810.287495:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004800 00000100:00100000:1.0:1786562810.287561:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 365 00000100:00100000:1.0:1786562810.287570:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:71783:x1873345653004800:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786562810.293853:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:71783:x1873345653004800:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 6269us (6440us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.293882:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 365 00000100:00100000:3.0:1786562810.300326:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562810.300993:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653004928 00000100:00100000:2.0:1786562810.301199:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653004928 00000100:00100000:2.0:1786562810.301305:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 366 00000100:00100000:2.0:1786562810.301316:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653004928:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562810.301332:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562810.301351:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd72f expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.301379:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 10 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.301390:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 10 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.301398:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfdc00, rc 0) 00000100:00100000:2.0:1786562810.301447:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653004928:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 133us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.301453:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 366 00000100:00100000:0.0:1786562810.312259:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562810.312426:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005056 00000100:00100000:2.0:1786562810.312436:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005056 00000100:00100000:2.0:1786562810.312489:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 367 00000100:00100000:2.0:1786562810.312500:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653005056:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.312930:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653005056:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 430us (678us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786562810.312939:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 367 00010000:00010000:2.0:1786562810.664223:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786562810.664256:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562810.664267:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e8812d5800 from 42 10000000:01000000:3.0:1786562810.664272:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562810.664828:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.664841:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.664854:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562810.665124:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654962432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.665207:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562810.665255:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.668217:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962432 00000100:00100000:0.0:1786562810.668232:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962432 00000100:00100000:0.0:1786562810.668300:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1786562810.668310:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+12:5818:x1873345654962432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562810.668328:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562810.668347:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a142d expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.668377:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a142d expref: 13 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.668388:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a142d expref: 13 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.668398:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562810.668501:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654962432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.668508:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1786562810.669242:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654962432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562810.669264:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.669275:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562810.669348:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654962560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.669389:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562810.669426:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1786562810.675081:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962560 00000100:00100000:1.0:1786562810.675096:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962560 00000100:00100000:1.0:1786562810.675156:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1786562810.675166:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654962560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.675453:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654962560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (6062us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.675461:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1786562810.675653:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654962560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.675707:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654962688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.675760:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.675792:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.675816:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962688 00000100:00100000:0.0:1786562810.675821:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962688 00000100:00100000:0.0:1786562810.675846:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1786562810.675853:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654962688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.676050:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654962688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.676057:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1786562810.676101:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654962688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.679090:0:41628:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41628:1873345654962816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.679172:0:41628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.679211:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962816 00000100:00100000:1.0:1786562810.679219:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962816 00000100:00100000:1.0:1786562810.679260:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1786562810.679268:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:41628:x1873345654962816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.680291:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:41628:x1873345654962816:12345-0@lo:502:llog_process_th.0 Request processed in 1019us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.680302:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1786562810.680365:0:41628:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e989367300 going to sleep for 11 seconds 00000100:00100000:1.0:1786562810.680388:0:41628:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41628:1873345654962816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.680444:0:41628:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41628:1873345654962944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.680483:0:41628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.680993:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654962944 00000100:00100000:1.0:1786562810.681446:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654962944 00000100:00100000:0.0:1786562810.681627:0:41628:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562810.682111:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1786562810.682124:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:41628:x1873345654962944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.682384:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:41628:x1873345654962944:12345-0@lo:502:llog_process_th.0 Request processed in 262us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.682393:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1786562810.682819:0:41628:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41628:1873345654962944:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786562810.682859:0:41628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:0.0:1786562810.683238:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:0.0:1786562810.683260:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786562810.683270:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.683282:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562810.683292:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786562810.683295:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:0.0:1786562810.683298:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786562810.683332:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.683341:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.683351:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562810.683373:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.683416:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.683449:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.683602:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963072 00000100:00100000:2.0:1786562810.683610:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963072 00000100:00100000:2.0:1786562810.683660:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1786562810.683679:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654963072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562810.683690:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562810.683703:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a143b expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.683724:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a143b expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.683733:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a143b expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.683742:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd200, rc 0) 00000100:00100000:2.0:1786562810.683786:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654963072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.683792:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1786562810.684096:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562810.684111:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.684121:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562810.684171:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.684200:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.684316:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.684355:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963200 00000100:00100000:2.0:1786562810.684360:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963200 00000100:00100000:2.0:1786562810.684392:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1786562810.684400:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654963200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.684647:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654963200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.684654:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1786562810.685383:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.685424:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.685470:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.685509:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.685526:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963328 00000100:00100000:0.0:1786562810.685532:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963328 00000100:00100000:0.0:1786562810.685559:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1786562810.685566:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654963328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.685731:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654963328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.685739:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1786562810.686534:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.691344:0:41629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41629:1873345654963456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.691433:0:41629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.691483:0:41629:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e780 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.692277:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963456 00000100:00100000:0.0:1786562810.692287:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963456 00000100:00100000:0.0:1786562810.692334:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1786562810.692343:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:41629:x1873345654963456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562810.693120:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:41629:x1873345654963456:12345-0@lo:502:llog_process_th.0 Request processed in 774us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.693130:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1786562810.693621:0:41629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41629:1873345654963456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786562810.693659:0:41629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786562810.693673:0:41629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786562810.693675:0:41629:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre-MDT0000-m new lustre.test_204f 00000020:00000080:2.0:1786562810.693681:0:41629:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1786562810.693761:0:41629:0:(lod_pool.c:475:lod_pool_new()) test_204f is pool #1 00080000:10000000:2.0:1786562810.698398:0:41629:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00000001:00080000:3.0:1786562810.730045:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950868 is committed 00080000:10000000:2.0:1786562810.785840:0:41629:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00080000:10000000:3.0:1786562810.821350:0:41629:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/8/4) registered 00000100:00100000:3.0:1786562810.901382:0:41629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41629:1873345654963584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562810.901468:0:41629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562810.901531:0:41629:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988b133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.902344:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963584 00000100:00100000:0.0:1786562810.902355:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963584 00000100:00100000:0.0:1786562810.902422:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1786562810.902434:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:41629:x1873345654963584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562810.902721:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:41629:x1873345654963584:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.902730:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1786562810.903437:0:41629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41629:1873345654963584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786562810.903479:0:41629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786562810.903497:0:41629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786562810.903500:0:41629:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre-MDT0000-m new lustre.test_204f 00000040:00080000:3.0:1786562810.903505:0:41629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000020:01000000:0.0:1786562810.904584:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-39 (rc=0) 10000000:01000000:0.0:1786562810.904617:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786562810.904629:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.904641:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562810.904652:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786562810.904654:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e988fe0000 from 42 10000000:01000000:0.0:1786562810.904657:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786562810.904695:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.904704:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.904714:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562810.904738:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.904807:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.904846:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baedd540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.905065:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963712 00000100:00100000:3.0:1786562810.905073:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963712 00000100:00100000:3.0:1786562810.905113:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1786562810.905121:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654963712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562810.905133:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562810.905146:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1449 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.905169:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 15 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.905181:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 15 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.905190:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267800, rc 0) 00000100:00100000:3.0:1786562810.905239:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654963712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.905246:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1786562810.905435:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562810.905450:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.905460:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562810.905523:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.905552:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.905579:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020000 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.905688:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963840 00000100:00100000:2.0:1786562810.905693:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963840 00000100:00100000:2.0:1786562810.905729:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1786562810.905736:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654963840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.906068:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654963840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.906075:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1786562810.906362:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.906400:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.906444:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.906473:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.907107:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654963968 00000100:00100000:3.0:1786562810.907114:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654963968 00000100:00100000:3.0:1786562810.907150:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1786562810.907158:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654963968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.907346:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654963968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.907357:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1786562810.907850:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654963968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.909239:0:41631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41631:1873345654964096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.909302:0:41631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.909341:0:41631:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.909393:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964096 00000100:00100000:3.0:1786562810.909400:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964096 00000100:00100000:3.0:1786562810.909446:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1786562810.909455:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:41631:x1873345654964096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562810.909682:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:41631:x1873345654964096:12345-0@lo:502:llog_process_th.0 Request processed in 228us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.909690:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1786562810.909833:0:41631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41631:1873345654964096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.909878:0:41631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41631:1873345654964224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.909986:0:41631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.910137:0:41631:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020180 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.914418:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964224 00000100:00100000:2.0:1786562810.914432:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964224 00000100:00100000:0.0:1786562810.914577:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1786562810.921374:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:41631:x1873345654964224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562810.922431:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:41631:x1873345654964224:12345-0@lo:502:llog_process_th.0 Request processed in 7841us (12440us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562810.922443:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1786562810.924616:0:41631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41631:1873345654964224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786562810.924668:0:41631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:0.0:1786562810.924867:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:0.0:1786562810.924893:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786562810.924915:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.924927:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562810.924938:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1786562810.924941:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1786562810.924944:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786562810.924987:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.925043:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.925055:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562810.925082:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.925142:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.925180:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baedd540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.925271:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964352 00000100:00100000:3.0:1786562810.925278:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964352 00000100:00100000:3.0:1786562810.925319:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1786562810.925328:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654964352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562810.925342:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562810.925356:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1457 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.925379:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 16 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.925389:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 16 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562810.925398:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266800, rc 0) 00000100:00100000:3.0:1786562810.925439:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654964352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.925446:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1786562810.925722:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562810.925737:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.925746:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562810.925815:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.925846:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.925880:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.925986:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964480 00000100:00100000:2.0:1786562810.925991:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964480 00000100:00100000:2.0:1786562810.926048:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1786562810.926056:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654964480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.926308:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654964480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.926316:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1786562810.926595:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.926627:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.926667:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.926695:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.927604:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964608 00000100:00100000:2.0:1786562810.927613:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964608 00000100:00100000:2.0:1786562810.927658:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1786562810.927666:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654964608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.931408:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654964608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3732us (4731us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.931426:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1786562810.934212:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786562810.943574:0:41632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:2.0:1786562810.945157:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1786562810.945202:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1786562810.945215:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.945230:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562810.945241:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786562810.945245:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e98318c000 from 42 10000000:01000000:2.0:1786562810.945248:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786562810.945289:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.945296:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.945306:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562810.945335:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.945405:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.945606:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.945695:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964736 00000100:00100000:0.0:1786562810.945703:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964736 00000100:00100000:0.0:1786562810.945815:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1786562810.945825:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654964736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562810.945842:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562810.945857:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1465 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.945897:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 17 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.946847:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 17 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.946858:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268e00, rc 0) 00000100:00100000:0.0:1786562810.947034:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654964736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1209us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.947043:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1786562810.947388:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562810.947409:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.947420:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562810.947569:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.947606:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.947642:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.947691:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964864 00000100:00100000:3.0:1786562810.947696:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964864 00000100:00100000:3.0:1786562810.947774:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1786562810.947783:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654964864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.948324:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654964864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 541us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.948332:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1786562810.948609:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.948657:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.948708:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.948773:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.948812:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654964992 00000100:00100000:3.0:1786562810.948819:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654964992 00000100:00100000:3.0:1786562810.948895:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1786562810.949157:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654964992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.949346:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654964992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.949354:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1786562810.949421:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654964992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562810.950556:0:41633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41633:1873345654965120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562810.950616:0:41633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.950694:0:41633:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b46ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.950747:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965120 00000100:00100000:3.0:1786562810.950753:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965120 00000100:00100000:3.0:1786562810.950795:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1786562810.950815:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:41633:x1873345654965120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562810.951262:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:41633:x1873345654965120:12345-0@lo:502:llog_process_th.0 Request processed in 447us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.951269:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1786562810.951543:0:41633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41633:1873345654965120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562810.951588:0:41633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41633:1873345654965248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562810.951619:0:41633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562810.951676:0:41633:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.951701:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965248 00000100:00100000:3.0:1786562810.951705:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965248 00000100:00100000:3.0:1786562810.951755:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1786562810.951762:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:41633:x1873345654965248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562810.951919:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:41633:x1873345654965248:12345-0@lo:502:llog_process_th.0 Request processed in 157us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.951926:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1786562810.951975:0:41633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41633:1873345654965248:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786562810.952002:0:41633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:1.0:1786562810.952252:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:1.0:1786562810.952272:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786562810.952281:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.952293:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562810.952302:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786562810.952304:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1786562810.952306:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786562810.952328:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.952335:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.952344:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562810.952357:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.952385:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.952646:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:0.0:1786562810.952714:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965376 00000100:00100000:0.0:1786562810.952720:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965376 00000100:00100000:0.0:1786562810.952745:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1786562810.952750:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654965376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562810.952759:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562810.952771:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1473 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.952791:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.952812:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.952821:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269600, rc 0) 00000100:00100000:0.0:1786562810.952859:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654965376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562810.952865:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1786562810.952961:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562810.952974:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.952983:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562810.953052:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.953074:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.953087:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.953566:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965504 00000100:00100000:3.0:1786562810.953572:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965504 00000100:00100000:3.0:1786562810.953594:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786562810.953600:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654965504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.953842:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654965504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.953849:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1786562810.954325:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.954364:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.954410:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.954441:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:3.0:1786562810.954564:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965632 00000100:00100000:3.0:1786562810.954569:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965632 00000100:00100000:3.0:1786562810.954606:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1786562810.954613:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654965632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562810.955210:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654965632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 595us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562810.955218:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1786562810.955307:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786562810.956464:0:41634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1786562810.956857:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1786562810.956887:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786562810.956963:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.956976:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562810.956987:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1786562810.956990:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90e9a99d4d40 from 1 10000000:01000000:1.0:1786562810.957232:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786562810.957274:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.957283:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562810.957294:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562810.957319:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.957376:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562810.957453:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562810.957555:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965760 00000100:00100000:2.0:1786562810.957563:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965760 00000100:00100000:2.0:1786562810.957645:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1786562810.957655:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654965760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562810.957668:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562810.957680:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1481 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.957702:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 19 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.957713:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 19 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562810.957720:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562810.957768:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654965760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562810.957774:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1786562810.957847:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562810.957863:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.957872:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562810.957945:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562810.957974:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562810.958418:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988a06000 going to sleep for 11 seconds 00000100:00100000:1.0:1786562810.958492:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654965888 00000100:00100000:1.0:1786562810.958498:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654965888 00000100:00100000:1.0:1786562810.958526:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1786562810.958533:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654965888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562810.958826:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654965888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (850us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786562810.958834:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1786562810.959286:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654965888:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786562810.959321:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786562810.959329:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562810.959344:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562811.685459:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786562812.596260:0:41682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffc5464310 20000000:00000080:3.0:1786562812.596285:0:41682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90e887a44000 uarg=0000000000000000 00000040:00100000:3.0:1786562812.597838:0:41682:0:(llog.c:1072:llog_reverse_process()) index 44 : idx 1 20000000:01000000:3.0:1786562812.597855:0:41682:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 43 cmd:0xce020 lustre.test_204f 00000040:00080000:3.0:1786562812.598400:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off16008 20000000:01000000:3.0:1786562812.598428:0:41682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre test_204f lustre-OST0000_UUID (null) 00000040:00080000:3.0:1786562812.598462:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 136 off16144 00000040:00080000:3.0:1786562812.598509:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].48, 224 off16608 00000040:00080000:3.0:1786562812.598716:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15280 20000000:01000000:3.0:1786562812.598726:0:41682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_204f lustre-OST0000_UUID (null) 00000040:00080000:3.0:1786562812.598785:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 144 off15424 00000040:00080000:3.0:1786562812.598938:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15648 10000000:01000000:3.0:1786562812.598956:0:41682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1786562812.598984:0:41682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599173:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599184:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599193:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a142d expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599201:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a143b expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599207:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599213:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599220:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599227:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599239:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599247:0:41682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599305:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599322:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 18 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.599340:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e49f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966016:0@lo:104: 00000100:00100000:3.0:1786562812.599434:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562812.599518:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599527:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.599536:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e4b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966144:0@lo:104: 00000100:00100000:3.0:1786562812.599559:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562812.599733:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.599742:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.599750:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e48e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966272:0@lo:104: 00000100:00100000:3.0:1786562812.599787:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562812.604104:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786562812.604149:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966016 00000100:00100000:0.0:1786562812.604162:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966016 00000100:00100000:0.0:1786562812.604232:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966144 00000100:00100000:0.0:1786562812.604237:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966144 00000100:00100000:0.0:1786562812.604249:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966272 00000100:00100000:0.0:1786562812.604251:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966272 00000100:00100000:0.0:1786562812.604269:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786562812.604282:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+5:41682:x1873345654966016:12345-0@lo:104: 00010000:00010000:0.0:1786562812.604306:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.604424:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786562812.604431:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+5:41682:x1873345654966016:12345-0@lo:104: Request processed in 152us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.604440:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786562812.604458:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786562812.604464:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+4:41682:x1873345654966144:12345-0@lo:104: 00010000:00010000:0.0:1786562812.604472:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.604506:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786562812.604511:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+4:41682:x1873345654966144:12345-0@lo:104: Request processed in 48us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.604520:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786562812.604534:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786562812.604540:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af30bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+3:41682:x1873345654966272:12345-0@lo:104: 00010000:00010000:0.0:1786562812.604548:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.604588:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786562812.604593:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af30bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+3:41682:x1873345654966272:12345-0@lo:104: Request processed in 55us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.604599:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1786562812.604982:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.604998:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 18 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.605054:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e48a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966400:0@lo:104: 00000100:00100000:3.0:1786562812.605097:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562812.605125:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605134:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 18 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.605143:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e4b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966528:0@lo:104: 00000100:00100000:2.0:1786562812.605151:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966400 00000100:00100000:2.0:1786562812.605158:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966400 00000100:00100000:3.0:1786562812.605166:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.605183:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966528 00000100:00100000:2.0:1786562812.605185:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966528 00010000:00010000:3.0:1786562812.605186:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a143b expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605195:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a143b expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.605196:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786562812.605203:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e49c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966656:0@lo:104: 00000100:00100000:2.0:1786562812.605203:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41682:x1873345654966400:12345-0@lo:104: 00010000:00010000:2.0:1786562812.605213:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.605223:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562812.605239:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a142d expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605247:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a142d expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.605252:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1786562812.605258:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41682:x1873345654966400:12345-0@lo:104: Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.605261:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e49180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966784:0@lo:104: 00000100:00100000:2.0:1786562812.605264:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786562812.605278:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966656 00000100:00100000:2.0:1786562812.605281:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966656 00000100:00100000:3.0:1786562812.605285:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.605291:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654966784 00000100:00100000:2.0:1786562812.605293:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654966784 00000100:00100000:2.0:1786562812.605303:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1786562812.605308:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.605308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+5:41682:x1873345654966528:12345-0@lo:104: 00010000:00010000:2.0:1786562812.605316:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605317:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 9 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.605329:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e49880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966912:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562812.605346:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1786562812.605350:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+5:41682:x1873345654966528:12345-0@lo:104: Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.605356:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786562812.605367:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786562812.605372:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41682:x1873345654966656:12345-0@lo:104: 00010000:00010000:2.0:1786562812.605379:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605389:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605398:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 9 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.605402:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1786562812.605406:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e4bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654967040:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562812.605406:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:41682:x1873345654966656:12345-0@lo:104: Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.605412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786562812.605423:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786562812.605429:0:41682:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9812ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.605429:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881e48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:41682:x1873345654966784:12345-0@lo:104: 00010000:00010000:2.0:1786562812.605436:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.605457:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e49f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966016:0@lo:104: 00010000:00010000:2.0:1786562812.605460:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1786562812.605464:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881e48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:41682:x1873345654966784:12345-0@lo:104: Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.605467:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e4b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966144:0@lo:104: 00000100:00100000:2.0:1786562812.605470:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786562812.605475:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e48e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966272:0@lo:104: 00000100:00100000:3.0:1786562812.605482:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e48a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966400:0@lo:104: 00000100:00100000:3.0:1786562812.605488:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e4b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966528:0@lo:104: 00010000:00010000:2.0:1786562812.605490:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:3.0:1786562812.605493:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e49c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966656:0@lo:104: 00010000:00010000:2.0:1786562812.605497:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.605499:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e49180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966784:0@lo:104: 00010000:00010000:2.0:1786562812.605507:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557c00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562812.605512:0:8414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.605521:0:8414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562812.605529:0:8414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562812.605535:0:8414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.605538:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786562812.605544:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605883:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557000 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.605888:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605898:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.605906:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.605912:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.605937:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.605945:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786562812.606049:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654967296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562812.606107:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562812.606203:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.606212:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990557000/0x5c655bf6668a1473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a147a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.606235:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786562812.606240:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.606247:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd400 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.606250:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.606263:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.606269:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.606274:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.606292:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.606298:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786562812.606466:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967296 00000100:00100000:0.0:1786562812.606474:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967296 00010000:00010000:0.0:1786562812.606509:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 19 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562812.606539:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8810 00000100:00100000:0.0:1786562812.606549:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654967296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786562812.606563:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562812.606569:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 19 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.606581:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 19 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.606599:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb269600/0x5c655bf6668a147a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1473 expref: 19 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.606614:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562812.606996:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607031:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a146c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607044:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786562812.607049:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607054:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.607057:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607065:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.607072:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.607079:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.607103:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607110:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562812.607136:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607144:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9bb269a00/0x5c655bf6668a1457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a145e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607154:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786562812.607157:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607163:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269200 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.607167:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607174:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.607180:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.607186:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.607234:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607241:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562812.607248:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607254:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9bb269200/0x5c655bf6668a1449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1450 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607263:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786562812.607266:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607272:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268a00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.607275:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607282:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.607288:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.607294:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.607308:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607313:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562812.607319:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607325:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9bb268a00/0x5c655bf6668a143b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1442 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607334:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562812.607338:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607345:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.607347:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607354:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.607361:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.607365:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.607380:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607387:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562812.607392:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607399:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a142d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607408:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.607410:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.607412:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.607426:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.607450:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.607457:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786562812.607476:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562812.607481:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e8812d5800 from 45 10000000:01000000:3.0:1786562812.607485:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562812.607525:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607535:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.607545:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.607567:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654968064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.607629:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.607672:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9812ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.607698:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654967552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.607726:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.607759:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562812.607839:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654967680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.607864:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.607897:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967552 00000100:00100000:3.0:1786562812.607906:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967552 00010000:00010000:3.0:1786562812.607934:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 19 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.607961:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967680 00000100:00100000:3.0:1786562812.607963:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967680 00010000:00010000:3.0:1786562812.607974:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 20 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.607993:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8811 00000100:00100000:3.0:1786562812.608002:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7c95f678-1633-48c9-bbd9-793f47c06679+20:3291:x1873345654967552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562812.608046:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562812.608051:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 20 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.608061:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 20 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.608076:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266800/0x5c655bf6668a145e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1457 expref: 20 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.608088:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562812.608121:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654967552:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.608129:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8811 00000100:00100000:3.0:1786562812.608149:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8812 00000100:00100000:3.0:1786562812.608155:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7c95f678-1633-48c9-bbd9-793f47c06679+18:3291:x1873345654967680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562812.608162:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562812.608167:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 18 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.608175:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 18 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.608185:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a1450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1449 expref: 18 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.608195:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562812.608217:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7c95f678-1633-48c9-bbd9-793f47c06679+17:3291:x1873345654967680:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.608223:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8812 00000100:00100000:3.0:1786562812.608267:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654967680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.608276:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654967552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.609126:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968064 00000100:00100000:3.0:1786562812.609138:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968064 00000100:00100000:3.0:1786562812.609194:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1786562812.609204:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654968064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.609226:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562812.609245:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1496 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.609270:0:33109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.609281:0:33109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.609302:0:33109:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.611975:0:8414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.612128:0:8414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562812.612322:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.612331:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1488 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.612405:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654967168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562812.612506:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.612590:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967168 00000100:00100000:2.0:1786562812.612600:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967168 00010000:00010000:2.0:1786562812.612641:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 19 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.612675:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8813 00000100:00100000:2.0:1786562812.612686:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654967168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562812.612702:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562812.612709:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 19 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.612724:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 19 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.612748:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a1488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1481 expref: 19 pid: 33108 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.612778:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562812.612820:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7c95f678-1633-48c9-bbd9-793f47c06679+18:3291:x1873345654967168:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.612841:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8813 00000100:00100000:2.0:1786562812.612896:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654967168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562812.612920:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562812.612923:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562812.612925:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.614708:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 17 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.614722:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266a00, rc 0) 00000100:00100000:3.0:1786562812.616317:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e881e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654967424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.616388:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.616440:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654967936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.616462:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.616490:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562812.616497:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654967808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.616526:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.616576:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967424 00000100:00100000:3.0:1786562812.616586:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967424 00010000:00010000:3.0:1786562812.616630:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.616661:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967936 00000100:00100000:3.0:1786562812.616665:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967936 00010000:00010000:3.0:1786562812.616678:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a142d expref: 19 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.616688:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654967808 00000100:00100000:3.0:1786562812.616691:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654967808 00010000:00010000:3.0:1786562812.616703:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a143b expref: 20 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.616718:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8814 00000100:00100000:3.0:1786562812.616733:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+20:3290:x1873345654967424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562812.616750:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562812.616756:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 20 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.616790:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 20 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.616814:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb268e00/0x5c655bf6668a146c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1465 expref: 20 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.616835:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562812.616873:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654967424:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.616881:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8814 00000100:00100000:3.0:1786562812.616904:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8815 00000100:00100000:3.0:1786562812.616910:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+18:3290:x1873345654967936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562812.616918:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562812.616921:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a142d expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.616930:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a142d expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.616940:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a142d expref: 18 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.616949:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562812.616969:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+17:3290:x1873345654967936:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.617108:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8815 00000100:00100000:3.0:1786562812.617127:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8816 00000100:00100000:3.0:1786562812.617134:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+16:3290:x1873345654967808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562812.617143:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562812.617147:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a143b expref: 16 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617156:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a143b expref: 16 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617167:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfd200/0x5c655bf6668a1442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a143b expref: 16 pid: 33107 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617178:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562812.617201:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+15:3290:x1873345654967808:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.617208:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8816 00000100:00100000:3.0:1786562812.617259:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654967808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.617271:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654967424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.617278:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654967936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.617341:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654968064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8137us (9710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.617349:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1786562812.617385:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654968064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.617405:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617418:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.617471:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e49880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654966912:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562812.617484:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e4bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654967040:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562812.617488:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562812.617519:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1786562812.617536:0:41682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.617537:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005184 00000100:00100000:2.0:1786562812.617541:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005184 00010000:00010000:2.0:1786562812.617560:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 10 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.617580:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005312 00000100:00100000:2.0:1786562812.617583:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005312 00000100:00100000:3.0:1786562812.617585:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8817 00000100:00100000:3.0:1786562812.617592:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b4bd338-b43c-4989-b811-79054f6124e2+11:2349:x1873345653005184:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562812.617594:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 11 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617602:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786562812.617605:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8818 00010000:00010000:3.0:1786562812.617607:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 11 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.617610:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+11:2349:x1873345653005312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562812.617617:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 11 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.617617:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562812.617621:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 11 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617630:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a1426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd72f expref: 11 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.617631:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 11 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.617641:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb268600/0x5c655bf6668a141f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd728 expref: 10 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617644:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.617653:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562812.617731:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c95f678-1633-48c9-bbd9-793f47c06679+13:3289:x1873345654967296:12345-0@lo:103:ldlm_bl.0 Request processed in 11182us (11621us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.617740:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8810 00000100:00100000:1.0:1786562812.617950:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e881e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654967296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562812.624158:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562812.624309:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+9:2349:x1873345653005312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6686us (6776us total) trans 0 rc 0/0 00010000:00010000:3.0:1786562812.624620:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.624635:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.624644:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.624653:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.624665:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266400 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562812.624670:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.624679:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.624787:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8818 00010000:00010000:0.0:1786562812.625322:0:41682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.625335:0:41682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1786562812.625433:0:41682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffc5464310 20000000:00000080:0.0:1786562812.625449:0:41682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90e889eba000 uarg=0000000000000000 00000040:00100000:0.0:1786562812.626628:0:41682:0:(llog.c:1072:llog_reverse_process()) index 48 : idx 48 00000040:00100000:0.0:1786562812.626665:0:41682:0:(llog.c:1072:llog_reverse_process()) index 46 : idx 1 20000000:01000000:0.0:1786562812.626672:0:41682:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 43 cmd:0xce020 lustre.test_204f 00000040:00080000:0.0:1786562812.629940:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16832 20000000:01000000:0.0:1786562812.629984:0:41682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre test_204f lustre-OST0001_UUID (null) 00000040:00080000:0.0:1786562812.630105:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 136 off16968 00000040:00080000:0.0:1786562812.630149:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off17192 00000040:00080000:0.0:1786562812.630733:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15872 20000000:01000000:0.0:1786562812.630745:0:41682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_204f lustre-OST0001_UUID (null) 00010000:00010000:3.0:1786562812.631002:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 12 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.631034:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 12 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.631093:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 12 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.631114:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:6673:1873345654968192:0@lo:105: 00000100:00100000:3.0:1786562812.631325:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.631392:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9812ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.631473:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968192 00000100:00100000:2.0:1786562812.631483:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968192 00000100:00100000:2.0:1786562812.631543:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786562812.631553:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:6673:x1873345654968192:12345-0@lo:105: 00000040:00080000:0.0:1786562812.631553:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 144 off16016 00010000:00010000:2.0:1786562812.631566:0:5852:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.631577:0:5852:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.631586:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.631593:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.631601:0:5852:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562812.631608:0:41682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off16240 00010000:00010000:2.0:1786562812.631631:0:5852:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff90e9b4267200) 10000000:01000000:0.0:1786562812.631631:0:41682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:2.0:1786562812.631694:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:6673:x1873345654968192:12345-0@lo:105: Request processed in 142us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.631703:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786562812.631751:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:6673:1873345654968192:0@lo:105: 00010000:00010000:2.0:1786562812.631787:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.631798:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266400/0x5c655bf6668a148f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.631800:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.631810:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.631813:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562812.631879:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654968320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.631885:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b4bd338-b43c-4989-b811-79054f6124e2+8:2349:x1873345653005184:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 14292us (14396us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.631896:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8817 00000100:00100000:3.0:1786562812.631913:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.631930:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9812ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.631948:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968320 00000100:00100000:3.0:1786562812.631952:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968320 00000100:00100000:3.0:1786562812.631990:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1786562812.631997:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654968320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.633110:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654968320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1106us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.633123:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1786562812.633306:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654968320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.633375:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654968448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.633437:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.633474:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5480 going to sleep for 11 seconds 00010000:00010000:0.0:1786562812.633542:0:41682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.633561:0:41682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 12 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.633570:0:41682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.633606:0:41682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 12 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.633622:0:41682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 12 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562812.633624:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968448 00000100:00100000:1.0:1786562812.633632:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968448 00000100:00100000:0.0:1786562812.633634:0:41682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654968576:0@lo:104: 00000100:00100000:0.0:1786562812.633664:0:41682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562812.633674:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1786562812.633683:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654968448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.633693:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968576 00000100:00100000:0.0:1786562812.633696:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968576 00000100:00100000:0.0:1786562812.633727:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786562812.633733:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+3:41682:x1873345654968576:12345-0@lo:104: 00010000:00010000:0.0:1786562812.633746:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.633937:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786562812.633943:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+3:41682:x1873345654968576:12345-0@lo:104: Request processed in 210us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.633950:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786562812.634060:0:41682:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562812.634077:0:41682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:41682:1873345654968576:0@lo:104: 00010000:00010000:0.0:1786562812.634091:0:41682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562812.634244:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654968448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 562us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.634251:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1786562812.634384:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654968448:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.634726:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562812.634735:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.634744:0:7599:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff90e9b4267200 is referenced, will be cancelled later 00010000:00010000:3.0:1786562812.634747:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.634756:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.634758:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.634759:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562812.635120:0:41683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41683:1873345654968704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.635193:0:41683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.635234:0:41683:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.635551:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968704 00000100:00100000:3.0:1786562812.635560:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968704 00000100:00100000:3.0:1786562812.635613:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1786562812.635622:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:41683:x1873345654968704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.635934:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:41683:x1873345654968704:12345-0@lo:502:llog_process_th.0 Request processed in 311us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.635943:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1786562812.635979:0:41683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41683:1873345654968704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.636181:0:41683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41683:1873345654968832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.636224:0:41683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.636260:0:41683:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5000 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.636312:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968832 00000100:00100000:1.0:1786562812.636318:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968832 00000100:00100000:1.0:1786562812.636355:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1786562812.636364:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:41683:x1873345654968832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562812.636521:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:41683:x1873345654968832:12345-0@lo:502:llog_process_th.0 Request processed in 157us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.636529:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1786562812.642202:0:41683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41683:1873345654968832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.642331:0:41683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c698380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41683:1873345654968960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.642442:0:41683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.642512:0:41683:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99fe33000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562812.642718:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654968960 00000100:00100000:0.0:1786562812.642727:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654968960 00000100:00100000:0.0:1786562812.642810:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1786562812.642821:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:41683:x1873345654968960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562812.643158:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:41683:x1873345654968960:12345-0@lo:502:llog_process_th.0 Request processed in 337us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.643169:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1786562812.643954:0:41683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c698380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41683:1873345654968960:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786562812.644041:0:41683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1786562812.644807:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-51 (rc=0) 10000000:01000000:0.0:1786562812.644849:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786562812.644864:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11400400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.644880:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11400400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.644918:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1786562812.644928:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786562812.644932:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 40 10000000:01000000:0.0:1786562812.644935:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786562812.645000:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.645034:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.645047:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562812.645078:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.645173:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.645219:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969088 00000100:00100000:0.0:1786562812.645223:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.645227:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969088 00000100:00100000:2.0:1786562812.645293:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1786562812.645305:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654969088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562812.645324:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562812.645343:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14ab expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.645373:0:33109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.645385:0:33109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 14 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.645405:0:33109:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.645418:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 14 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.645427:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562812.645479:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654969088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.645486:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1786562812.645532:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562812.645546:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.645555:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.646270:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562812.646281:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.646292:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267200 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562812.646297:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.646307:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562812.646316:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.646323:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562812.646367:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.646374:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562812.646415:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.646423:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9b4267200/0x5c655bf6668a1496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a149d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.646437:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.646439:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562812.646441:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562812.646579:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654969216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562812.646645:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562812.646758:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969216 00000100:00100000:1.0:1786562812.646785:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969216 00010000:00010000:1.0:1786562812.646820:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 14 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562812.646859:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8819 00000100:00100000:1.0:1786562812.646870:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c95f678-1633-48c9-bbd9-793f47c06679+14:3292:x1873345654969216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562812.646884:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562812.646891:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 14 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646903:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 14 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646921:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266a00/0x5c655bf6668a149d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1496 expref: 14 pid: 33109 timeout: 1345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646939:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646947:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646977:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646984:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646992:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.646999:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.647040:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562812.647045:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.647053:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.647074:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.647081:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.647106:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562812.647118:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5806:1873345654969344:0@lo:105: 00010000:00010000:0.0:1786562812.647137:0:41682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.647146:0:41682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562812.647172:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562812.647201:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.647494:0:5852:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786562812.647508:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969344 00000100:00100000:3.0:1786562812.647512:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969344 00000100:00100000:3.0:1786562812.647556:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786562812.647564:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:5806:x1873345654969344:12345-0@lo:105: 00010000:00010000:3.0:1786562812.647575:0:5852:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.647585:0:5852:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.647594:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.647600:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.647607:0:5852:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.647622:0:5852:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff90e9bb269600) 00000100:00100000:3.0:1786562812.647665:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:5806:x1873345654969344:12345-0@lo:105: Request processed in 102us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.647674:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1786562812.647786:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.647796:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.647872:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.647908:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.647937:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.648113:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969472 00000100:00100000:3.0:1786562812.648118:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969472 00000100:00100000:3.0:1786562812.648155:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1786562812.648172:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654969472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.648512:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654969472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.648519:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1786562812.648581:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.648622:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.648671:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562812.648710:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff40780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.648799:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969600 00000100:00100000:3.0:1786562812.648804:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969600 00000100:00100000:3.0:1786562812.648838:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1786562812.648847:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654969600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.649050:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654969600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.649058:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1786562812.649100:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562812.649330:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5806:1873345654969344:0@lo:105: 00010000:00010000:1.0:1786562812.649352:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.649366:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb269000/0x5c655bf6668a14a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 41682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.649380:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562812.649422:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c95f678-1633-48c9-bbd9-793f47c06679+13:3292:x1873345654969216:12345-0@lo:103:ldlm_bl.0 Request processed in 2553us (2776us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.649433:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8819 00000100:00100000:1.0:1786562812.649473:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654969216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562812.653403:0:41684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41684:1873345654969728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.653547:0:41684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.653654:0:41684:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983317240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562812.653916:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969728 00000100:00100000:0.0:1786562812.653927:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969728 00000100:00100000:0.0:1786562812.654416:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1786562812.654430:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:41684:x1873345654969728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562812.654930:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:41684:x1873345654969728:12345-0@lo:502:llog_process_th.0 Request processed in 501us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.654941:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1786562812.655444:0:41684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41684:1873345654969728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786562812.655493:0:41684:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786562812.655507:0:41684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786562812.655511:0:41684:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre-MDT0000-m add lustre.test_204f.lustre-OST0000_UUID 00000020:00000080:3.0:1786562812.655516:0:41684:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1786562812.655540:0:41684:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to test_204f as member 1 00000020:01000000:3.0:1786562812.657402:0:41684:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786562812.657415:0:41684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786562812.657416:0:41684:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre-MDT0000-m add lustre.test_204f.lustre-OST0000_UUID 00000020:01000000:3.0:1786562812.657420:0:41684:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786562812.657427:0:41684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786562812.657428:0:41684:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-MDT0000-m add lustre.test_204f.lustre-OST0001_UUID 00000020:00000080:3.0:1786562812.657432:0:41684:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1786562812.657450:0:41684:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to test_204f as member 2 00000100:00100000:3.0:1786562812.657824:0:41684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41684:1873345654969856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.657944:0:41684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.658053:0:41684:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99829de40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.658145:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969856 00000100:00100000:1.0:1786562812.658155:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969856 00000100:00100000:1.0:1786562812.658236:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1786562812.658248:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:41684:x1873345654969856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562812.658592:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:41684:x1873345654969856:12345-0@lo:502:llog_process_th.0 Request processed in 346us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.658601:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1786562812.658974:0:41684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41684:1873345654969856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786562812.659048:0:41684:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786562812.659056:0:41684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786562812.659058:0:41684:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-MDT0000-m add lustre.test_204f.lustre-OST0001_UUID 00000040:00080000:3.0:1786562812.659063:0:41684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1786562812.659395:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 40-45 (rc=0) 10000000:01000000:1.0:1786562812.659432:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786562812.659444:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.659458:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562812.659470:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786562812.659474:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e988fe0000 from 45 10000000:01000000:1.0:1786562812.659477:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786562812.659514:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.659523:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.659534:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562812.659560:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562812.659610:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562812.659653:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.659756:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654969984 00000100:00100000:3.0:1786562812.659774:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654969984 00000100:00100000:3.0:1786562812.659824:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1786562812.659833:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654969984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.659847:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562812.659866:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14b9 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.659894:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.659906:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.659916:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267800, rc 0) 00000100:00100000:3.0:1786562812.659966:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654969984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.659973:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1786562812.660124:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654969984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562812.660139:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.660148:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.660222:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.660257:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.660283:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.660296:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970112 00000100:00100000:2.0:1786562812.660300:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970112 00000020:01000004:0.0:1786562812.660645:0:41685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e8812d5800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786562812.660651:0:41685:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e8812d5800 4 00000100:00100000:2.0:1786562812.669280:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1786562812.669317:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654970112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.669775:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654970112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 464us (9502us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.669785:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1786562812.670040:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.670120:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.670209:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.670248:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99829d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562812.670421:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970240 00000100:00100000:0.0:1786562812.670430:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970240 00000100:00100000:0.0:1786562812.670487:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1786562812.670497:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654970240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.670702:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654970240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.670711:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1786562812.670808:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.673509:0:41686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41686:1873345654970368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.673623:0:41686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.673717:0:41686:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99829d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562812.676410:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970368 00000100:00100000:0.0:1786562812.676432:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970368 00000100:00100000:1.0:1786562812.676890:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1786562812.676904:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:41686:x1873345654970368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562812.677372:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:41686:x1873345654970368:12345-0@lo:502:llog_process_th.0 Request processed in 470us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.677383:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1786562812.677606:0:41686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41686:1873345654970368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.677695:0:41686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41686:1873345654970496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.677751:0:41686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.677800:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970496 00000100:00100000:2.0:1786562812.677806:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970496 00000100:00100000:2.0:1786562812.677845:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1786562812.677854:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:41686:x1873345654970496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.677999:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:41686:x1873345654970496:12345-0@lo:502:llog_process_th.0 Request processed in 145us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.678040:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1786562812.678086:0:41686:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.678101:0:41686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41686:1873345654970496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.678137:0:41686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41686:1873345654970624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.678273:0:41686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.678296:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970624 00000100:00100000:2.0:1786562812.678300:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970624 00000100:00100000:2.0:1786562812.678319:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1786562812.678326:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:41686:x1873345654970624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.678433:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:41686:x1873345654970624:12345-0@lo:502:llog_process_th.0 Request processed in 106us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.678440:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1786562812.678469:0:41686:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.678482:0:41686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41686:1873345654970624:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786562812.678502:0:41686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1786562812.678922:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-51 (rc=0) 10000000:01000000:0.0:1786562812.678953:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786562812.678966:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.678979:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562812.678990:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1786562812.678993:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1786562812.678996:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786562812.679053:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.679064:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562812.679076:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562812.679095:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.679137:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562812.679174:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e991e87cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.679333:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970752 00000100:00100000:3.0:1786562812.679340:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970752 00000100:00100000:3.0:1786562812.679386:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1786562812.679395:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654970752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.679408:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562812.679429:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14c7 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.679461:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 15 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.679473:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 15 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.679484:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267200, rc 0) 00000100:00100000:3.0:1786562812.679525:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654970752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.679532:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1786562812.679572:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.679590:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.679600:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.679659:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.679687:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.679701:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99042a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.679712:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654970880 00000100:00100000:3.0:1786562812.679715:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654970880 00000100:00100000:3.0:1786562812.679733:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1786562812.679739:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654970880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.680085:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654970880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.680093:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1786562812.680126:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654970880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.680443:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.680492:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.680527:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99042a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.680600:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971008 00000100:00100000:1.0:1786562812.680607:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971008 00000100:00100000:1.0:1786562812.680647:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1786562812.680657:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654971008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562812.680867:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654971008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.680874:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1786562812.681146:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786562812.682615:0:41687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1786562812.682887:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786562812.682917:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786562812.682931:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.682952:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.682973:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562812.682976:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e98318c000 from 45 10000000:01000000:3.0:1786562812.682980:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562812.683061:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.683069:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.683081:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.683114:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.683335:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.683387:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.683750:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971136 00000100:00100000:1.0:1786562812.683760:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971136 00000100:00100000:1.0:1786562812.683838:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1786562812.683850:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654971136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562812.683869:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562812.683886:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14d5 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.683915:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 16 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.683930:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 16 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.683939:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556600, rc 0) 00000100:00100000:1.0:1786562812.684026:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654971136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.684035:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1786562812.684376:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.684395:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.684405:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.684478:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.684513:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.684546:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.684589:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971264 00000100:00100000:2.0:1786562812.684595:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971264 00000100:00100000:2.0:1786562812.684629:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1786562812.684636:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654971264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.685076:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654971264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.685084:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1786562812.685445:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.685488:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.685543:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.685578:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562812.685753:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971392 00000100:00100000:0.0:1786562812.685760:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971392 00000100:00100000:0.0:1786562812.685821:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1786562812.685831:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654971392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562812.686101:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654971392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562812.686113:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1786562812.686239:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.687668:0:41688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41688:1873345654971520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.687773:0:41688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.687823:0:41688:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.687874:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971520 00000100:00100000:1.0:1786562812.687883:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971520 00000100:00100000:1.0:1786562812.687938:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1786562812.687950:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:41688:x1873345654971520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562812.688556:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:41688:x1873345654971520:12345-0@lo:502:llog_process_th.0 Request processed in 606us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.688567:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1786562812.688674:0:41688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41688:1873345654971520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.688737:0:41688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41688:1873345654971648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.688785:0:41688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.688825:0:41688:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.688871:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971648 00000100:00100000:2.0:1786562812.688876:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971648 00000100:00100000:2.0:1786562812.688917:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1786562812.688927:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:41688:x1873345654971648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.689114:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:41688:x1873345654971648:12345-0@lo:502:llog_process_th.0 Request processed in 189us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.689121:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1786562812.689471:0:41688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41688:1873345654971648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.689515:0:41688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41688:1873345654971776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562812.689554:0:41688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.689581:0:41688:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562812.689628:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971776 00000100:00100000:2.0:1786562812.689633:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971776 00000100:00100000:2.0:1786562812.689669:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1786562812.689677:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:41688:x1873345654971776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562812.689828:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:41688:x1873345654971776:12345-0@lo:502:llog_process_th.0 Request processed in 152us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562812.689836:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1786562812.689911:0:41688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:41688:1873345654971776:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786562812.689931:0:41688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1786562812.690276:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-51 (rc=0) 10000000:01000000:2.0:1786562812.690304:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786562812.690318:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.690330:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562812.690341:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786562812.690345:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1786562812.690348:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786562812.690383:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.690392:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.690403:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.690420:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.690455:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.690482:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.690555:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654971904 00000100:00100000:1.0:1786562812.690561:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654971904 00000100:00100000:1.0:1786562812.690601:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1786562812.690609:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654971904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562812.690620:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562812.690636:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14e3 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.690661:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 17 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.690678:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 17 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.690688:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557a00, rc 0) 00000100:00100000:1.0:1786562812.690722:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654971904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.690728:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1786562812.690809:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654971904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562812.690823:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.690832:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562812.690885:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.690914:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.690935:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562812.690987:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972032 00000100:00100000:3.0:1786562812.690992:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972032 00000100:00100000:3.0:1786562812.691044:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1786562812.691051:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654972032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.691344:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654972032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.691355:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1786562812.691465:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.691497:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562812.691541:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562812.691563:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.691688:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972160 00000100:00100000:1.0:1786562812.691693:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972160 00000100:00100000:1.0:1786562812.691726:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1786562812.691734:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654972160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562812.691923:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654972160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562812.691930:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1786562812.692078:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786562812.693664:0:41689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1786562812.694413:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1786562812.694450:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786562812.694466:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562812.694481:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562812.694556:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1786562812.694560:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90e9a99d4d40 from 1 10000000:01000000:3.0:1786562812.694564:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786562812.694622:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.694631:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.694644:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.694676:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.694776:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562812.694872:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.694916:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972288 00000100:00100000:1.0:1786562812.694925:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972288 00000100:00100000:1.0:1786562812.695911:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1786562812.695931:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654972288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562812.695954:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562812.695988:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14f1 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.696048:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.696062:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562812.696077:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557600, rc 0) 00000100:00100000:1.0:1786562812.696155:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654972288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562812.696297:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562812.696322:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.696333:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562812.696429:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562812.696473:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562812.696542:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1786562812.696741:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562812.696860:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972416 00000100:00100000:1.0:1786562812.696867:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972416 00000100:00100000:1.0:1786562812.696896:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1786562812.696905:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654972416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562812.697280:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654972416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (806us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786562812.697289:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1786562812.697491:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1786562812.697531:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786562812.697542:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.697553:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562812.709449:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562813.733146:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786562813.800070:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562813.800079:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e8812d5800 from 52 10000000:01000000:3.0:1786562813.800084:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562813.800146:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562813.800159:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562813.800170:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562813.800199:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562813.800285:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562813.800351:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99823f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562813.801367:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972544 00000100:00100000:0.0:1786562813.801378:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972544 00000100:00100000:0.0:1786562813.801447:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1786562813.801458:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654972544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562813.801481:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562813.801497:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a14ff expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.801523:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 19 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.801535:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 19 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.801545:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268c00, rc 0) 00000100:00100000:0.0:1786562813.801610:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654972544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562813.801617:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1786562813.801672:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562813.801689:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.801699:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562813.801775:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562813.801817:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562813.801843:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972672 00000100:00100000:0.0:1786562813.801847:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972672 00000100:00100000:0.0:1786562813.801872:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1786562813.801879:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654972672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562813.802172:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654972672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562813.802179:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1786562813.802215:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98246bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562813.802227:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562813.802256:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562813.802297:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562813.802321:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baeb6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562813.802350:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654972800 00000100:00100000:3.0:1786562813.802355:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654972800 00000100:00100000:3.0:1786562813.802387:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1786562813.802395:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654972800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562813.802543:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654972800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562813.802551:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1786562813.802588:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654972800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786562813.811759:0:41698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1786562813.811977:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1786562813.811999:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786562813.812038:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562813.812054:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562813.945406:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562813.945477:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005440 00000100:00100000:0.0:1786562813.945489:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005440 00000100:00100000:0.0:1786562813.945551:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 430 00000100:00100000:0.0:1786562813.945562:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+8:41781:x1873345653005440:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562813.945580:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562813.945609:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd736 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.945647:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.945660:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562813.945671:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb269c00, rc 0) 00000100:00100000:0.0:1786562813.945755:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653005440:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 175us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562813.945763:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 430 00000100:00100000:1.0:1786562813.954047:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562813.954107:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005568 00000100:00100000:0.0:1786562813.954117:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005568 00000100:00100000:0.0:1786562813.954174:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 431 00000100:00100000:0.0:1786562813.954183:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653005568:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562813.954648:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653005568:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 464us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562813.954657:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 431 00000100:00100000:0.0:1786562813.960829:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562813.961409:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005696 00000100:00100000:2.0:1786562813.961423:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005696 00000100:00100000:2.0:1786562813.961570:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 432 00000100:00100000:2.0:1786562813.961583:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653005696:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562813.961917:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653005696:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 336us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562813.961926:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 432 00000100:00100000:2.0:1786562813.974463:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562813.974777:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005824 00000100:00100000:0.0:1786562813.974791:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005824 00000100:00100000:0.0:1786562813.974901:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 433 00000100:00100000:0.0:1786562813.974914:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:71827:x1873345653005824:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786562813.975360:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:71827:x1873345653005824:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 448us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562813.975370:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 433 00000100:00100000:2.0:1786562813.986304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562813.986492:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653005952 00000100:00100000:3.0:1786562813.986506:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653005952 00000100:00100000:3.0:1786562813.986576:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 434 00000100:00100000:3.0:1786562813.986587:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:71827:x1873345653005952:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786562813.986915:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:71827:x1873345653005952:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 328us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562813.986925:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 434 00000100:00100000:1.0:1786562813.990077:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562813.990259:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006080 00000100:00100000:3.0:1786562813.990272:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006080 00000100:00100000:3.0:1786562813.990341:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 435 00000100:00100000:3.0:1786562813.990354:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:71827:x1873345653006080:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786562813.990688:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:71827:x1873345653006080:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 336us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562813.990698:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 435 00000100:00100000:1.0:1786562814.001412:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562814.001635:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006208 00000100:00100000:3.0:1786562814.001650:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006208 00000100:00100000:3.0:1786562814.001861:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 436 00000100:00100000:3.0:1786562814.001874:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653006208:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562814.001902:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562814.001931:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd73d expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.001972:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 10 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.001987:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 10 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.001997:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266e00, rc 0) 00000100:00100000:3.0:1786562814.002135:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653006208:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 264us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562814.002143:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 436 00000100:00100000:1.0:1786562814.005528:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562814.005629:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006336 00000100:00100000:0.0:1786562814.005642:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006336 00000100:00100000:0.0:1786562814.005713:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 437 00000100:00100000:0.0:1786562814.005727:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653006336:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562814.006352:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653006336:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 625us (910us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786562814.006365:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 437 00000100:00100000:1.0:1786562814.264859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562814.264915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562814.264969:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562814.265043:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562814.265048:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006592 00000100:00100000:0.0:1786562814.265062:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006592 00000100:00100000:1.0:1786562814.265073:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006848 00000100:00100000:1.0:1786562814.265076:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006848 00000100:00100000:1.0:1786562814.265134:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006720 00000100:00100000:1.0:1786562814.265137:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006720 00000100:00100000:0.0:1786562814.265139:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 485 00000100:00100000:0.0:1786562814.265151:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345653006592:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562814.265160:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 593 00000100:00100000:1.0:1786562814.265167:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653006848:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:2.0:1786562814.265255:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562814.265261:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562814.265264:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562814.265280:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 594 00000100:00100000:2.0:1786562814.265291:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653006720:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562814.265390:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006464 00000100:00100000:3.0:1786562814.265395:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006464 00000100:00100000:1.0:1786562814.265610:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653006848:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 442us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562814.265620:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 593 00000100:00100000:3.0:1786562814.267061:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 438 00000100:00100000:3.0:1786562814.267083:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653006464:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562814.267175:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653006464:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562814.267183:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 438 00000100:00100000:0.0:1786562814.273364:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+18:2348:x1873345653006592:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 8193us (8500us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562814.273387:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 485 00000100:00100000:2.0:1786562814.276344:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653006720:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 11038us (11281us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562814.276366:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 594 00010000:00010000:2.0:1786562814.758769:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562814.863927:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562814.865562:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653006976 00000100:00100000:0.0:1786562814.865579:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653006976 00000100:00100000:0.0:1786562814.865750:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17478 00000100:00100000:0.0:1786562814.865763:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+18:71837:x1873345653006976:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562814.865791:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562814.865823:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a151b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd744 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.865937:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1522 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.865954:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.865967:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562814.867713:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1786562814.867735:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 44 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562814.867970:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.868056:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268e00/0x5c655bf6668a151b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd744 expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.868082:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd744 expref: 19 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.868092:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562814.868095:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562814.868100:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9bb268a00, rc 0) 00000100:00100000:0.0:1786562814.868213:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:71837:x1873345653006976:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2450us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562814.868224:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17478 00000100:00100000:1.0:1786562814.870697:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562814.871802:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653007104 00000100:00100000:2.0:1786562814.871820:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653007104 00000100:00100000:0.0:1786562814.871919:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17479 00000100:00100000:0.0:1786562814.871945:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+19:71837:x1873345653007104:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562814.871980:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562814.872056:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a1529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd74b expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.872156:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.872173:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.872186:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.872213:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.872220:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.872227:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873309:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6dc00/0x5c655bf6668a153e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873465:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6dc00/0x5c655bf6668a153e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873477:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6dc00/0x5c655bf6668a153e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562814.873584:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ef:0x0]: returning size 7680 00000004:00200000:0.0:1786562814.873589:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562814.873814:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6dc00/0x5c655bf6668a153e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873832:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873840:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873847:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873858:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562814.873864:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873872:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873889:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562814.873893:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562814.873899:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873905:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269a00/0x5c655bf6668a1530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873923:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873929:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873949:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873954:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb268600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562814.873958:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873964:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873977:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4b5033f (ffff90e9b46ab700) 00010000:00010000:0.0:1786562814.873980:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562814.873983:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.873989:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268600/0x5c655bf6668a1537 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4b5033f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.874281:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb269200/0x5c655bf6668a1529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd74b expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.874299:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6dc00/0x5c655bf6668a153e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd74b expref: 20 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.874307:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562814.874310:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786562814.874312:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6dc00, rc 0) 00000100:00100000:0.0:1786562814.876797:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:71837:x1873345653007104:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4852us (6100us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562814.876813:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17479 00000100:00100000:1.0:1786562814.882948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562814.883304:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653007232 00000100:00100000:3.0:1786562814.884184:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653007232 00000100:00100000:3.0:1786562814.884293:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17480 00000100:00100000:3.0:1786562814.884306:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:71837:x1873345653007232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562814.884348:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562814.884859:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a1545 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd752 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.885523:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.885544:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.885558:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.885579:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.885587:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.885594:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886815:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886832:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886841:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886849:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562814.886856:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886865:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886886:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562814.886890:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.886896:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886904:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a154c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886939:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886947:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886954:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886960:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562814.886963:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886970:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886978:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1900) 00010000:00010000:3.0:1786562814.886981:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.886992:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.886998:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1553 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.887592:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a1545 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd752 expref: 21 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.887734:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562814.887739:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.887745:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a1545 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd752 expref: 21 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.887756:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267400, rc 0) 00000100:00100000:3.0:1786562814.887941:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:71837:x1873345653007232:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3629us (5017us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562814.887953:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17480 00000100:00100000:1.0:1786562814.900621:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562814.900826:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653007360 00000100:00100000:0.0:1786562814.900841:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653007360 00000100:00100000:0.0:1786562814.900928:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17481 00000100:00100000:0.0:1786562814.900950:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:71837:x1873345653007360:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562814.900979:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562814.901062:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a155a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd759 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.901171:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.901189:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.901203:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.901222:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.901230:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.901237:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.903929:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.903958:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.903967:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.903974:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562814.903979:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904167:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904189:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562814.904193:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562814.904200:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904207:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a1561 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904226:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904234:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904241:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904245:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562814.904249:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904255:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904264:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b46ab700) 00010000:00010000:1.0:1786562814.904267:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562814.904270:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904276:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1568 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904630:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a155a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd759 expref: 21 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904644:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562814.904646:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562814.904650:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a155a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd759 expref: 21 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562814.904669:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d800, rc 0) 00000100:00100000:1.0:1786562814.904786:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:71837:x1873345653007360:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3837us (4177us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562814.904797:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17481 00000100:00100000:1.0:1786562814.915223:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562814.915671:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653007488 00000100:00100000:0.0:1786562814.915688:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653007488 00000100:00100000:0.0:1786562814.915787:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17482 00000100:00100000:0.0:1786562814.915810:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:71837:x1873345653007488:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562814.915838:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562814.915863:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a156f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd760 expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.916620:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1576 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.916646:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.916659:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562814.916954:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ef:0x0]: returning size 7680 00000004:00200000:0.0:1786562814.916959:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562814.918640:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.918711:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a156f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd760 expref: 22 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.918751:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1576 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd760 expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.918760:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562814.918763:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786562814.918767:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6ce00, rc 0) 00000100:00100000:0.0:1786562814.918866:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:71837:x1873345653007488:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3066us (3656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562814.918877:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17482 00000100:00100000:0.0:1786562814.927635:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562814.927792:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653007616 00000100:00100000:3.0:1786562814.927803:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653007616 00000100:00100000:3.0:1786562814.927870:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17483 00000100:00100000:3.0:1786562814.927883:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:71837:x1873345653007616:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562814.927905:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562814.927939:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a157d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd767 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928070:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928089:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928100:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928127:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928134:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928140:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928715:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928735:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928743:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928749:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562814.928753:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928761:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928776:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562814.928780:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.928784:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928790:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267000/0x5c655bf6668a1584 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928803:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928809:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928814:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928819:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562814.928822:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928829:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928837:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1900) 00010000:00010000:3.0:1786562814.928839:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.928842:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928848:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a158b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928890:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a157d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd767 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928902:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562814.928905:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.928908:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a157d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd767 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.928918:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267400, rc 0) 00000100:00100000:3.0:1786562814.929235:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:71837:x1873345653007616:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1353us (1608us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562814.929244:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17483 00000100:00100000:1.0:1786562814.938161:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562814.938482:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653007872 00000100:00100000:3.0:1786562814.938503:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653007872 00000100:00100000:3.0:1786562814.938576:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17484 00000100:00100000:3.0:1786562814.938587:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+21:71837:x1873345653007872:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562814.938611:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562814.938623:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562814.938660:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1576 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd760 expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.938681:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562814.938694:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562814.938710:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1592 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd76e expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.939467:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.939496:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.939515:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.939537:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.939544:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.939551:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947165:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947188:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947200:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562814.947213:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 0 00010000:00010000:3.0:1786562814.947244:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947264:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947273:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947280:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562814.947284:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947292:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947304:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562814.947307:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.947312:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947504:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1599 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562814.947519:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef1c88d4 reply state 000000009e764bf3 transno 8589950869 ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562814.947529:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786562814.947569:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1592 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947591:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.947600:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:3.0:1786562814.947602:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562814.947605:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267400, rc 0) 00000100:00100000:3.0:1786562814.947681:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71837:x1873345653007872:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 9096us (9529us total) trans 8589950869 rc 0/0 00000100:00100000:3.0:1786562814.947692:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17484 00010000:00010000:3.0:1786562814.950426:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.950444:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.950452:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.950458:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562814.950463:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.950470:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.950487:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1700) 00010000:00010000:3.0:1786562814.950490:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562814.950494:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562814.950499:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a15a0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562814.952606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562814.952710:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653008128 00000100:00100000:2.0:1786562814.952731:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653008128 00000100:00100000:2.0:1786562814.952797:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17485 00000100:00100000:2.0:1786562814.952809:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:71837:x1873345653008128:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562814.952835:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562814.952857:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a15b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd775 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.952975:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.952990:0:33114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.952999:0:33114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.953285:0:33114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.953301:0:33114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 23 pid: 34450 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562814.953830:0:33114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654972928:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562814.953947:0:33114:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882114780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562814.961135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562814.961498:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653008256 00000100:00100000:0.0:1786562814.961507:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653008256 00010000:00010000:0.0:1786562814.961549:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 24 pid: 34450 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562814.961593:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8820 00000100:00100000:0.0:1786562814.961603:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345653008256:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562814.961619:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562814.961626:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 24 pid: 34450 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.961640:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 24 pid: 34450 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.961664:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:0.0:1786562814.961671:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.961693:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.961701:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562814.961731:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562814.961790:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345653008256:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 187us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562814.961798:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8820 00010000:00010000:2.0:1786562814.962541:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267400/0x5c655bf6668a15a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd76e expref: 23 pid: 34450 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562814.962560:0:33114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:33114:1873345654972928:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562814.962583:0:33114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.962593:0:33114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.962599:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562814.962621:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 0 00000004:00080000:2.0:1786562814.963062:0:33114:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x743:0x0], index 0: 0 00000004:00080000:2.0:1786562814.963075:0:33114:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x727:0x0], index 1: 0 00010000:00010000:2.0:1786562814.963852:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963865:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963872:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963878:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562814.963882:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963889:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963905:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:2.0:1786562814.963907:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562814.963911:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963917:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a15bc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963976:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a15b5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd775 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.963985:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562814.963988:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562814.963992:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a15b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd775 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562814.964000:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562814.964540:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:71837:x1873345653008128:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11731us (11941us total) trans 8589950870 rc 301/301 00000100:00100000:2.0:1786562814.964550:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17485 00000100:00100000:1.0:1786562814.988621:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562814.988775:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653008512 00000100:00100000:3.0:1786562814.988793:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653008512 00000100:00100000:3.0:1786562814.988960:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6354 00000100:00100000:3.0:1786562814.988974:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:71837:x1873345653008512:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1786562814.990831:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:71837:x1873345653008512:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1845us (2208us total) trans 8589950871 rc 0/0 00000100:00100000:0.0:1786562814.990850:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6354 00000100:00100000:1.0:1786562814.995144:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562814.995343:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653008768 00000100:00100000:2.0:1786562814.995534:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653008768 00000100:00100000:2.0:1786562814.995610:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6355 00000100:00100000:2.0:1786562814.995623:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:71837:x1873345653008768:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562814.996265:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:71837:x1873345653008768:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 641us (1133us total) trans 8589950872 rc 0/0 00000100:00100000:2.0:1786562814.996276:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6355 00000100:00100000:1.0:1786562815.270435:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654973056:0@lo:400:kworker.0 00000100:00100000:1.0:1786562815.270548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562815.270626:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654973568:0@lo:400:kworker.0 00000100:00100000:1.0:1786562815.270660:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562815.270694:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786562815.270700:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654973184:0@lo:400:kworker.0 00000100:00100000:1.0:1786562815.270745:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562815.270763:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9916fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654973696:0@lo:400:kworker.0 00000100:00100000:1.0:1786562815.270785:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562815.270822:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654973440:0@lo:400:kworker.0 00000100:00100000:1.0:1786562815.270849:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562815.270872:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562815.270878:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654973312:0@lo:400:kworker.0 00000100:00100000:1.0:1786562815.270899:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562815.270933:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973568 00000100:00100000:1.0:1786562815.270942:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973568 00000100:00100000:0.0:1786562815.273357:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973056 00000100:00100000:0.0:1786562815.273379:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973056 00000100:00100000:0.0:1786562815.273445:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1786562815.273457:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654973056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.273601:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654973056:12345-0@lo:400:kworker.0 Request processed in 146us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.273610:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1786562815.273689:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654973056:0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.273736:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973184 00000100:00100000:0.0:1786562815.273741:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973184 00000100:00100000:0.0:1786562815.273780:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973696 00000100:00100000:0.0:1786562815.273784:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973696 00000100:00100000:0.0:1786562815.273806:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973312 00000100:00100000:0.0:1786562815.273810:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973312 00000100:00100000:0.0:1786562815.273834:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1786562815.273849:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654973184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.273896:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654973184:12345-0@lo:400:kworker.0 Request processed in 54us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.273904:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1786562815.273917:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1786562815.273924:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654973696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.273956:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654973696:12345-0@lo:400:kworker.0 Request processed in 32us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.273964:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1786562815.273980:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1786562815.273988:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654973312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.274049:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345654973312:12345-0@lo:400:kworker.0 Request processed in 63us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.274056:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1786562815.274097:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654973184:0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.274114:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9916fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654973696:0@lo:400:kworker.0 00000100:00100000:2.0:1786562815.274188:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654973824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562815.274243:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786562815.274393:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562815.274400:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562815.274422:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973440 00000100:00100000:0.0:1786562815.274427:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973440 00000100:00100000:2.0:1786562815.274471:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973824 00000100:00100000:0.0:1786562815.274476:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1786562815.274477:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973824 00000100:00100000:0.0:1786562815.274488:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654973568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562815.274524:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1786562815.274534:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654973824:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562815.274543:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654973568:12345-0@lo:400:kworker.0 Request processed in 57us (3880us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.274551:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00002000:00000024:2.0:1786562815.274569:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562815.274570:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1786562815.274582:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654973440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562815.274622:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654973824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.274631:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654973440:12345-0@lo:400:kworker.0 Request processed in 51us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562815.274632:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1786562815.274643:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00080000:0.0:1786562815.274673:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562815.274701:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98873ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654973568:0@lo:400:kworker.0 00000100:00100000:2.0:1786562815.274724:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654973824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562815.274964:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654973952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562815.274997:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562815.275296:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345654973312:0@lo:400:kworker.0 00000100:00100000:2.0:1786562815.275309:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654973440:0@lo:400:kworker.0 00000100:00100000:0.0:1786562815.279808:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654973952 00000100:00100000:0.0:1786562815.279830:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654973952 00000100:00100000:0.0:1786562815.279897:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1786562815.279911:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654973952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562815.279964:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562815.284268:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654973952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4344us (9254us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562815.284291:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1786562815.284942:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654973952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562815.782122:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562816.406427:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950872 is committed 00010000:00010000:2.0:1786562816.815889:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562817.831466:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562818.855276:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562819.390555:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562819.390659:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562819.390716:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562819.390759:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562819.390864:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009280 00000100:00100000:3.0:1786562819.390879:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009280 00000100:00100000:3.0:1786562819.390959:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009152 00000100:00100000:3.0:1786562819.390963:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009152 00000100:00100000:3.0:1786562819.390995:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 597 00000100:00100000:3.0:1786562819.391051:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653009280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562819.391150:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653009280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 144us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562819.391158:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 597 00000100:00100000:3.0:1786562819.391178:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 598 00000100:00100000:3.0:1786562819.391184:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653009152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562819.391211:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653009152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562819.391217:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 598 00000100:00080000:1.0:1786562819.391291:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562819.391297:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562819.391927:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653008896 00000100:00100000:0.0:1786562819.391936:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653008896 00000100:00100000:0.0:1786562819.391993:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 440 00000100:00100000:0.0:1786562819.392001:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653008896:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562819.392099:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653008896:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 100us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562819.392106:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 440 00000100:00100000:2.0:1786562819.393685:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009024 00000100:00100000:2.0:1786562819.393704:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009024 00000100:00100000:2.0:1786562819.393814:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 489 00000100:00100000:2.0:1786562819.393826:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345653009024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562819.393928:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+20:2349:x1873345653009024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 104us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562819.393935:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 489 00000100:00080000:0.0:1786562819.397618:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562819.878767:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562820.389681:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654974080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562820.389789:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562820.389870:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562820.389982:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c69b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654974208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562820.390034:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562820.393865:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974080 00000100:00100000:0.0:1786562820.393884:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974080 00000100:00100000:1.0:1786562820.393973:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654974464:0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.393983:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974208 00000100:00100000:0.0:1786562820.393994:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974208 00000100:00100000:0.0:1786562820.394041:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1786562820.394054:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654974080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562820.394085:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1786562820.394108:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:1.0:1786562820.394149:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562820.394161:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654974336:0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.394199:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98873ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654974080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (4406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562820.394209:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1786562820.394216:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562820.394241:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1786562820.394254:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9916fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654974208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562820.394282:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654974592:0@lo:400:kworker.0 00002000:00000024:0.0:1786562820.394292:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:1.0:1786562820.394316:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562820.394350:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9916fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654974208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (4313us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562820.394358:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1786562820.394386:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c69b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654974208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562820.394420:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b46e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654974080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786562820.394423:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562820.394429:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562820.394451:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562820.394455:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974336 00000100:00100000:0.0:1786562820.394461:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974336 00000100:00100000:1.0:1786562820.394462:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654974720:0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.394506:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1786562820.394514:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562820.394520:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654974336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562820.394564:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974464 00000100:00100000:1.0:1786562820.394571:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974464 00000100:00100000:0.0:1786562820.394582:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654974336:12345-0@lo:400:kworker.0 Request processed in 64us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562820.394590:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1786562820.394653:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974592 00000100:00100000:1.0:1786562820.394660:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974592 00000100:00100000:1.0:1786562820.394699:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1786562820.394709:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654974336:0@lo:400:kworker.0 00000100:00100000:1.0:1786562820.394713:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654974464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562820.394788:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654974464:12345-0@lo:400:kworker.0 Request processed in 80us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562820.394800:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1786562820.395322:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974720 00000100:00100000:0.0:1786562820.395330:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974720 00000100:00100000:0.0:1786562820.395366:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1786562820.395375:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654974592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.395502:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654974592:12345-0@lo:400:kworker.0 Request processed in 127us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562820.395510:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1786562820.395586:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786562820.395595:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654974720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.395649:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654974720:12345-0@lo:400:kworker.0 Request processed in 54us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562820.395660:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00080000:0.0:1786562820.395707:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562820.395863:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654974464:0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.396116:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654974720:0@lo:400:kworker.0 00000100:00100000:0.0:1786562820.396131:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654974592:0@lo:400:kworker.0 00010000:00010000:3.0:1786562820.901900:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562821.927267:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562822.949758:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562823.973286:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562824.504304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562824.504414:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562824.504457:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562824.504496:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562824.504553:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009408 00000100:00100000:2.0:1786562824.504563:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009408 00000100:00100000:3.0:1786562824.504584:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009792 00000100:00100000:3.0:1786562824.504591:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009792 00000100:00100000:2.0:1786562824.504623:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 442 00000100:00100000:2.0:1786562824.504634:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345653009408:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562824.504639:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009664 00000100:00100000:3.0:1786562824.504644:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009664 00000100:00100000:3.0:1786562824.504674:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 599 00000100:00100000:3.0:1786562824.504684:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345653009792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562824.504707:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2351:x1873345653009408:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562824.504717:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 442 00000100:00100000:3.0:1786562824.504737:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345653009792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562824.504745:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 599 00000100:00100000:2.0:1786562824.504756:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 600 00000100:00100000:2.0:1786562824.504767:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345653009664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562824.504797:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345653009664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562824.504804:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 600 00000100:00080000:1.0:1786562824.504885:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562824.504890:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562824.510132:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653009536 00000100:00100000:0.0:1786562824.510150:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653009536 00000100:00100000:0.0:1786562824.510334:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 493 00000100:00100000:0.0:1786562824.510346:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345653009536:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562824.510445:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+20:2351:x1873345653009536:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 100us (6151us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562824.510452:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 493 00000100:00080000:1.0:1786562824.510575:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562824.999719:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562825.509294:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654975232:0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.509307:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654975104:0@lo:400:kworker.0 00000100:00100000:3.0:1786562825.509420:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654974848:0@lo:400:kworker.0 00000100:00100000:2.0:1786562825.509527:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654974976:0@lo:400:kworker.0 00000100:00100000:0.0:1786562825.512429:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562825.513651:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975232 00000100:00100000:0.0:1786562825.513663:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975232 00000100:00100000:0.0:1786562825.513751:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1786562825.513761:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654975232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562825.513838:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654975232:12345-0@lo:400:kworker.0 Request processed in 78us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562825.513845:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00080000:0.0:1786562825.513869:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562825.513903:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654975232:0@lo:400:kworker.0 00000100:00100000:0.0:1786562825.513997:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654975744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562825.514047:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562825.514082:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975744 00000100:00100000:0.0:1786562825.514086:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975744 00000100:00100000:0.0:1786562825.514437:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1786562825.514446:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654975744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562825.514477:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520552448 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562825.514530:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654975744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562825.514536:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1786562825.514650:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654975744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562825.515839:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562825.515882:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654975616:0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.515912:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562825.515945:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975104 00000100:00100000:1.0:1786562825.515951:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975104 00000100:00100000:1.0:1786562825.515990:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975616 00000100:00100000:1.0:1786562825.515993:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975616 00000100:00100000:1.0:1786562825.516025:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1786562825.516033:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654975104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.516075:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654975104:12345-0@lo:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562825.516082:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1786562825.516097:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1786562825.516103:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654975616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.516125:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654975616:12345-0@lo:400:kworker.0 Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562825.516131:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00080000:1.0:1786562825.516150:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562825.516170:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654975104:0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.516178:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654975616:0@lo:400:kworker.0 00000100:00100000:3.0:1786562825.528130:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562825.528139:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562825.528230:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974976 00000100:00100000:1.0:1786562825.528239:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974976 00000100:00100000:3.0:1786562825.528266:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654975488:0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.528304:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1786562825.528316:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562825.528328:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654974976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562825.528349:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975488 00000100:00100000:3.0:1786562825.528354:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975488 00000100:00100000:3.0:1786562825.528394:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1786562825.528398:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654974976:12345-0@lo:400:kworker.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562825.528405:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654975488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.528410:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1786562825.528442:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654974848 00000100:00100000:1.0:1786562825.528447:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654974848 00000100:00100000:3.0:1786562825.528452:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654975488:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562825.528462:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1786562825.528483:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1786562825.528493:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654974848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562825.528520:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654975488:0@lo:400:kworker.0 00000100:00100000:1.0:1786562825.528542:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654974848:12345-0@lo:400:kworker.0 Request processed in 50us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562825.528550:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00080000:1.0:1786562825.528578:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786562825.528582:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562825.528632:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654974848:0@lo:400:kworker.0 00000100:00100000:2.0:1786562825.528913:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654974976:0@lo:400:kworker.0 00000100:00100000:2.0:1786562825.528921:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654975360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562825.529041:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562825.529159:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975360 00000100:00100000:3.0:1786562825.529164:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975360 00000100:00100000:3.0:1786562825.529250:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1786562825.529259:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654975360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562825.529288:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562825.529628:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654975360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 369us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562825.529635:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1786562825.534280:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654975360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562826.021378:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562827.045328:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562828.041447:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562828.042120:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653010048 00000100:00100000:2.0:1786562828.042132:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653010048 00000100:00100000:2.0:1786562828.042219:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17486 00000100:00100000:2.0:1786562828.042230:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+20:71879:x1873345653010048:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1786562828.042253:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562828.042275:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a15ca lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd77c expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562828.043029:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562828.043490:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.043511:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.043601:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.043620:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.043628:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.043634:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044207:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a15df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044219:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a15df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044227:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a15df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562828.044240:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 0 00010000:00010000:2.0:1786562828.044372:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044380:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044386:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044392:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfdc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562828.044396:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044403:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044416:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562828.044419:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562828.044423:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044430:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfdc00/0x5c655bf6668a15d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044442:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044448:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044463:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044470:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562828.044473:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044479:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044491:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b6332800) 00010000:00010000:2.0:1786562828.044493:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562828.044496:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.044506:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a15d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.046436:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a15ca lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd77c expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.046475:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a15df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd77c expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.046486:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:2.0:1786562828.046489:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562828.046492:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd400, rc 0) 00000100:00100000:2.0:1786562828.047046:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:71879:x1873345653010048:12345-192.168.204.29@tcp:101:dd.0 Request processed in 4814us (5608us total) trans 8589950873 rc 0/0 00000100:00100000:2.0:1786562828.047056:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17486 00010000:00010000:3.0:1786562828.069385:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562828.079958:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562828.080053:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653010304 00000100:00100000:1.0:1786562828.080064:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653010304 00000100:00100000:1.0:1786562828.080127:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17487 00000100:00100000:1.0:1786562828.080136:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:71879:x1873345653010304:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:1.0:1786562828.080161:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562828.080165:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562828.080193:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd400/0x5c655bf6668a15df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd77c expref: 22 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562828.080212:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:1.0:1786562828.080225:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562828.080239:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a15ed lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd783 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562828.080294:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf6668a15f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562828.080418:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf6668a15f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562828.080430:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf6668a15f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786562828.081739:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4423, 88 off358864 00000004:00080000:1.0:1786562828.081752:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1260523745470ns, next at 1217993912197ns, rc = 0 00000040:00080000:1.0:1786562828.081807:0:33140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4453, 88 off361584 00000004:00080000:1.0:1786562828.081813:0:33140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1260523806975ns, next at 1218001025865ns, rc = 0 00000001:00080000:1.0:1786562828.200089:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950874 is committed 00000004:00080000:1.0:1786562828.200104:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2958 committed 00000004:00080000:1.0:1786562828.200113:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2928 committed 00010000:00010000:3.0:1786562828.200415:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf6668a15f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd783 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562828.200430:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562828.200433:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1786562828.200460:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a15ed lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd783 expref: 22 pid: 33140 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562828.200480:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf6668a15f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd783 expref: 21 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562828.200529:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562828.200532:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1786562828.200534:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557400, rc 0) 00000100:00100000:3.0:1786562828.200606:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+21:71879:x1873345653010304:12345-192.168.204.29@tcp:101:dd.0 Request processed in 120470us (120655us total) trans 8589950874 rc 0/0 00000100:00100000:3.0:1786562828.200615:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17487 00000100:00100000:3.0:1786562828.200663:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654975872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562828.200726:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562828.200810:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654975872 00000100:00100000:3.0:1786562828.200818:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654975872 00000100:00100000:3.0:1786562828.200878:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18016 00000100:00100000:3.0:1786562828.200887:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654975872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562828.201218:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654975872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 332us (500us total) trans 21474843680 rc 0/0 00000100:00100000:3.0:1786562828.201229:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18016 00000100:00080000:3.0:1786562828.201247:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1786562828.201302:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bc06c700/2, rc 0, transno 21474843680 00000100:00100000:3.0:1786562828.201308:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654975872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562828.206247:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654976000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562828.206333:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562828.207176:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976000 00000100:00100000:1.0:1786562828.207186:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976000 00000100:00100000:1.0:1786562828.207262:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18017 00000100:00100000:1.0:1786562828.207282:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654976000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786562828.208050:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654976000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 768us (1714us total) trans 17179876154 rc 0/0 00000100:00100000:1.0:1786562828.208061:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18017 00000100:00080000:2.0:1786562828.209236:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1786562828.209298:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e8841c1880/2, rc 0, transno 17179876154 00000100:00100000:2.0:1786562828.209309:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654976000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786562828.238141:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562828.238298:0:29461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653010432 00000100:00100000:1.0:1786562828.238316:0:29461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653010432 00000100:00100000:1.0:1786562828.238467:0:29461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11671 00000100:00100000:1.0:1786562828.238480:0:29461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653010432:12345-192.168.204.29@tcp:4:dd.0 00000100:00080000:2.0:1786562828.238629:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562828.238826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:1.0:1786562828.238990:0:29461:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786562828.239049:0:29461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562828.239214:0:16203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653010560 00000100:00100000:2.0:1786562828.239220:0:16203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653010560 00000100:00100000:2.0:1786562828.239282:0:16203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11672 00000100:00100000:2.0:1786562828.239291:0:16203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653010560:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:2.0:1786562828.239312:0:16203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562828.239401:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=1260s v=(0 0) 00010000:00010000:1.0:1786562828.239414:0:29461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786562828.239422:0:29461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562828.239437:0:29461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.244905:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562828.244917:0:16203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562828.244926:0:16203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562828.244946:0:16203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786562828.420473:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843681 is committed 00002000:00010000:0.0:1786562828.420494:0:16203:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1786562828.420500:0:16203:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb mtime from disk: 0 -> 1786562827 00000001:00080000:2.0:1786562828.420502:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843682 is committed 00002000:00010000:0.0:1786562828.420503:0:16203:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb ctime from disk: 0 -> 1786562827 00002000:00010000:0.0:1786562828.420506:0:16203:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb blocks from disk: 1 -> 4103 00000001:00080000:2.0:1786562828.420515:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843680 is committed 00010000:00010000:0.0:1786562828.420533:0:16203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420550:0:16203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420564:0:16203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420583:0:16203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562828.420592:0:16203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420603:0:16203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420637:0:16203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420645:0:16203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3a135e8/0x5c655bf6668a1602 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562828.420770:0:16203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653010560:12345-192.168.204.29@tcp:4:dd.0 Request processed in 181473us (181941us total) trans 21474843682 rc 0/0 00000100:00100000:0.0:1786562828.420783:0:16203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11672 00010000:00010000:0.0:1786562828.420858:0:29461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420866:0:29461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420873:0:29461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420880:0:29461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562828.420883:0:29461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420890:0:29461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420903:0:29461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562828.420910:0:29461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f408f18/0x5c655bf6668a15fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562828.420981:0:29461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653010432:12345-192.168.204.29@tcp:4:dd.0 Request processed in 182505us (185171us total) trans 21474843681 rc 0/0 00000100:00100000:0.0:1786562828.420988:0:29461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11671 00000100:00100000:1.0:1786562828.428497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562828.428924:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653010816 00000100:00100000:0.0:1786562828.428939:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653010816 00000100:00100000:0.0:1786562828.429052:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6356 00000100:00100000:0.0:1786562828.429065:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:71879:x1873345653010816:12345-192.168.204.29@tcp:35:dd.0 00000001:00080000:0.0:1786562828.429604:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950875 00000100:00100000:0.0:1786562828.429762:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:71879:x1873345653010816:12345-192.168.204.29@tcp:35:dd.0 Request processed in 698us (1278us total) trans 8589950876 rc 0/0 00000100:00100000:0.0:1786562828.429772:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6356 00000020:00080000:0.0:1786562828.429777:0:34647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786562829.093249:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562829.631086:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562829.631140:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562829.631172:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562829.631199:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562829.631235:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011328 00000100:00100000:3.0:1786562829.631246:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011328 00000100:00100000:3.0:1786562829.631318:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011200 00000100:00100000:3.0:1786562829.631322:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011200 00000100:00100000:3.0:1786562829.631353:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 603 00000100:00100000:3.0:1786562829.631366:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653011328:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562829.631468:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653011328:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 103us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562829.631477:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 603 00000100:00100000:3.0:1786562829.631501:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 604 00000100:00100000:3.0:1786562829.631509:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653011200:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562829.631540:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653011200:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562829.631547:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 604 00000100:00080000:3.0:1786562829.631571:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562829.632579:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011072 00000100:00100000:1.0:1786562829.632594:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011072 00000100:00100000:1.0:1786562829.632659:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 497 00000100:00100000:1.0:1786562829.632672:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345653011072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562829.632755:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345653011072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 88us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562829.632762:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 497 00000100:00100000:1.0:1786562829.632794:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653010944 00000100:00100000:1.0:1786562829.632799:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653010944 00000100:00100000:1.0:1786562829.632843:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 444 00000100:00100000:1.0:1786562829.632854:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653010944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562829.632895:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653010944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 46us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562829.632905:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 444 00010000:00010000:2.0:1786562830.117546:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562830.629488:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562830.629522:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654976128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562830.629629:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562830.629726:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976128 00000100:00100000:2.0:1786562830.629736:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976128 00000100:00100000:2.0:1786562830.629809:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1786562830.629822:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654976128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562830.629869:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:2.0:1786562830.629926:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654976128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562830.629935:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1786562830.629998:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843680 gen 2 00000100:00080000:3.0:1786562830.630096:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562830.630144:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562830.630156:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654976256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562830.630188:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562830.630224:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976256 00000100:00100000:0.0:1786562830.630228:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976256 00000100:00100000:0.0:1786562830.630262:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1786562830.630268:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88130c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654976256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562830.630293:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:0.0:1786562830.630328:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88130c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654976256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562830.630338:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00080000:0.0:1786562830.630354:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562830.630378:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654976256:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1786562830.632372:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bc06c700, transno 21474843680 00000100:00100000:2.0:1786562830.632425:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654976128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562830.633443:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654976512:0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.633466:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654976384:0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.633858:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562830.633950:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976384 00000100:00100000:3.0:1786562830.633960:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976384 00000100:00100000:3.0:1786562830.636701:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1786562830.636739:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654976384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.636883:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654976384:12345-0@lo:400:kworker.0 Request processed in 164us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562830.636893:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1786562830.636997:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88130ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654976384:0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.637124:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654976640:0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.638821:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562830.638912:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562830.638928:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654976768:0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.638997:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562830.640790:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976640 00000100:00100000:3.0:1786562830.640808:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976640 00000100:00100000:3.0:1786562830.640887:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976768 00000100:00100000:3.0:1786562830.640891:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976768 00000100:00100000:3.0:1786562830.640921:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1786562830.640934:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654976640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562830.641037:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1786562830.641049:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654976768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562830.641111:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1873345654976768:12345-0@lo:400:kworker.0 Request processed in 64us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562830.641120:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00080000:2.0:1786562830.641965:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562830.642093:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3289:1873345654976768:0@lo:400:kworker.0 00000100:00100000:3.0:1786562830.643612:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654976640:12345-0@lo:400:kworker.0 Request processed in 2674us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562830.643641:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1786562830.644485:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654976640:0@lo:400:kworker.0 00000100:00100000:0.0:1786562830.646922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562830.647353:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976512 00000100:00100000:0.0:1786562830.647365:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976512 00000100:00100000:0.0:1786562830.647456:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1786562830.647469:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654976512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562830.647572:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654976512:12345-0@lo:400:kworker.0 Request processed in 105us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562830.647581:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00080000:1.0:1786562830.647775:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562830.647923:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9b35d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654976512:0@lo:400:kworker.0 00000001:00080000:0.0:1786562830.745294:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876154 is committed 00010000:00010000:3.0:1786562831.141136:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562832.165512:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562833.189249:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562833.268380:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950876 is committed 00010000:00010000:3.0:1786562834.213909:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562834.745272:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562834.745340:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562834.745462:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011456 00000100:00100000:1.0:1786562834.745476:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011456 00000100:00100000:1.0:1786562834.745563:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 446 00000100:00100000:1.0:1786562834.745580:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653011456:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562834.745694:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653011456:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 116us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562834.745702:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 446 00000100:00100000:2.0:1786562834.745972:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562834.746057:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562834.746316:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011584 00000100:00100000:1.0:1786562834.746333:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011584 00000100:00100000:1.0:1786562834.746409:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 501 00000100:00100000:1.0:1786562834.746419:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345653011584:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562834.746473:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:2348:x1873345653011584:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 56us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562834.746484:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 501 00000100:00080000:0.0:1786562834.747709:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562834.748331:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011712 00000100:00100000:3.0:1786562834.748348:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011712 00000100:00100000:3.0:1786562834.748878:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011840 00000100:00100000:3.0:1786562834.748885:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011840 00000100:00100000:3.0:1786562834.748920:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 605 00000100:00100000:3.0:1786562834.748934:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653011712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562834.749056:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653011712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 125us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562834.749065:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 605 00000100:00100000:3.0:1786562834.749086:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 606 00000100:00100000:3.0:1786562834.749093:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653011840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562834.749123:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653011840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562834.749130:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 606 00000100:00080000:2.0:1786562834.749272:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786562834.749278:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786562835.237349:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562835.751947:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654976896:0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.752102:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562835.752173:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654977408:0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.752211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562835.752246:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786562835.752254:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654977024:0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.752384:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562835.752409:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654977536:0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.752438:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562835.752662:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977024 00000100:00100000:0.0:1786562835.752673:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977024 00000100:00100000:0.0:1786562835.752742:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977536 00000100:00100000:0.0:1786562835.752746:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977536 00000100:00100000:0.0:1786562835.752771:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1786562835.752783:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654977024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.752850:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b35d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654977024:12345-0@lo:400:kworker.0 Request processed in 69us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562835.752859:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1786562835.752882:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1786562835.752889:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654977536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.752918:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654977536:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562835.752924:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00080000:0.0:1786562835.752953:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562835.752990:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654977024:0@lo:400:kworker.0 00000100:00100000:0.0:1786562835.753002:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654977536:0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753207:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654977152:0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753247:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562835.753292:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562835.753298:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654977280:0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753336:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562835.753367:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977408 00000100:00100000:3.0:1786562835.753371:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977408 00000100:00100000:3.0:1786562835.753414:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977280 00000100:00100000:3.0:1786562835.753418:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977280 00000100:00100000:3.0:1786562835.753437:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1786562835.753462:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654977408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753725:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654977408:12345-0@lo:400:kworker.0 Request processed in 280us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562835.753733:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1786562835.753748:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1786562835.753755:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654977280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753790:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654977280:12345-0@lo:400:kworker.0 Request processed in 36us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562835.753795:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1786562835.753817:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977152 00000100:00100000:3.0:1786562835.753821:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977152 00000100:00100000:3.0:1786562835.753851:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1786562835.753858:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753888:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654977152:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562835.753893:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00080000:3.0:1786562835.753924:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562835.753929:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562835.753932:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562835.753957:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654977280:0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.753967:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654977152:0@lo:400:kworker.0 00000100:00100000:3.0:1786562835.754000:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876154 gen 2 00000004:00080000:3.0:1786562835.754039:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e8841c1880, transno 17179876154 00000100:00100000:3.0:1786562835.754053:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654977408:0@lo:400:kworker.0 00000100:00100000:1.0:1786562835.754390:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654976896 00000100:00100000:1.0:1786562835.754397:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654976896 00000100:00100000:1.0:1786562835.754436:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1786562835.754460:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654976896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562835.755424:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654976896:12345-0@lo:400:kworker.0 Request processed in 973us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562835.755438:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1786562835.755916:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654976896:0@lo:400:kworker.0 00000100:00100000:2.0:1786562835.756132:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562835.756147:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562835.756207:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562835.756347:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977664 00000100:00100000:2.0:1786562835.756355:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977664 00000100:00100000:2.0:1786562835.756404:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1786562835.756414:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654977664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562835.756592:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1786562835.756646:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654977664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562835.756653:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1786562835.756696:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562835.756882:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786562835.756893:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654977792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562835.756926:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562835.756957:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977792 00000100:00100000:1.0:1786562835.756961:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977792 00000100:00100000:1.0:1786562835.756991:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1786562835.756998:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654977792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562835.757049:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562835.757086:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654977792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562835.757093:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1786562835.757125:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654977792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786562836.262792:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562837.286091:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562838.309273:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562839.333248:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562839.868273:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562839.868340:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562839.868383:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562839.868425:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562839.868493:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653011968 00000100:00100000:0.0:1786562839.868509:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653011968 00000100:00100000:2.0:1786562839.868519:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653012096 00000100:00100000:2.0:1786562839.868532:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653012096 00000100:00100000:0.0:1786562839.868588:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 448 00000100:00100000:0.0:1786562839.868602:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653011968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562839.868620:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 505 00000100:00100000:2.0:1786562839.868635:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:2349:x1873345653012096:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562839.868690:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653011968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 90us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562839.868700:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 448 00000100:00100000:2.0:1786562839.868719:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:2349:x1873345653012096:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562839.868731:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 505 00000100:00080000:2.0:1786562839.868795:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562839.869980:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653012352 00000100:00100000:3.0:1786562839.869994:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653012352 00000100:00100000:3.0:1786562839.870101:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653012224 00000100:00100000:3.0:1786562839.870105:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653012224 00000100:00100000:3.0:1786562839.870141:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 609 00000100:00100000:3.0:1786562839.870150:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653012352:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562839.870214:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2349:x1873345653012352:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 66us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562839.870233:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 609 00000100:00100000:3.0:1786562839.870248:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 610 00000100:00100000:3.0:1786562839.870256:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653012224:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562839.870281:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653012224:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562839.870287:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 610 00000100:00080000:2.0:1786562839.871397:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786562839.871403:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786562840.357266:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562840.869268:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786562840.869294:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654977920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562840.869378:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562840.869640:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654977920 00000100:00100000:1.0:1786562840.869649:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654977920 00000100:00100000:1.0:1786562840.869707:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1786562840.869727:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654977920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562840.869764:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562840.869825:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654977920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562840.869832:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:1.0:1786562840.869856:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562840.869895:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654977920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562840.870341:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786562840.870352:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654978048:0@lo:400:kworker.0 00000100:00100000:3.0:1786562840.870392:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562840.870441:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654978304:0@lo:400:kworker.0 00000100:00100000:3.0:1786562840.870469:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562840.870489:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562840.870494:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654978176:0@lo:400:kworker.0 00000100:00100000:3.0:1786562840.870515:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562840.871106:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978304 00000100:00100000:3.0:1786562840.871113:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978304 00000100:00100000:3.0:1786562840.871153:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978176 00000100:00100000:3.0:1786562840.871157:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978176 00000100:00100000:3.0:1786562840.871178:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1786562840.871187:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654978304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562840.871277:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654978304:12345-0@lo:400:kworker.0 Request processed in 90us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562840.871284:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1786562840.871299:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1786562840.871306:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654978176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562840.871337:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345654978176:12345-0@lo:400:kworker.0 Request processed in 33us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562840.871343:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00080000:3.0:1786562840.871368:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562840.871394:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345654978176:0@lo:400:kworker.0 00000100:00100000:3.0:1786562840.871406:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654978304:0@lo:400:kworker.0 00000100:00100000:0.0:1786562840.871673:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654978560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786562840.871788:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562840.872127:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786562840.872136:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654978688:0@lo:400:kworker.0 00000100:00100000:2.0:1786562840.872175:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562840.872215:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978688 00000100:00100000:2.0:1786562840.872219:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978688 00000100:00100000:2.0:1786562840.872384:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786562840.872392:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654978688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562840.872438:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654978688:12345-0@lo:400:kworker.0 Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562840.872445:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786562840.872478:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654978688:0@lo:400:kworker.0 00000100:00100000:1.0:1786562840.872564:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654978432:0@lo:400:kworker.0 00000100:00100000:1.0:1786562840.872599:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562840.872639:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978048 00000100:00100000:1.0:1786562840.872643:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978048 00000100:00100000:1.0:1786562840.872674:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1786562840.872680:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654978048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562840.874400:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654978048:12345-0@lo:400:kworker.0 Request processed in 1709us (3997us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562840.874418:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1786562840.874597:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978432 00000100:00100000:2.0:1786562840.874607:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978432 00000100:00100000:2.0:1786562840.874678:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1786562840.874687:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654978432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562840.874843:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654978048:0@lo:400:kworker.0 00000100:00080000:1.0:1786562840.875169:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562840.876043:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978560 00000100:00100000:3.0:1786562840.876053:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978560 00000100:00100000:3.0:1786562840.876099:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1786562840.876108:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654978560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562840.876147:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51314688 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562840.876243:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654978560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562840.876250:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1786562840.876958:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654978432:12345-0@lo:400:kworker.0 Request processed in 2268us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562840.876970:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1786562840.877041:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654978432:0@lo:400:kworker.0 00000100:00100000:0.0:1786562840.877452:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c52c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654978560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562841.381281:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562842.134277:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.134407:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653012608 00000100:00100000:2.0:1786562842.134418:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653012608 00000100:00100000:2.0:1786562842.134506:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17488 00000100:00100000:2.0:1786562842.134518:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:71910:x1873345653012608:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562842.134543:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562842.134569:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1609 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd78a expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.134663:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.134678:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.134693:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.134738:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.134747:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.134755:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786562842.135569:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562842.135738:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135749:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135756:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135762:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.135767:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135774:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135789:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562842.135792:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.135797:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135803:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a1610 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135819:0:33113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135825:0:33113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135831:0:33113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135835:0:33113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.135839:0:33113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135844:0:33113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135850:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b6332500) 00010000:00010000:2.0:1786562842.135853:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.135855:0:33113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135861:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1617 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135903:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1609 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd78a expref: 22 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135913:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562842.135915:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562842.135919:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1609 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd78a expref: 22 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.135928:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562842.136190:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+21:71910:x1873345653012608:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1673us (1922us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562842.136198:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17488 00000100:00100000:3.0:1786562842.152971:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.155633:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653012864 00000100:00100000:0.0:1786562842.155650:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653012864 00000100:00100000:0.0:1786562842.155735:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17489 00000100:00100000:0.0:1786562842.155746:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:71910:x1873345653012864:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562842.155766:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562842.155786:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a161e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd791 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562842.156089:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ef:0x0]: returning size 7680 00010000:00010000:0.0:1786562842.156330:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a161e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd791 expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.156347:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abf00) 00010000:00010000:0.0:1786562842.156351:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562842.156357:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c200/0x5c655bf6668a161e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd791 expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.156368:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6c200, rc 0) 00000100:00100000:0.0:1786562842.156430:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+22:71910:x1873345653012864:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 687us (3470us total) trans 8589950877 rc 301/301 00000100:00100000:0.0:1786562842.156453:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17489 00000100:00100000:0.0:1786562842.160636:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.160749:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653012992 00000100:00100000:3.0:1786562842.160759:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653012992 00000100:00100000:3.0:1786562842.160824:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17490 00000100:00100000:3.0:1786562842.160835:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:71910:x1873345653012992:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562842.160927:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.160946:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.160970:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.160988:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.160996:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161003:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161399:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161410:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161417:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562842.161471:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00000004:00200000:3.0:1786562842.161477:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562842.161489:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161505:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161511:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161519:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161525:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562842.161529:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161536:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161549:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562842.161553:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562842.161558:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161564:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a162c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161575:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161581:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161591:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161596:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562842.161599:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161605:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161612:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1c00) 00010000:00010000:3.0:1786562842.161614:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562842.161617:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161623:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1633 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161642:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161649:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161654:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.161659:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562842.161662:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.162003:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.162031:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562842.162034:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562842.162038:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.162043:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a163a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562842.162131:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:71910:x1873345653012992:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1295us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562842.162141:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17490 00000100:00100000:1.0:1786562842.173929:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.174066:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653013248 00000100:00100000:2.0:1786562842.174078:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653013248 00000100:00100000:2.0:1786562842.174144:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6357 00000100:00100000:2.0:1786562842.174156:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+22:71910:x1873345653013248:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562842.174728:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9b46e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:71910:x1873345653013248:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 571us (809us total) trans 8589950878 rc 0/0 00000100:00100000:2.0:1786562842.174739:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6357 00000100:00100000:0.0:1786562842.233545:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.233941:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653013504 00000100:00100000:2.0:1786562842.233968:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653013504 00000100:00100000:2.0:1786562842.234075:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17491 00000100:00100000:2.0:1786562842.234087:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71917:x1873345653013504:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562842.234114:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562842.234151:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1641 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd798 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.234663:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.234678:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.234689:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.234704:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.234712:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.234718:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235088:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235098:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235104:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235111:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.235114:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235122:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235144:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562842.235147:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.235410:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235418:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1648 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235432:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235439:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235446:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235451:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.235455:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235461:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235469:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b6332500) 00010000:00010000:2.0:1786562842.235472:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.235475:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235481:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a164f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235531:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1641 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd798 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235544:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562842.235546:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562842.235550:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1641 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd798 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.235559:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562842.235630:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71917:x1873345653013504:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1546us (2098us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562842.235639:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17491 00000100:00100000:0.0:1786562842.244074:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.251650:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653013760 00000100:00100000:2.0:1786562842.251665:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653013760 00000100:00100000:2.0:1786562842.251734:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17492 00000100:00100000:2.0:1786562842.251744:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:71917:x1873345653013760:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562842.251769:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562842.251790:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd79f expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.252087:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a165d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.252114:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a165d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.252134:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a165d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562842.252146:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4ef:0x0]: returning size 7680 00010000:00010000:2.0:1786562842.252776:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd79f expref: 26 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.252796:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd600/0x5c655bf6668a165d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd79f expref: 25 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.252805:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562842.252808:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786562842.252811:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd600, rc 0) 00000100:00100000:2.0:1786562842.252937:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:71917:x1873345653013760:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1193us (8871us total) trans 8589950879 rc 0/0 00000100:00100000:2.0:1786562842.252945:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17492 00000100:00100000:1.0:1786562842.257273:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.257516:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653013888 00000100:00100000:2.0:1786562842.257527:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653013888 00000100:00100000:2.0:1786562842.257580:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17493 00000100:00100000:2.0:1786562842.257592:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+25:71917:x1873345653013888:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562842.257675:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.257691:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.257703:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.257719:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.257726:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.257733:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258107:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258117:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258326:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562842.258430:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00000004:00200000:2.0:1786562842.258436:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562842.258449:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258468:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258474:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258481:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258486:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfde00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.258490:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258497:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258509:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562842.258512:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.258517:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258523:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a166b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258535:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258541:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258546:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258552:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.258555:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258561:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258568:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b6332500) 00010000:00010000:2.0:1786562842.258571:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.258573:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258578:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a1672 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258592:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258598:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258603:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258608:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.258611:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258616:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258625:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562842.258628:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.258630:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.258636:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1679 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562842.258724:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+25:71917:x1873345653013888:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1131us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562842.258733:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17493 00000100:00100000:0.0:1786562842.337453:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.338155:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653014144 00000100:00100000:3.0:1786562842.338167:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653014144 00000100:00100000:3.0:1786562842.338246:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17494 00000100:00100000:3.0:1786562842.338258:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:71919:x1873345653014144:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562842.338282:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562842.338305:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1680 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7a6 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.338576:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.338594:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.338606:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.338625:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.338632:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.338639:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342561:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342581:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342588:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342595:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562842.342600:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342608:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342624:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562842.342627:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562842.342632:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342639:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a1687 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342656:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342663:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342669:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342674:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562842.342676:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342682:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342690:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1c00) 00010000:00010000:3.0:1786562842.342692:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562842.342695:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342700:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a168e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342753:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1680 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7a6 expref: 26 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342764:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562842.342767:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562842.342771:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266200/0x5c655bf6668a1680 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7a6 expref: 26 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.342781:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266200, rc 0) 00000100:00100000:3.0:1786562842.344056:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:71919:x1873345653014144:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5793us (6619us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562842.344070:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17494 00000100:00100000:1.0:1786562842.365591:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562842.365634:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653014272 00000100:00100000:1.0:1786562842.365644:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653014272 00000100:00100000:1.0:1786562842.365698:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17495 00000100:00100000:1.0:1786562842.365709:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:71919:x1873345653014272:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562842.365800:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.365819:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.365831:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.365849:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.365857:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.365863:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366275:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366286:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366293:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562842.366334:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00000004:00200000:1.0:1786562842.366338:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562842.366351:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366367:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366374:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366382:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366387:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562842.366391:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366398:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366409:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562842.366413:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562842.366417:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366423:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a1695 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366434:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366453:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366462:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366466:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562842.366469:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366475:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366482:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9bc2a2200) 00010000:00010000:1.0:1786562842.366485:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562842.366487:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366493:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a169c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366508:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366514:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366520:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366525:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562842.366528:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366537:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366545:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562842.366548:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562842.366551:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.366556:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a16a3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562842.366633:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:71919:x1873345653014272:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 925us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562842.366642:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17495 00010000:00010000:2.0:1786562842.413530:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562842.428030:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.428077:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653014400 00000100:00100000:0.0:1786562842.428088:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653014400 00000100:00100000:0.0:1786562842.428156:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17496 00000100:00100000:0.0:1786562842.428182:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+25:71922:x1873345653014400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562842.428204:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562842.428227:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a16aa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7ad expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.428310:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.428325:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.428338:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.428355:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.428363:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.428373:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429165:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429187:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429196:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562842.429688:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00000004:00200000:0.0:1786562842.429696:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562842.429723:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429738:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429748:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429754:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429760:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429766:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562842.429770:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429778:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429792:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562842.429795:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562842.429801:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429806:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a16b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429821:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429826:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429831:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429835:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6ce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562842.429839:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429844:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429851:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b46ab000) 00010000:00010000:0.0:1786562842.429854:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562842.429858:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429864:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a16b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429909:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a16aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7ad expref: 27 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429923:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7ad expref: 26 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.429930:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:0.0:1786562842.429932:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562842.429935:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6c000, rc 0) 00000100:00100000:0.0:1786562842.430058:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+26:71922:x1873345653014400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1890us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562842.430069:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17496 00000100:00100000:0.0:1786562842.437720:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.437878:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653014528 00000100:00100000:3.0:1786562842.437890:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653014528 00000100:00100000:3.0:1786562842.437978:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18018 00000100:00100000:3.0:1786562842.437992:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653014528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562842.438028:0:29963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562842.438053:0:29963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7b4 expref: -99 pid: 29963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562842.438084:0:29963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x743:0x0] initial LVB size: 2097152, mtime: 0x6a7cc90b, atime: 0x0, ctime: 0x6a7cc90b, blocks: 0x1007 00010000:00010000:3.0:1786562842.438122:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=1274s v=(0 0) 00010000:00010000:3.0:1786562842.438127:0:29963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00000100:00080000:0.0:1786562842.438132:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786562842.438141:0:29963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 9 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.438163:0:29963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 9 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.438191:0:29963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266200, rc 0) 00000100:00100000:3.0:1786562842.438258:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653014528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 269us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562842.438269:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18018 00000100:00100000:3.0:1786562842.462095:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.462132:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653014784 00000100:00100000:3.0:1786562842.462142:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653014784 00000100:00100000:3.0:1786562842.462210:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17497 00000100:00100000:3.0:1786562842.462222:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+26:71922:x1873345653014784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562842.462367:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562842.462389:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a16cd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7bb expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.462708:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a16d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.462722:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a16d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.462734:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a16d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562842.462745:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00010000:00010000:3.0:1786562842.462865:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a16cd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7bb expref: 29 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.462883:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a16d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7bb expref: 28 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.462892:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562842.462894:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562842.462898:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267c00, rc 0) 00000100:00100000:3.0:1786562842.462955:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+28:71922:x1873345653014784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 736us (866us total) trans 8589950880 rc 0/0 00000100:00100000:3.0:1786562842.462963:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17497 00000100:00100000:3.0:1786562842.479960:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.480721:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653014912 00000100:00100000:2.0:1786562842.480736:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653014912 00000100:00100000:2.0:1786562842.480816:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 997 00000100:00100000:2.0:1786562842.480828:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:2351:x1873345653014912:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562842.480845:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562842.480872:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267c00/0x5c655bf6668a16d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7bb expref: 28 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.480891:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562842.480896:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562842.480956:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2351:x1873345653014912:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 131us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562842.480965:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 997 00000100:00100000:3.0:1786562842.483252:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.483433:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653015168 00000100:00100000:2.0:1786562842.483444:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653015168 00000100:00100000:2.0:1786562842.483509:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17498 00000100:00100000:2.0:1786562842.483519:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:71922:x1873345653015168:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562842.483745:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562842.483770:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a16e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7c2 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.483897:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a16e9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.483913:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a16e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.483924:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a16e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562842.483937:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00010000:00010000:2.0:1786562842.484093:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a16e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c2 expref: 30 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.484111:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a16e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c2 expref: 29 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.484120:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562842.484123:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562842.484126:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562842.484195:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:71922:x1873345653015168:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 678us (964us total) trans 8589950881 rc 0/0 00000100:00100000:2.0:1786562842.484204:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17498 00000100:00100000:2.0:1786562842.489599:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.489828:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653015296 00000100:00100000:3.0:1786562842.489838:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653015296 00000100:00100000:3.0:1786562842.489901:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18019 00000100:00100000:3.0:1786562842.489912:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653015296:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1786562842.489964:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.489986:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 9 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.489996:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562842.490002:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562842.490029:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.490073:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 9 pid: 29963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.490087:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 9 pid: 29963 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562842.490108:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e8841c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654978816:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562842.490210:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b780 going to sleep for 11 seconds 00000100:00100000:3.0:1786562842.499036:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e8841c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6658:1873345654978816:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562842.499069:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562842.499945:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.500112:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653015424 00000100:00100000:0.0:1786562842.500121:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653015424 00010000:00010000:0.0:1786562842.500159:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 10 pid: 29963 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562842.500206:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8821 00000100:00100000:0.0:1786562842.500215:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653015424:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562842.500230:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562842.500261:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 10 pid: 29963 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.500275:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 10 pid: 29963 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.500298:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001893b9e9/0x5c655bf6668a16c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7b4 expref: 10 pid: 29963 timeout: 1374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.500313:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562842.500318:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562842.500324:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.500335:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.500357:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562842.500416:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653015424:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 202us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562842.500702:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8821 00010000:00010000:3.0:1786562842.500924:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.500936:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.500965:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.500973:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.500980:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.500987:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562842.500991:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.501001:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.501037:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.501045:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080cceb1e/0x5c655bf6668a16f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562842.501104:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653015296:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 11193us (11516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562842.501113:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18019 00000100:00100000:3.0:1786562842.504281:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.504692:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653015680 00000100:00100000:2.0:1786562842.504703:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653015680 00000100:00100000:2.0:1786562842.505662:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17499 00000100:00100000:2.0:1786562842.505680:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+29:71922:x1873345653015680:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562842.505741:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786562842.505769:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a16bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7ad expref: 29 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.505789:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557400/0x5c655bf6668a15f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd783 expref: 28 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.505798:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562842.505803:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562842.505836:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.505849:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.505860:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786562842.506454:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4424, 88 off358952 00000004:00080000:2.0:1786562842.506466:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1274948459904ns, next at 1217993912197ns, rc = 0 00000040:00080000:2.0:1786562842.506531:0:33113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4454, 88 off361672 00000004:00080000:2.0:1786562842.506538:0:33113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1274948532402ns, next at 1218001025865ns, rc = 0 00000001:00080000:0.0:1786562842.564745:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950877 is committed 00000001:00080000:0.0:1786562842.564762:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950882 is committed 00000004:00080000:0.0:1786562842.564766:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2959 committed 00000004:00080000:0.0:1786562842.564775:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2929 committed 00000004:00010000:2.0:1786562842.566775:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000862ce2b8 reply state 000000000d698243 transno 8589950882 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562842.566798:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786562842.566919:0:33113:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1786562842.566940:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:71922:x1873345653015680:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 61262us (62664us total) trans 8589950882 rc 0/0 00000100:00100000:2.0:1786562842.566949:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17499 00010000:00010000:2.0:1786562842.567076:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.567083:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.567089:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.567096:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.567101:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.567109:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.567127:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562842.567131:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562842.567135:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.567142:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a16fe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562842.567177:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654978944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786562842.568335:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562842.568406:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9831fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654979072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786562842.568711:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562842.568763:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654978944 00000100:00100000:0.0:1786562842.568773:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654978944 00000100:00100000:0.0:1786562842.568828:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654979072 00000100:00100000:0.0:1786562842.568832:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654979072 00000100:00100000:0.0:1786562842.568865:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18020 00000100:00100000:0.0:1786562842.568877:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9831fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654978944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562842.569262:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9831fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3290:x1873345654978944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 387us (930us total) trans 17179876155 rc 0/0 00000100:00100000:0.0:1786562842.569270:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18020 00000100:00100000:0.0:1786562842.569291:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18021 00000100:00100000:0.0:1786562842.569297:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654979072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562842.569496:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3291:x1873345654979072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (785us total) trans 21474843683 rc 0/0 00000100:00100000:0.0:1786562842.569503:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18021 00000100:00080000:0.0:1786562842.569520:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562842.569525:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1786562842.570393:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9bf8dc700/2, rc 0, transno 17179876155 00000100:00100000:2.0:1786562842.570404:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654978944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1786562842.570636:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9831fd180/2, rc 0, transno 21474843683 00000100:00100000:2.0:1786562842.570643:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9831fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654979072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562842.572496:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562842.572853:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653015808 00000100:00100000:1.0:1786562842.572863:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653015808 00000100:00100000:1.0:1786562842.572927:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17500 00000100:00100000:1.0:1786562842.572940:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:71922:x1873345653015808:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562842.572965:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562842.572986:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7c9 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.573084:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 23 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.573100:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 23 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.573124:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562842.573317:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562842.573322:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556a00, rc 0) 00000100:00100000:1.0:1786562842.573387:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:71922:x1873345653015808:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 449us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562842.573397:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17500 00000100:00100000:3.0:1786562842.588278:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.588323:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653015936 00000100:00100000:3.0:1786562842.588336:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653015936 00000100:00100000:3.0:1786562842.588397:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17501 00000100:00100000:3.0:1786562842.588411:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:71922:x1873345653015936:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562842.588433:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562842.588455:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a170c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7d0 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.588547:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a1713 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.588561:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a1713 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.588573:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a1713 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562842.588725:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097153 00000004:00200000:3.0:1786562842.588730:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562842.588750:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a1713 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.588778:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4267600/0x5c655bf6668a170c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d0 expref: 25 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.588795:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a1713 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d0 expref: 24 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.588804:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562842.588807:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562842.588812:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4266a00, rc 0) 00000100:00100000:3.0:1786562842.588877:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:71922:x1873345653015936:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 469us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562842.588887:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17501 00000100:00100000:0.0:1786562842.597237:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.597380:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016064 00000100:00100000:3.0:1786562842.597392:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016064 00000100:00100000:3.0:1786562842.597454:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18022 00000100:00100000:3.0:1786562842.597466:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bad51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653016064:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562842.597485:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562842.597506:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7d7 expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562842.597541:0:37002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x743:0x0] initial LVB size: 2097152, mtime: 0x6a7cc90b, atime: 0x0, ctime: 0x6a7cc90b, blocks: 0x1007 00010000:00010000:3.0:1786562842.597561:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=1275s v=(0 0) 00010000:00010000:3.0:1786562842.597566:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562842.597577:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 9 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.597612:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 9 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.597626:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e9b4267000, rc 0) 00000100:00100000:3.0:1786562842.597691:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bad51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653016064:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 228us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562842.597700:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18022 00000100:00100000:3.0:1786562842.725988:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.726103:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016192 00000100:00100000:0.0:1786562842.726114:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016192 00000100:00100000:0.0:1786562842.726183:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18023 00000100:00100000:0.0:1786562842.726194:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653016192:12345-192.168.204.29@tcp:23:lfs.0 00000001:00080000:0.0:1786562842.755377:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843683 is committed 00000100:00100000:0.0:1786562842.766496:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653016192:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 40292us (40506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562842.766523:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18023 00000100:00100000:1.0:1786562842.770820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.770926:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016320 00000100:00100000:0.0:1786562842.770939:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016320 00000100:00100000:2.0:1786562842.771076:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18024 00000100:00100000:2.0:1786562842.771092:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653016320:12345-192.168.204.29@tcp:23:lfs.0 00000100:00100000:2.0:1786562842.771240:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653016320:12345-192.168.204.29@tcp:23:lfs.0 Request processed in 153us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562842.771248:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18024 00000100:00100000:3.0:1786562842.781615:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.781860:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016448 00000100:00100000:0.0:1786562842.781870:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016448 00000100:00100000:0.0:1786562842.781950:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11673 00000100:00100000:0.0:1786562842.781963:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653016448:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:0.0:1786562842.782031:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.782422:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562842.782427:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562842.782434:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.782450:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562842.782912:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.782976:0:29460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016576 00000100:00100000:2.0:1786562842.782983:0:29460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016576 00000100:00100000:2.0:1786562842.783044:0:29460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11674 00000100:00100000:2.0:1786562842.783052:0:29460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345653016576:12345-192.168.204.29@tcp:3:lfs.0 00010000:00010000:2.0:1786562842.783073:0:29460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.783084:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562842.783087:0:29460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562842.783091:0:29460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.783101:0:29460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807073:0:29460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807096:0:29460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807105:0:29460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807111:0:29460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562842.807116:0:29460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807125:0:29460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807145:0:29460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.807153:0:29460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045a61ee7/0x5c655bf6668a1728 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562842.807274:0:29460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345653016576:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 24218us (24360us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786562842.807285:0:29460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11674 00010000:00010000:1.0:1786562842.808504:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.808520:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.808528:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.808535:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562842.808539:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.808547:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.808563:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.808575:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013b45ca2/0x5c655bf6668a1721 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562842.808641:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653016448:12345-192.168.204.29@tcp:3:lfs.0 Request processed in 26678us (27033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786562842.808652:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11673 00000100:00100000:2.0:1786562842.822151:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.822304:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016704 00000100:00100000:3.0:1786562842.822314:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016704 00000100:00100000:3.0:1786562842.822411:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11675 00000100:00100000:3.0:1786562842.822421:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345653016704:12345-192.168.204.29@tcp:4:lfs.0 00002000:00010000:3.0:1786562842.822484:0:14369:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562842.822494:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.822512:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=1275s v=(0 0) 00010000:00010000:3.0:1786562842.822517:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562842.822524:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.822540:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562842.823219:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562842.825361:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.825460:0:29463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653016832 00000100:00100000:0.0:1786562842.825470:0:29463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653016832 00000100:00100000:0.0:1786562842.825535:0:29463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11676 00000100:00100000:0.0:1786562842.825546:0:29463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345653016832:12345-192.168.204.29@tcp:4:lfs.0 00010000:00010000:0.0:1786562842.825582:0:29463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.825599:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562842.825603:0:29463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562842.825610:0:29463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562842.825623:0:29463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786562842.938374:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876156 is committed 00000001:00080000:0.0:1786562842.938399:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876155 is committed 00000001:00080000:0.0:1786562842.938408:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876157 is committed 00002000:00010000:3.0:1786562842.938626:0:14369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1786562842.938632:0:14369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb mtime from disk: 0 -> 1786562842 00002000:00010000:3.0:1786562842.938635:0:14369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1786562842.938651:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.938676:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.938686:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.938695:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562842.938701:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.938710:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.938734:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.938748:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a172f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562842.938865:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345653016704:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 116441us (116720us total) trans 17179876157 rc 0/0 00000100:00100000:3.0:1786562842.938877:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11675 00010000:00010000:1.0:1786562842.943599:0:29463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.943713:0:29463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.943723:0:29463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.943731:0:29463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562842.943736:0:29463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.943745:0:29463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.943764:0:29463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.943778:0:29463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a5563b7/0x5c655bf6668a1736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562842.943927:0:29463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:cae43410-29f4-4da8-9608-d4626744ead5+7:2351:x1873345653016832:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 118379us (118570us total) trans 17179876156 rc 0/0 00000100:00100000:1.0:1786562842.943937:0:29463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11676 00000100:00100000:2.0:1786562842.980219:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562842.980783:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017088 00000100:00100000:1.0:1786562842.980794:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017088 00000100:00100000:1.0:1786562842.980913:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17502 00000100:00100000:1.0:1786562842.980925:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:71922:x1873345653017088:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1786562842.980983:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562842.981057:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9b4266a00/0x5c655bf6668a1713 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d0 expref: 24 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.981076:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562842.981089:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562842.981601:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.981616:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.981627:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786562842.981702:0:34450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950883 00000004:00010000:1.0:1786562842.981730:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001acaa56a reply state 00000000ed85085e transno 8589950884 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562842.981739:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562842.981838:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:71922:x1873345653017088:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 915us (1628us total) trans 8589950884 rc 0/0 00000100:00100000:1.0:1786562842.981846:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17502 00000020:00080000:1.0:1786562842.981852:0:34450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786562842.985385:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.985404:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.985411:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.985418:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562842.985434:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.985443:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.985461:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562842.985465:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562842.985469:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.985475:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a173d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562842.987364:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562842.987609:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017216 00000100:00100000:3.0:1786562842.987619:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017216 00000100:00100000:3.0:1786562842.987674:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18025 00000100:00100000:3.0:1786562842.987685:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+7:71922:x1873345653017216:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562842.987702:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562842.987725:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7de expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562842.987754:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x727:0x0] initial LVB size: 2097152, mtime: 0x6a7cc91a, atime: 0x0, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1786562842.987778:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=1275s v=(0 0) 00010000:00010000:3.0:1786562842.987783:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562842.987793:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.987809:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562842.987823:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0000, rc 0) 00000100:00100000:3.0:1786562842.987888:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e886c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:71922:x1873345653017216:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 205us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562842.987895:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18025 00000100:00100000:2.0:1786562842.991130:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562842.991528:0:13913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017344 00000100:00100000:0.0:1786562842.991539:0:13913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017344 00002000:00010000:0.0:1786562842.991581:0:13913:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1831 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562842.991586:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa2680 with x1873345653017344 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562842.991598:0:13913:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bbfa2680. 00000100:00100000:0.0:1786562842.991631:0:13913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11677 00000100:00100000:0.0:1786562842.991641:0:13913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653017344:12345-192.168.204.29@tcp:10:lfs.0 00002000:00010000:0.0:1786562842.991928:0:13913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562842.991932:0:13913:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb mtime from disk: 1786562842 -> 1786562842 00002000:00010000:0.0:1786562842.991934:0:13913:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562842.991936:0:13913:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb ctime from disk: 0 -> 1786562842 00002000:00010000:0.0:1786562842.991938:0:13913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562842.991999:0:13913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653017344:12345-192.168.204.29@tcp:10:lfs.0 Request processed in 360us (881us total) trans 17179876158 rc 0/0 00000100:00100000:0.0:1786562842.992038:0:13913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11677 00002000:00010000:0.0:1786562842.992042:0:13913:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/1831 (2097152->18446744073709551615) 00002000:00100000:0.0:1786562842.992045:0:13913:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90e9bbfa2680 with x1873345653017344 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1786562842.992049:0:13913:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e9bbfa2680. 00000100:00100000:0.0:1786562842.995988:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562842.996128:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017600 00000100:00100000:2.0:1786562842.996138:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017600 00000100:00100000:2.0:1786562842.996209:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17503 00000100:00100000:2.0:1786562842.996219:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:71922:x1873345653017600:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562842.996327:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.996345:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562842.996368:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562842.996528:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077948cb2 reply state 0000000038d8501d transno 8589950885 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562842.996538:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562842.996640:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:71922:x1873345653017600:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 423us (662us total) trans 8589950885 rc 0/0 00000100:00100000:2.0:1786562842.996647:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17503 00010000:00010000:1.0:1786562842.998703:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.998722:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.998729:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.998735:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfda00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562842.998740:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.998747:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.998763:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562842.998767:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562842.998772:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562842.998779:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfda00/0x5c655bf6668a174b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562843.001315:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562843.001585:0:12119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017728 00000100:00100000:2.0:1786562843.001595:0:12119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017728 00000100:00100000:2.0:1786562843.001659:0:12119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18026 00000100:00100000:2.0:1786562843.001679:0:12119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:71922:x1873345653017728:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562843.001696:0:12119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562843.001715:0:12119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7e5 expref: -99 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.001745:0:12119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.001754:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562843.001759:0:12119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562843.001764:0:12119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->104857599] (req 0->104857599) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 10 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.001797:0:12119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.001811:0:12119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562843.001829:0:12119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654979200:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562843.001933:0:12119:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786562843.005334:0:12119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12119:1873345654979200:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562843.005373:0:12119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->104857599] (req 0->104857599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 10 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.005395:0:12119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:0.0:1786562843.005818:0:12119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:71922:x1873345653017728:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4149us (4741us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562843.005829:0:12119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18026 00000100:00100000:3.0:1786562843.007261:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562843.007351:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017856 00000100:00100000:2.0:1786562843.007370:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017856 00010000:00010000:2.0:1786562843.007414:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562843.007577:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8822 00000100:00100000:2.0:1786562843.007587:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653017856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562843.007603:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562843.007627:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.007640:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.007669:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdb1738/0x5c655bf6668a171a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7d7 expref: 10 pid: 37002 timeout: 1375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.007687:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562843.007692:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562843.007700:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.007710:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.007747:0:8413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562843.007763:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654979328:192.168.204.29@tcp:105: 00000100:00100000:2.0:1786562843.007843:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867a5540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562843.012336:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562843.012574:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8413:1873345654979328:192.168.204.29@tcp:105: 00010000:00010000:2.0:1786562843.012600:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562843.012668:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653017856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5083us (5413us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562843.012680:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8822 00000100:00100000:3.0:1786562843.020856:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653017984 00000100:00100000:3.0:1786562843.020873:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653017984 00000100:00100000:0.0:1786562843.021269:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18027 00000100:00100000:0.0:1786562843.021281:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653017984:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:0.0:1786562843.021602:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562843.021606:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb mtime from disk: 1786562827 -> 1786562827 00002000:00010000:0.0:1786562843.021609:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb atime from disk: 0 -> 1786562814 00002000:00010000:0.0:1786562843.021611:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb ctime from disk: 1786562827 -> 1786562842 00002000:00010000:0.0:1786562843.021614:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562843.021695:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653017984:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 415us (9369us total) trans 21474843684 rc 0/0 00000100:00100000:0.0:1786562843.021704:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18027 00000100:00100000:1.0:1786562843.025918:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562843.026149:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653018240 00000100:00100000:0.0:1786562843.026170:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653018240 00000100:00100000:0.0:1786562843.026236:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6358 00000100:00100000:0.0:1786562843.026248:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98f615850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+26:71922:x1873345653018240:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:0.0:1786562843.026319:0:34647:0:(mdt_open.c:2507:mdt_close_resync_done()) ### [0x200000404:0x4f0:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a16e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c2 expref: 26 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.026624:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.026640:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 26 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.026648:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.026683:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 26 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.026697:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 26 pid: 33115 timeout: 1375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562843.026710:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654979456:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562843.026801:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988ce3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562843.032051:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562843.032268:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653018368 00000100:00100000:2.0:1786562843.032278:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653018368 00010000:00010000:2.0:1786562843.032321:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 27 pid: 33115 timeout: 1375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562843.032646:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345654979456:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562843.032671:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562843.032728:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8823 00000100:00100000:2.0:1786562843.032739:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:2348:x1873345653018368:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562843.032756:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562843.032765:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 27 pid: 33115 timeout: 1375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.032777:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 27 pid: 33115 timeout: 1375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.032799:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1705 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c9 expref: 27 pid: 33115 timeout: 1375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.032815:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562843.032819:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.032829:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.032836:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.032863:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562843.032914:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+26:2348:x1873345653018368:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 178us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562843.032922:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8823 00010000:00010000:0.0:1786562843.032998:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.033030:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562843.033679:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4425, 88 off359040 00000004:00080000:0.0:1786562843.033690:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1275475684237ns, next at 1217993912197ns, rc = 0 00000040:00080000:0.0:1786562843.033789:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4455, 88 off361760 00000004:00080000:0.0:1786562843.033797:0:34647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1275475791322ns, next at 1218001025865ns, rc = 0 00000001:00080000:0.0:1786562843.076985:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950886 is committed 00000004:00080000:0.0:1786562843.076998:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2960 committed 00000004:00080000:0.0:1786562843.077032:0:33119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2930 committed 00000100:00100000:0.0:1786562843.077167:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654979584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786562843.077239:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562843.077290:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654979712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786562843.077315:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562843.077348:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654979584 00000100:00100000:0.0:1786562843.077367:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654979584 00000100:00100000:0.0:1786562843.077408:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654979712 00000100:00100000:0.0:1786562843.077411:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654979712 00000100:00100000:0.0:1786562843.077450:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18028 00000100:00100000:0.0:1786562843.077458:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654979584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786562843.077673:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562843.077678:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb mtime from disk: 1786562842 -> 1786562842 00002000:00010000:0.0:1786562843.077681:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786562843.077683:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb ctime from disk: 1786562842 -> 1786562842 00002000:00010000:0.0:1786562843.077685:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x727:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562843.077735:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654979584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 276us (496us total) trans 17179876159 rc 0/0 00000100:00100000:0.0:1786562843.077743:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18028 00000100:00100000:0.0:1786562843.077759:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18029 00000100:00100000:0.0:1786562843.077767:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654979712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1786562843.077882:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1786562843.077886:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb mtime from disk: 1786562827 -> 1786562827 00002000:00010000:0.0:1786562843.077888:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb atime from disk: 1786562814 -> 1786562814 00002000:00010000:0.0:1786562843.077890:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb ctime from disk: 1786562842 -> 1786562842 00002000:00010000:0.0:1786562843.077893:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x743:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:0.0:1786562843.077922:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654979712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (605us total) trans 21474843685 rc 0/0 00000100:00100000:0.0:1786562843.077928:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18029 00000100:00100000:0.0:1786562843.077976:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843683 gen 2 00000004:00080000:0.0:1786562843.077981:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9831fd180, transno 21474843683 00000100:00100000:0.0:1786562843.077994:0:3289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e98827b800 x1873345654979712/t21474843685(21474843685) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562859 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786562843.078028:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98827b800/2, rc 0, transno 21474843685 00000100:00100000:0.0:1786562843.078034:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654979712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786562843.078203:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876155 gen 2 00000004:00080000:3.0:1786562843.078208:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9bf8dc700, transno 17179876155 00000100:00100000:3.0:1786562843.078218:0:3292:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90e98827ad80 x1873345654979584/t17179876159(17179876159) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786562859 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786562843.078227:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e98827ad80/2, rc 0, transno 17179876159 00000100:00100000:3.0:1786562843.078231:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654979584:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1786562843.079133:0:34647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000241b44dc reply state 000000005f77c082 transno 8589950886 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562843.079149:0:34647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786562843.079177:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562843.079180:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562843.079189:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a16e9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7c2 expref: 22 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1786562843.079310:0:34647:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1786562843.079324:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98f615850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:71922:x1873345653018240:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 53079us (53415us total) trans 8589950886 rc 0/0 00000100:00100000:2.0:1786562843.079333:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6358 00010000:00010000:2.0:1786562843.079401:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.079427:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.079436:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.079441:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562843.079446:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.079453:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.079468:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562843.079470:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562843.079474:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.079481:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a1759 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562843.084252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562843.084365:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653018496 00000100:00100000:1.0:1786562843.084375:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653018496 00000100:00100000:1.0:1786562843.084452:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17504 00000100:00100000:1.0:1786562843.084462:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+21:71922:x1873345653018496:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562843.084489:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562843.084514:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1760 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7ec expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.084594:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1760 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7ec expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.084608:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1760 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7ec expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.084626:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:1.0:1786562843.084629:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562843.084632:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556400, rc 0) 00000100:00100000:1.0:1786562843.084684:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:71922:x1873345653018496:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 224us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562843.084692:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17504 00000100:00100000:0.0:1786562843.092999:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562843.093173:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653018752 00000100:00100000:1.0:1786562843.093184:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653018752 00000100:00100000:1.0:1786562843.093245:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6359 00000100:00100000:1.0:1786562843.093255:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:71922:x1873345653018752:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562843.093747:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+23:71922:x1873345653018752:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 492us (757us total) trans 8589950887 rc 0/0 00000100:00100000:1.0:1786562843.093923:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6359 00000100:00100000:2.0:1786562843.111910:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562843.112642:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653019008 00000100:00100000:3.0:1786562843.112654:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653019008 00000100:00100000:3.0:1786562843.112859:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17505 00000100:00100000:1.0:1786562843.112991:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:71923:x1873345653019008:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562843.113042:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562843.113065:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556000/0x5c655bf6668a1767 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7f3 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113142:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113165:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113175:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113193:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113200:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113207:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113615:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113623:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113629:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113639:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.113643:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113650:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113662:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562843.113665:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.113670:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113676:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a176e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113688:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113694:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113700:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113706:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.113708:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113714:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113725:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562843.113728:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.113731:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113736:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a1775 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113772:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556000/0x5c655bf6668a1767 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7f3 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113783:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562843.113785:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562843.113789:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556000/0x5c655bf6668a1767 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7f3 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.113798:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556000, rc 0) 00000100:00100000:1.0:1786562843.114220:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:71923:x1873345653019008:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1349us (2319us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562843.114229:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17505 00000100:00100000:1.0:1786562843.119628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562843.119800:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653019136 00000100:00100000:3.0:1786562843.119811:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653019136 00000100:00100000:3.0:1786562843.119884:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17506 00000100:00100000:3.0:1786562843.119898:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71923:x1873345653019136:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562843.119987:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.120030:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.120045:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.120067:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.120076:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.120082:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.121882:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.121902:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.121914:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562843.121959:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097152 00000004:00200000:0.0:1786562843.121964:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562843.121978:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.121993:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.121999:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122027:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122033:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.122037:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122044:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122057:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562843.122060:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.122064:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122070:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a177c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122239:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122247:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122253:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122258:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.122262:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122268:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122276:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1300) 00010000:00010000:0.0:1786562843.122278:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.122281:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122287:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1783 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122414:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122421:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122427:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122432:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6da00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.122435:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122440:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122448:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:0.0:1786562843.122450:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.122454:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.122459:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a178a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562843.122862:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71923:x1873345653019136:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2963us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562843.122873:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17506 00000100:00100000:0.0:1786562843.166112:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562843.166217:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653019392 00000100:00100000:3.0:1786562843.166228:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653019392 00000100:00100000:3.0:1786562843.166287:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17507 00000100:00100000:3.0:1786562843.166300:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:71929:x1873345653019392:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562843.166322:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562843.166343:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1791 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd7fa expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166452:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166470:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166482:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166500:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166508:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166516:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166914:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166923:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166930:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166936:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.166940:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166947:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166961:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562843.166965:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.166969:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.166976:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a1798 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167054:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167062:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167069:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167074:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.167077:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167084:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167092:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1100) 00010000:00010000:3.0:1786562843.167094:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.167097:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167109:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a179f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167149:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1791 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7fa expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167172:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562843.167175:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562843.167180:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a1791 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7fa expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.167204:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0600, rc 0) 00000100:00100000:3.0:1786562843.167275:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:71929:x1873345653019392:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 977us (1173us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562843.167287:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17507 00000100:00100000:2.0:1786562843.188383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562843.191095:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653019520 00000100:00100000:0.0:1786562843.191109:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653019520 00000100:00100000:1.0:1786562843.194918:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17508 00000100:00100000:1.0:1786562843.194934:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:71929:x1873345653019520:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562843.195048:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195066:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195078:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195093:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195101:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195107:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195860:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195872:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195880:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562843.195917:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097152 00000004:00200000:1.0:1786562843.195921:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562843.195932:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195947:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195953:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195964:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195970:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.195973:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195980:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.195992:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562843.195996:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.196000:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196033:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557000/0x5c655bf6668a17a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196046:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196051:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196057:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196061:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.196064:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196073:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196080:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562843.196082:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.196085:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196090:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557e00/0x5c655bf6668a17ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196102:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196108:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196113:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196117:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.196120:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196125:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196131:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:1.0:1786562843.196133:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.196136:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.196142:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557c00/0x5c655bf6668a17b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562843.196253:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:71929:x1873345653019520:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1320us (7877us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562843.196262:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17508 00000100:00100000:1.0:1786562843.236520:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562843.236632:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653019776 00000100:00100000:2.0:1786562843.236642:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653019776 00000100:00100000:2.0:1786562843.236708:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17509 00000100:00100000:2.0:1786562843.236718:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9866c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:71936:x1873345653019776:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562843.236740:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562843.236760:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a17bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd801 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.236835:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.236848:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.236859:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.236874:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.236881:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.236887:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237476:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237485:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237493:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237499:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfce00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562843.237503:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237510:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237523:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562843.237527:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562843.237532:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237538:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfce00/0x5c655bf6668a17c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237550:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237556:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237561:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237567:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562843.237570:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237576:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237582:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b6332500) 00010000:00010000:2.0:1786562843.237584:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562843.237587:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237593:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc400/0x5c655bf6668a17c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237631:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a17bb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd801 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237641:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:2.0:1786562843.237643:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562843.237647:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a17bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd801 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562843.237656:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562843.237767:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9866c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:71936:x1873345653019776:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1050us (1256us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562843.237775:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17509 00000100:00100000:2.0:1786562843.243072:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562843.243179:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653019904 00000100:00100000:0.0:1786562843.243191:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653019904 00000100:00100000:0.0:1786562843.243261:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17510 00000100:00100000:0.0:1786562843.243273:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71936:x1873345653019904:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562843.243351:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243381:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243394:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243410:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243418:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243436:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243887:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243898:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243906:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562843.243947:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097152 00000004:00200000:0.0:1786562843.243953:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562843.243967:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243983:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243990:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.243998:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244050:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6da00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.244055:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244688:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244707:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562843.244711:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.244716:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244724:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a17d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244737:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244742:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244748:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244754:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6cc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.244756:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244762:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244769:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b46aba00) 00010000:00010000:0.0:1786562843.244772:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.244775:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244781:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a17d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244798:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244804:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244810:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244815:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.244818:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244823:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244830:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:0.0:1786562843.244833:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.244836:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.244842:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a17de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562843.244938:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71936:x1873345653019904:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1664us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562843.244948:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17510 00000100:00100000:1.0:1786562843.288365:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562843.288502:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653020160 00000100:00100000:3.0:1786562843.288514:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653020160 00000100:00100000:3.0:1786562843.288577:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17511 00000100:00100000:3.0:1786562843.288588:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:71941:x1873345653020160:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562843.288611:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562843.288632:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a17e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd808 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.288719:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.288733:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.288744:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.288761:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.288769:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.288776:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289339:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289363:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289369:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289376:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.289380:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289386:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289400:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562843.289403:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.289407:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289413:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a17ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289440:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289446:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289451:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289456:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.289459:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289464:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289471:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1100) 00010000:00010000:3.0:1786562843.289473:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.289476:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289481:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a17f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289519:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a17e5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd808 expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289529:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562843.289531:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562843.289534:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0600/0x5c655bf6668a17e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd808 expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.289627:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0600, rc 0) 00000100:00100000:3.0:1786562843.289702:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:71941:x1873345653020160:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1116us (1357us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562843.289712:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17511 00000100:00100000:1.0:1786562843.294186:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562843.295339:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653020288 00000100:00100000:3.0:1786562843.295615:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653020288 00000100:00100000:3.0:1786562843.295757:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17512 00000100:00100000:3.0:1786562843.295770:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:71941:x1873345653020288:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1786562843.295871:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.295888:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.295908:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.295925:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.295933:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.295939:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.296337:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.296983:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.296997:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562843.297063:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097152 00000004:00200000:3.0:1786562843.297068:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562843.297082:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297097:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297105:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297111:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297117:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.297122:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297128:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297142:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562843.297145:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.297149:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297165:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a17fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297192:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297198:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297204:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297209:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.297212:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297218:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297225:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1500) 00010000:00010000:3.0:1786562843.297228:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.297230:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297235:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1801 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297251:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297257:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297262:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297266:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562843.297269:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297274:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.297279:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:3.0:1786562843.297282:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562843.297285:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562843.298776:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1808 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562843.299170:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+23:71941:x1873345653020288:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3398us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562843.299181:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17512 00000100:00100000:2.0:1786562843.325162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562843.325236:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653020544 00000100:00100000:1.0:1786562843.325250:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653020544 00000100:00100000:1.0:1786562843.325338:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17513 00000100:00100000:1.0:1786562843.325349:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:71945:x1873345653020544:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562843.325380:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562843.325402:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a180f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd80f expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.325488:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.325504:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.325516:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.325531:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.325556:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.325564:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.326540:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.327513:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.327522:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.327529:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.327533:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.327541:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328074:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562843.328077:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.328083:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328091:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a1816 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328109:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328116:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328122:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328128:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562843.328131:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328137:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328144:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9bc2a2e00) 00010000:00010000:1.0:1786562843.328146:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562843.328158:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328164:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a181d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328216:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a180f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd80f expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328227:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:1.0:1786562843.328230:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786562843.328233:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a180f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd80f expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562843.328248:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556a00, rc 0) 00000100:00100000:1.0:1786562843.328341:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:71945:x1873345653020544:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2993us (3200us total) trans 0 rc 301/301 00000100:00100000:1.0:1786562843.328350:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17513 00000100:00100000:1.0:1786562843.332367:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562843.332565:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653020672 00000100:00100000:0.0:1786562843.332576:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653020672 00000100:00100000:0.0:1786562843.332639:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17514 00000100:00100000:0.0:1786562843.332650:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71945:x1873345653020672:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1786562843.332726:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.332745:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.332757:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.332772:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.332779:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.332786:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333621:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333633:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333642:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562843.333685:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097152 00000004:00200000:0.0:1786562843.333693:0:34450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562843.333706:0:34450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333721:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333732:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333740:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333746:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.333750:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333758:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333770:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562843.333773:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.333778:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333785:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d000/0x5c655bf6668a1824 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333952:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333961:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333968:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333974:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6cc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.333978:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333985:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.333994:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9b46aba00) 00010000:00010000:0.0:1786562843.333996:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.334000:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334186:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6cc00/0x5c655bf6668a182b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334204:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334210:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334217:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334222:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6da00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562843.334225:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334231:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334239:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:0.0:1786562843.334241:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562843.334245:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562843.334250:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6da00/0x5c655bf6668a1832 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562843.334374:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:71945:x1873345653020672:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1724us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562843.334384:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17514 00010000:00010000:3.0:1786562843.429176:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562844.453295:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562844.994222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562844.994250:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562844.994274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562844.994295:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562844.994382:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653020928 00000100:00100000:3.0:1786562844.994392:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653020928 00000100:00100000:3.0:1786562844.994451:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 509 00000100:00100000:3.0:1786562844.994462:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345653020928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562844.994536:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345653020928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562844.994544:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 509 00000100:00100000:3.0:1786562844.994565:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021184 00000100:00100000:3.0:1786562844.994568:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021184 00000100:00100000:3.0:1786562844.994588:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021056 00000100:00100000:3.0:1786562844.994591:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021056 00000100:00100000:3.0:1786562844.994608:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 612 00000100:00100000:3.0:1786562844.994614:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653021184:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562844.994641:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653021184:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562844.994648:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 612 00000100:00100000:3.0:1786562844.994659:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 613 00000100:00100000:3.0:1786562844.994665:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653021056:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562844.994686:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653021056:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562844.994691:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 613 00000100:00080000:3.0:1786562844.994707:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562844.994711:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562844.994713:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562844.994809:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653020800 00000100:00100000:3.0:1786562844.994812:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653020800 00000100:00100000:3.0:1786562844.996948:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 450 00000100:00100000:3.0:1786562844.996964:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653020800:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562844.999808:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653020800:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 93us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562844.999840:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 450 00010000:00010000:2.0:1786562845.480076:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562845.989388:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654979968:0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989465:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562845.989519:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654980480:0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989539:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562845.989562:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562845.989567:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654980096:0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989584:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562845.989611:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654979968 00000100:00100000:1.0:1786562845.989618:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654979968 00000100:00100000:1.0:1786562845.989659:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980480 00000100:00100000:1.0:1786562845.989661:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980480 00000100:00100000:1.0:1786562845.989676:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980096 00000100:00100000:1.0:1786562845.989678:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980096 00000100:00100000:1.0:1786562845.989698:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1786562845.989705:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654979968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989753:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654979968:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562845.989760:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1786562845.989777:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1786562845.989782:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654980480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989808:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654980480:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562845.989815:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1786562845.989826:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1786562845.989832:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654980096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989855:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873345654980096:12345-0@lo:400:kworker.0 Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562845.989860:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1786562845.989896:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1873345654980096:0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989905:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654979968:0@lo:400:kworker.0 00000100:00100000:1.0:1786562845.989913:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654980480:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990090:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654980224:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990134:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562845.990167:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786562845.990172:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654979840:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990201:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562845.990226:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654980352:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990250:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562845.990274:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562845.990299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786562845.990330:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786562845.990346:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654979840 00000100:00100000:3.0:1786562845.990350:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654979840 00000100:00100000:3.0:1786562845.990375:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1786562845.990381:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654979840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990414:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654979840:12345-0@lo:400:kworker.0 Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562845.990421:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1786562845.990448:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980224 00000100:00100000:3.0:1786562845.990452:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980224 00000100:00100000:3.0:1786562845.990480:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980352 00000100:00100000:3.0:1786562845.990483:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980352 00000100:00100000:3.0:1786562845.990502:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1786562845.990507:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654980224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990535:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654980224:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562845.990540:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1786562845.990550:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1786562845.990555:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654980352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990578:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654980352:12345-0@lo:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562845.990583:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1786562845.990596:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980608 00000100:00100000:3.0:1786562845.990599:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980608 00000100:00100000:3.0:1786562845.990616:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1786562845.990621:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654980608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562845.990650:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:3.0:1786562845.990684:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1873345654980608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562845.990690:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:3.0:1786562845.990707:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786562845.990709:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562845.990732:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562845.990754:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654979840:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990763:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654980352:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.990771:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654980224:0@lo:400:kworker.0 00000100:00100000:3.0:1786562845.991318:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654980736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562845.991350:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562845.991426:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980736 00000100:00100000:2.0:1786562845.991431:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980736 00000100:00100000:2.0:1786562845.991464:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1786562845.991473:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654980736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786562845.991495:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54722560 pending 0 free 3844079616 avail 3841982464 00000100:00100000:2.0:1786562845.991533:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345654980736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562845.991540:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1786562845.991571:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654980736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786562846.501467:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562847.525847:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786562848.103078:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950887 is committed 00000001:00080000:0.0:1786562848.105173:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876159 is committed 00000001:00080000:0.0:1786562848.105190:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876158 is committed 00000001:00080000:0.0:1786562848.125714:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843685 is committed 00000001:00080000:0.0:1786562848.125735:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843684 is committed 00010000:00010000:3.0:1786562848.549196:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562849.573247:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562850.105597:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562850.105638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562850.105688:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562850.105723:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562850.105753:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021696 00000100:00100000:3.0:1786562850.105763:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021696 00000100:00080000:0.0:1786562850.105826:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562850.105829:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021568 00000100:00100000:3.0:1786562850.105834:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021568 00000100:00080000:0.0:1786562850.105855:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562850.105871:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 616 00000100:00100000:3.0:1786562850.105881:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653021696:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562850.105969:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653021696:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562850.105977:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 616 00000100:00100000:3.0:1786562850.105995:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 617 00000100:00100000:3.0:1786562850.106002:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653021568:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562850.106065:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653021568:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562850.106072:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 617 00000100:00100000:3.0:1786562850.106093:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021312 00000100:00100000:3.0:1786562850.106097:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021312 00000100:00100000:3.0:1786562850.106125:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 452 00000100:00100000:3.0:1786562850.106131:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653021312:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562850.106159:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653021312:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562850.106166:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 452 00000100:00100000:1.0:1786562850.106755:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021440 00000100:00100000:1.0:1786562850.106761:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021440 00000100:00100000:1.0:1786562850.106820:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 513 00000100:00100000:1.0:1786562850.106830:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345653021440:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562850.106882:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8841c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345653021440:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 54us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562850.106890:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 513 00000100:00080000:0.0:1786562850.106980:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786562850.597159:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562851.109424:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654980864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562851.109502:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562851.109610:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980864 00000100:00100000:3.0:1786562851.109618:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980864 00000100:00100000:3.0:1786562851.109682:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1786562851.109692:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654980864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562851.109727:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54722560 pending 0 free 3844079616 avail 3841982464 00000100:00100000:3.0:1786562851.109777:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654980864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562851.109784:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:2.0:1786562851.110036:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786562851.110065:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876159 gen 2 00000004:00080000:2.0:1786562851.110071:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98827ad80, transno 17179876159 00000100:00100000:2.0:1786562851.110088:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654980864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562851.111157:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786562851.111173:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654980992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562851.111369:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562851.116797:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654980992 00000100:00100000:1.0:1786562851.116811:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654980992 00000100:00100000:1.0:1786562851.116900:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1786562851.116912:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654980992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786562851.116955:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:1.0:1786562851.117049:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654980992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (5680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562851.117057:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1786562851.117103:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843685 gen 2 00000004:00080000:1.0:1786562851.117108:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e98827b800, transno 21474843685 00000100:00100000:1.0:1786562851.117127:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654980992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786562851.118124:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562851.119596:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654981120:0@lo:400:kworker.0 00000100:00100000:1.0:1786562851.119669:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562851.120492:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654981504:0@lo:400:kworker.0 00000100:00100000:3.0:1786562851.120537:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562851.120580:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654981504 00000100:00100000:3.0:1786562851.120587:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654981504 00000100:00100000:3.0:1786562851.120630:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1786562851.120639:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654981504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562851.120692:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1873345654981504:12345-0@lo:400:kworker.0 Request processed in 53us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562851.120700:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1786562851.120745:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1873345654981504:0@lo:400:kworker.0 00000100:00100000:2.0:1786562851.120989:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654981120 00000100:00100000:2.0:1786562851.121016:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654981120 00000100:00100000:2.0:1786562851.121099:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1786562851.121107:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654981120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562851.121391:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654981248:0@lo:400:kworker.0 00000100:00100000:0.0:1786562851.121423:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562851.121453:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786562851.121459:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654981376:0@lo:400:kworker.0 00000100:00100000:0.0:1786562851.121477:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562851.121502:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654981248 00000100:00100000:0.0:1786562851.121506:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654981248 00000100:00100000:0.0:1786562851.121539:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654981376 00000100:00100000:0.0:1786562851.121542:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654981376 00000100:00100000:0.0:1786562851.121562:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1786562851.121569:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654981248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562851.121602:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1873345654981248:12345-0@lo:400:kworker.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562851.121608:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1786562851.121619:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1786562851.121625:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654981376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562851.121648:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345654981376:12345-0@lo:400:kworker.0 Request processed in 24us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562851.121654:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00080000:0.0:1786562851.121674:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562851.121695:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345654981376:0@lo:400:kworker.0 00000100:00100000:0.0:1786562851.121705:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1873345654981248:0@lo:400:kworker.0 00000100:00100000:2.0:1786562851.121790:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:3292:x1873345654981120:12345-0@lo:400:kworker.0 Request processed in 684us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562851.121797:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1786562851.121987:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654981120:0@lo:400:kworker.0 00010000:00010000:3.0:1786562851.621168:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786562852.640831:0:42333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc8c30e180 20000000:00000080:0.0:1786562852.640849:0:42333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90e9bb078800 uarg=0000000000000000 00000040:00100000:0.0:1786562852.642349:0:42333:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 48 00000040:00100000:0.0:1786562852.642390:0:42333:0:(llog.c:1072:llog_reverse_process()) index 46 : idx 1 20000000:01000000:0.0:1786562852.642394:0:42333:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 46 cmd:0xce021 lustre.test_204f lustre-OST0000_UUID 20000000:01000000:0.0:1786562852.642408:0:42333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_204f.lustre-OST0000_UUID fl=4 20000000:01000000:1.0:1786562852.643466:0:42334:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 45 marker 27 1->4: lustre-clilov add lustre.test_204f.lustre-OST0000_UUID 20000000:01000000:1.0:1786562852.643590:0:42334:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 48 marker 27 2->4: lustre-clilov add lustre.test_204f.lustre-OST0000_UUID 00000040:00080000:1.0:1786562852.643642:0:42334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000040:00080000:0.0:1786562852.644378:0:42333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17416 20000000:01000000:0.0:1786562852.644394:0:42333:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre test_204f lustre-OST0000_UUID (null) 00000040:00080000:0.0:1786562852.644435:0:42333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 136 off17552 00000040:00080000:0.0:1786562852.644475:0:42333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17776 20000000:01000000:0.0:1786562852.644493:0:42333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_204f.lustre-OST0000_UUID fl=4 00010000:00010000:1.0:1786562852.646266:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1786562852.646638:0:42335:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 28 1->4: lustre-MDT0000-mdtlov add lustre.test_204f.lustre-OST0000_UUID 20000000:01000000:3.0:1786562852.646746:0:42335:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 28 2->4: lustre-MDT0000-mdtlov add lustre.test_204f.lustre-OST0000_UUID 00000040:00080000:3.0:1786562852.646823:0:42335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000040:00080000:0.0:1786562852.647819:0:42333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16608 20000000:01000000:0.0:1786562852.647837:0:42333:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_204f lustre-OST0000_UUID (null) 00000040:00080000:0.0:1786562852.647947:0:42333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].48, 144 off16752 00000040:00080000:0.0:1786562852.648171:0:42333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16976 10000000:01000000:0.0:1786562852.648192:0:42333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1786562852.648213:0:42333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648238:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648246:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648253:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648260:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648268:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648471:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648480:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648490:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648497:0:42333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648506:0:42333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648552:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648566:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.648583:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988279500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654981632:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562852.648746:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648756:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 9 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.648765:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988279c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654981760:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562852.648795:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648804:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 18 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.648814:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654981888:0@lo:104: 00000100:00100000:0.0:1786562852.648866:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786562852.648903:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.648911:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 18 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.648925:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988278700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982016:0@lo:104: 00000100:00100000:0.0:1786562852.648949:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786562852.648993:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649001:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 18 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.649040:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982144:0@lo:104: 00000100:00100000:0.0:1786562852.649063:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562852.649095:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654981888 00000100:00100000:0.0:1786562852.649101:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654981888 00000100:00100000:0.0:1786562852.649138:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982016 00000100:00100000:0.0:1786562852.649141:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982016 00000100:00100000:0.0:1786562852.649152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982144 00000100:00100000:0.0:1786562852.649154:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982144 00000100:00100000:0.0:1786562852.649168:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786562852.649176:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+5:42333:x1873345654981888:12345-0@lo:104: 00010000:00010000:0.0:1786562852.649189:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649237:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786562852.649243:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+5:42333:x1873345654981888:12345-0@lo:104: Request processed in 68us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.649250:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786562852.649268:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786562852.649274:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42333:x1873345654982016:12345-0@lo:104: 00010000:00010000:0.0:1786562852.649285:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649317:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786562852.649322:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42333:x1873345654982016:12345-0@lo:104: Request processed in 49us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.649328:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786562852.649339:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786562852.649345:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982144:12345-0@lo:104: 00010000:00010000:0.0:1786562852.649353:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649381:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786562852.649386:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982144:12345-0@lo:104: Request processed in 42us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.649392:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1786562852.649425:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649432:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 18 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.649440:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982272:0@lo:104: 00000100:00100000:0.0:1786562852.649461:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562852.649479:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982272 00000100:00100000:0.0:1786562852.649483:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982272 00000100:00100000:0.0:1786562852.649500:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786562852.649506:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982272:12345-0@lo:104: 00010000:00010000:0.0:1786562852.649515:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649547:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1786562852.649552:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982272:12345-0@lo:104: Request processed in 47us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.649558:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1786562852.649585:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649592:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 18 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.649601:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982400:0@lo:104: 00000100:00100000:0.0:1786562852.649623:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562852.649640:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982400 00000100:00100000:0.0:1786562852.649644:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982400 00000100:00100000:0.0:1786562852.649658:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786562852.649664:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982400:12345-0@lo:104: 00010000:00010000:0.0:1786562852.649672:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649704:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1786562852.649709:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982400:12345-0@lo:104: Request processed in 46us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.649715:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1786562852.649741:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649753:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 18 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.649762:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982528:0@lo:104: 00000100:00100000:0.0:1786562852.649783:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562852.649800:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982528 00000100:00100000:0.0:1786562852.649804:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982528 00000100:00100000:0.0:1786562852.649819:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786562852.649824:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982528:12345-0@lo:104: 00010000:00010000:0.0:1786562852.649832:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649856:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1786562852.649861:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982528:12345-0@lo:104: Request processed in 37us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.649866:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1786562852.649891:0:42333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.649899:0:42333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 18 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562852.649907:0:42333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982656:0@lo:104: 00000100:00100000:0.0:1786562852.649932:0:42333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562852.649957:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786562852.649980:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982656 00000100:00100000:0.0:1786562852.649984:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982656 00000100:00100000:0.0:1786562852.650002:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786562852.650044:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e887a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982656:12345-0@lo:104: 00010000:00010000:0.0:1786562852.650051:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562852.650076:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1786562852.650080:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e887a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+3:42333:x1873345654982656:12345-0@lo:104: Request processed in 38us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562852.650085:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786562852.650168:0:42333:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8823483c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562852.650192:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654981888:0@lo:104: 00000100:00100000:0.0:1786562852.650201:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988278700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982016:0@lo:104: 00000100:00100000:0.0:1786562852.650208:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982144:0@lo:104: 00000100:00100000:0.0:1786562852.650215:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982272:0@lo:104: 00000100:00100000:0.0:1786562852.650221:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982400:0@lo:104: 00000100:00100000:0.0:1786562852.650228:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982528:0@lo:104: 00000100:00100000:0.0:1786562852.650234:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654982656:0@lo:104: 00010000:00010000:1.0:1786562852.650348:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1786562852.650355:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650362:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266c00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562852.650366:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650375:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562852.650381:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562852.650386:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562852.650426:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650433:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562852.650454:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650461:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9b4266c00/0x5c655bf6668a14ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1506 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650471:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1786562852.650475:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650480:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4267a00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562852.650483:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650489:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562852.650495:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562852.650500:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562852.650514:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650520:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562852.650536:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650547:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9b4267a00/0x5c655bf6668a14f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650557:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1786562852.650560:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650571:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562852.650574:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650580:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562852.650587:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562852.650592:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562852.650605:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650612:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562852.650618:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650625:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a14e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650634:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786562852.650638:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650643:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9b4266800 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562852.650646:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650653:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650657:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:1.0:1786562852.650659:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650663:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562852.650664:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562852.650669:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269000 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562852.650672:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650675:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650680:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650681:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1786562852.650687:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650687:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562852.650693:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562852.650694:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9b4266800/0x5c655bf6668a14d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650702:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786562852.650705:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650707:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650711:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557200 already unused, calling callback (ffffffffc1b69c20) 00010000:00010000:3.0:1786562852.650713:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1786562852.650714:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650717:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650724:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9bb269000/0x5c655bf6668a14c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650726:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562852.650732:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650733:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562852.650736:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562852.650737:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562852.650742:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e9bb269600 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562852.650745:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650746:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650752:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650753:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562852.650756:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562852.650758:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562852.650763:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562852.650764:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a14b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650770:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562852.650772:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562852.650773:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.650773:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562852.650778:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562852.650782:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.650785:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654982784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562852.650792:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e9bb269600/0x5c655bf6668a14ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a14b2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.650803:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562852.650805:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562852.650806:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562852.650813:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562852.650816:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562852.650818:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562852.650838:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654983296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.650856:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654982912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.650858:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562852.650877:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562852.650882:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654983168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.650901:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562852.650923:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654983040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.650946:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562852.650974:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654983552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.650997:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562852.651052:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982784 00000100:00100000:1.0:1786562852.651057:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982784 00010000:00010000:1.0:1786562852.651078:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 19 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.651099:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983296 00000100:00100000:1.0:1786562852.651102:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983296 00000100:00100000:3.0:1786562852.651106:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562852.651113:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 20 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562852.651121:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654983424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.651123:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983168 00000100:00100000:1.0:1786562852.651125:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983168 00010000:00010000:1.0:1786562852.651134:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 21 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.651142:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983040 00000100:00100000:3.0:1786562852.651144:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562852.651145:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983040 00010000:00010000:1.0:1786562852.651153:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 22 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.651162:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983552 00000100:00100000:1.0:1786562852.651165:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983552 00010000:00010000:1.0:1786562852.651175:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 23 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.651184:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654982912 00000100:00100000:1.0:1786562852.651187:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654982912 00010000:00010000:1.0:1786562852.651197:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 24 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.651207:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983424 00000100:00100000:1.0:1786562852.651210:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983424 00010000:00010000:1.0:1786562852.651220:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 25 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.651234:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8824 00000100:00100000:1.0:1786562852.651242:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+25:3292:x1873345654982784:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.651245:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8825 00000100:00100000:3.0:1786562852.651252:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+25:3292:x1873345654983296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562852.651253:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562852.651257:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 25 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651259:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562852.651264:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 25 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.651268:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 25 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651285:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 25 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651297:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4267200/0x5c655bf6668a14ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14c7 expref: 25 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651311:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.651345:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+24:3292:x1873345654983296:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.651354:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8825 00010000:00010000:2.0:1786562852.651370:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562852.651372:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8826 00000100:00100000:3.0:1786562852.651378:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+23:3292:x1873345654983168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562852.651381:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8827 00010000:00010000:3.0:1786562852.651385:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786562852.651388:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+23:3290:x1873345654983040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562852.651389:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 23 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562852.651395:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562852.651397:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 23 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562852.651399:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 23 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651407:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990556600/0x5c655bf6668a14dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14d5 expref: 23 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562852.651408:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 23 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651417:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562852.651418:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990557a00/0x5c655bf6668a14ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14e3 expref: 22 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562852.651426:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.651437:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+21:3292:x1873345654983168:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.651444:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8826 00000100:00100000:2.0:1786562852.651451:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+20:3290:x1873345654983040:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.651456:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8828 00000100:00100000:3.0:1786562852.651461:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+20:3290:x1873345654983552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562852.651469:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562852.651473:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 20 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651481:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 20 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651490:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a14b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14ab expref: 20 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.651503:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.651524:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345654983552:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (526us total) trans 0 rc 0/0 00010000:00010000:1.0:1786562852.652266:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb268c00/0x5c655bf6668a1506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14ff expref: 19 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.652281:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562852.652314:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+18:3292:x1873345654982784:12345-0@lo:103:ldlm_bl.0 Request processed in 1074us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562852.652404:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8827 00000100:00100000:3.0:1786562852.652430:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8828 00000100:00100000:3.0:1786562852.652451:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8829 00000100:00100000:3.0:1786562852.652459:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+17:3289:x1873345654982912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562852.652471:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562852.652477:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 17 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.652486:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 17 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.652497:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990557600/0x5c655bf6668a14f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14f1 expref: 17 pid: 33109 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.652505:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.652538:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+16:3289:x1873345654982912:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.652544:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8829 00000100:00100000:3.0:1786562852.652557:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8830 00000100:00100000:3.0:1786562852.652563:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+15:3289:x1873345654983424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562852.652570:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562852.652575:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 15 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.652582:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 15 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.652593:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4267800/0x5c655bf6668a14c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a14b9 expref: 15 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.652601:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.653718:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c95f678-1633-48c9-bbd9-793f47c06679+13:3289:x1873345654983424:12345-0@lo:103:ldlm_bl.0 Request processed in 1151us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.653727:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8830 00000100:00100000:3.0:1786562852.653776:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654982912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.653787:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654983424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.653841:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654983168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.653850:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654982784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.653858:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654983296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562852.654265:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988279500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654981632:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562852.654275:0:42333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988279c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42333:1873345654981760:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562852.654315:0:42333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.654479:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8824 00000100:00100000:1.0:1786562852.654731:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654983040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.654743:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654983552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562852.657111:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562852.657413:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021952 00000100:00100000:2.0:1786562852.657424:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021952 00010000:00010000:2.0:1786562852.657468:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 10 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562852.657517:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8831 00000100:00100000:2.0:1786562852.657529:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653021952:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562852.657544:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562852.657551:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 10 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562852.657569:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 10 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562852.657591:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9bb269c00/0x5c655bf6668a150d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd736 expref: 10 pid: 33107 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562852.657611:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1786562852.657662:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.657755:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+9:2349:x1873345653021952:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 227us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.657765:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8831 00000100:00100000:3.0:1786562852.657784:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653021824 00000100:00100000:3.0:1786562852.657788:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653021824 00010000:00010000:3.0:1786562852.657804:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562852.657824:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8832 00000100:00100000:3.0:1786562852.657830:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+9:2349:x1873345653021824:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562852.657839:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562852.657843:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657852:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657863:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e9b4266e00/0x5c655bf6668a1514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd73d expref: 9 pid: 33108 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657876:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657884:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657898:0:8413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657905:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657911:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657918:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657929:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562852.657933:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657953:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657982:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562852.657993:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562852.658044:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+8:2349:x1873345653021824:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 213us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562852.658051:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8832 00010000:00010000:1.0:1786562852.658976:0:42333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.658988:0:42333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562852.658995:0:42333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e99ff6c600/0x5c655bf6668a1839 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.669246:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786562853.861129:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786562853.861195:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e8812d5800 from 52 10000000:01000000:0.0:1786562853.861267:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786562853.861318:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.861329:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.861391:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562853.861422:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654983680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.862627:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.862776:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfe1ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562853.863876:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983680 00000100:00100000:3.0:1786562853.863886:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983680 00000100:00100000:3.0:1786562853.863960:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1786562853.863972:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+12:5818:x1873345654983680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562853.863989:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562853.864026:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1840 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.864054:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.864065:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.864079:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:3.0:1786562853.864158:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654983680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562853.864165:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1786562853.864248:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654983680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562853.864265:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.864276:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562853.864361:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654983808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.864397:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.864472:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfe1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.869797:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983808 00000100:00100000:2.0:1786562853.869811:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983808 00000100:00100000:2.0:1786562853.869883:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1786562853.869893:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654983808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.871088:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654983808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1193us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.871099:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1786562853.874043:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654983808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.874116:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654983936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.874306:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.874356:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfe1ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1786562853.874393:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654983936 00000100:00100000:3.0:1786562853.874401:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654983936 00000100:00100000:3.0:1786562853.874465:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1786562853.874475:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654983936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.874744:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654983936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562853.875149:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1786562853.875703:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654983936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.877565:0:42338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42338:1873345654984064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.877650:0:42338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.878060:0:42338:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfe1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.879443:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984064 00000100:00100000:2.0:1786562853.879456:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984064 00000100:00100000:2.0:1786562853.879535:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1786562853.879546:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:42338:x1873345654984064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562853.879878:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:42338:x1873345654984064:12345-0@lo:502:llog_process_th.0 Request processed in 333us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.879887:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1786562853.880114:0:42338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42338:1873345654984064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.880210:0:42338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42338:1873345654984192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.880253:0:42338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.880295:0:42338:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfe1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.880343:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984192 00000100:00100000:1.0:1786562853.880349:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984192 00000100:00100000:1.0:1786562853.880396:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1786562853.880405:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:42338:x1873345654984192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562853.880569:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:42338:x1873345654984192:12345-0@lo:502:llog_process_th.0 Request processed in 165us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.880576:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1786562853.882746:0:42338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42338:1873345654984192:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786562853.882800:0:42338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1786562853.883100:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1786562853.883124:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786562853.883149:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.883160:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562853.883170:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1786562853.883172:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:3.0:1786562853.883175:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786562853.883219:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.883227:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.883242:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562853.883264:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.883321:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.883366:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e998317240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.883402:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984320 00000100:00100000:2.0:1786562853.883410:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984320 00000100:00100000:2.0:1786562853.883457:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1786562853.883475:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654984320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562853.883491:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562853.883505:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a184e expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.883528:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a184e expref: 14 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.883538:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a184e expref: 14 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.883547:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc000, rc 0) 00000100:00100000:2.0:1786562853.883593:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654984320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.883599:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1786562853.884100:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562853.884115:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.884124:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562853.884349:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.884386:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.884417:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e998317240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.884464:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984448 00000100:00100000:0.0:1786562853.884469:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984448 00000100:00100000:0.0:1786562853.884551:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1786562853.884561:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654984448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.885361:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654984448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 799us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.885371:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1786562853.890044:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.890119:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.890514:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.890553:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e998317240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.890881:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984576 00000100:00100000:1.0:1786562853.890889:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984576 00000100:00100000:1.0:1786562853.890959:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1786562853.890969:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654984576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562853.891237:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654984576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.891245:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1786562853.891937:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562853.893358:0:42339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42339:1873345654984704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562853.893439:0:42339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562853.893478:0:42339:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9ba96f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.893645:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984704 00000100:00100000:0.0:1786562853.893652:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984704 00000100:00100000:0.0:1786562853.893692:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1786562853.893702:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:42339:x1873345654984704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.896447:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:42339:x1873345654984704:12345-0@lo:502:llog_process_th.0 Request processed in 2737us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.896460:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1786562853.896652:0:42339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42339:1873345654984704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786562853.896703:0:42339:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786562853.896724:0:42339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786562853.896727:0:42339:0:(obd_config.c:1561:class_process_config()) marker 32 (0x1) lustre-MDT0000-m rem lustre.test_204f.lustre-OST0000_UUID 00000020:00000080:3.0:1786562853.896734:0:42339:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1786562853.896752:0:42339:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from test_204f 00000100:00100000:1.0:1786562853.913064:0:42339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42339:1873345654984832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562853.913174:0:42339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.913315:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984832 00000100:00100000:0.0:1786562853.913323:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984832 00000100:00100000:0.0:1786562853.913374:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1786562853.913384:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:42339:x1873345654984832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.913600:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:42339:x1873345654984832:12345-0@lo:502:llog_process_th.0 Request processed in 217us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.913609:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000020:01000004:3.0:1786562853.913992:0:42340:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e8812d5800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786562853.913997:0:42340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e8812d5800 4 00000100:00100000:1.0:1786562853.914735:0:42339:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.914765:0:42339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42339:1873345654984832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786562853.914801:0:42339:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786562853.914809:0:42339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786562853.914811:0:42339:0:(obd_config.c:1561:class_process_config()) marker 32 (0x2) lustre-MDT0000-m rem lustre.test_204f.lustre-OST0000_UUID 00000040:00080000:1.0:1786562853.914815:0:42339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:3.0:1786562853.917363:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:3.0:1786562853.917400:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786562853.917412:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.917426:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562853.917437:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562853.917440:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e988fe0000 from 52 10000000:01000000:3.0:1786562853.917443:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562853.917483:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.917505:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.917516:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562853.917542:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.917608:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.917779:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.920618:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654984960 00000100:00100000:0.0:1786562853.920634:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654984960 00000100:00100000:0.0:1786562853.920841:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1786562853.920853:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654984960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562853.920870:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562853.920889:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a185c expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.920917:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a185c expref: 15 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.920928:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a185c expref: 15 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.920947:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6c400, rc 0) 00000100:00100000:0.0:1786562853.921051:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654984960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (3441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.921059:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1786562853.921168:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654984960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562853.921190:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.921209:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562853.921277:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.921314:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.921754:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.921895:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985088 00000100:00100000:2.0:1786562853.921901:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985088 00000100:00100000:2.0:1786562853.921931:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1786562853.921948:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654985088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.922453:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654985088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 513us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.922461:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1786562853.922553:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.922589:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.922633:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.922658:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.922834:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985216 00000100:00100000:2.0:1786562853.922839:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985216 00000100:00100000:2.0:1786562853.922863:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1786562853.922869:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654985216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.923052:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654985216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.923062:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1786562853.923377:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.923824:0:42341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42341:1873345654985344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562853.923865:0:42341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.923898:0:42341:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020000 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.923951:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985344 00000100:00100000:2.0:1786562853.923957:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985344 00000100:00100000:2.0:1786562853.923979:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1786562853.923986:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:42341:x1873345654985344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562853.925394:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:42341:x1873345654985344:12345-0@lo:502:llog_process_th.0 Request processed in 1403us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.925408:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1786562853.925532:0:42341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42341:1873345654985344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562853.925596:0:42341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42341:1873345654985472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562853.925640:0:42341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.925676:0:42341:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bff40240 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.925730:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985472 00000100:00100000:1.0:1786562853.925737:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985472 00000100:00100000:1.0:1786562853.925773:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786562853.925781:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:42341:x1873345654985472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562853.925963:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:42341:x1873345654985472:12345-0@lo:502:llog_process_th.0 Request processed in 182us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.925970:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1786562853.925979:0:42341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42341:1873345654985472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786562853.925997:0:42341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1786562853.926168:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1786562853.926186:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786562853.926197:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.926207:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562853.926216:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1786562853.926218:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1786562853.926221:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786562853.926246:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.926258:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.926267:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562853.926281:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.926312:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.926479:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9867aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.926530:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985600 00000100:00100000:1.0:1786562853.926535:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985600 00000100:00100000:1.0:1786562853.926567:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1786562853.926575:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654985600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562853.926584:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562853.926598:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a186a expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.926619:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a186a expref: 16 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.926629:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a186a expref: 16 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.926637:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557200, rc 0) 00000100:00100000:2.0:1786562853.926807:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562853.926819:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.926829:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562853.926882:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.926911:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562853.926936:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.926976:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654985600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.926984:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1786562853.927072:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985728 00000100:00100000:1.0:1786562853.927077:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985728 00000100:00100000:1.0:1786562853.927096:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1786562853.927103:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654985728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562853.927790:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654985728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 685us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.927799:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1786562853.927957:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.927992:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.928051:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562853.928083:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.928155:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985856 00000100:00100000:0.0:1786562853.928161:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985856 00000100:00100000:0.0:1786562853.928357:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1786562853.928368:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654985856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.928596:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654985856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.928857:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786562853.930070:0:42342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000100:00100000:0.0:1786562853.930431:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000020:01000000:3.0:1786562853.930628:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786562853.930653:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786562853.930663:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.930675:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562853.930775:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562853.930777:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e98318c000 from 52 10000000:01000000:3.0:1786562853.930781:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562853.930814:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.930823:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.930834:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562853.930855:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.930906:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.930987:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.931304:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654985984 00000100:00100000:1.0:1786562853.931311:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654985984 00000100:00100000:2.0:1786562853.931459:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1786562853.931470:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654985984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562853.931484:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562853.931498:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1878 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.931520:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 17 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.931532:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 17 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.931540:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfdc00, rc 0) 00000100:00100000:2.0:1786562853.931594:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654985984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.931601:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786562853.931663:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654985984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562853.931688:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562853.931698:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562853.931751:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.931778:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.931976:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.932082:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986112 00000100:00100000:0.0:1786562853.932087:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986112 00000100:00100000:0.0:1786562853.932106:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1786562853.932113:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654986112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.932365:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654986112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.932372:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1786562853.932458:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.932487:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.932528:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562853.932554:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882020a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.932874:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986240 00000100:00100000:0.0:1786562853.932879:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986240 00000100:00100000:0.0:1786562853.932901:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1786562853.932908:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654986240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.933103:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654986240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.933110:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786562853.933652:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.936972:0:42343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42343:1873345654986368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.942367:0:42343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.942455:0:42343:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc1b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.942531:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986368 00000100:00100000:1.0:1786562853.942541:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986368 00000100:00100000:1.0:1786562853.942624:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1786562853.942635:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:42343:x1873345654986368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562853.942957:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:42343:x1873345654986368:12345-0@lo:502:llog_process_th.0 Request processed in 323us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.942966:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1786562853.943065:0:42343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42343:1873345654986368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.943150:0:42343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42343:1873345654986496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562853.943189:0:42343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.947049:0:42343:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf89acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.951406:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986496 00000100:00100000:2.0:1786562853.951423:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986496 00000100:00100000:2.0:1786562853.951499:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1786562853.951509:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:42343:x1873345654986496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562853.951909:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:42343:x1873345654986496:12345-0@lo:502:llog_process_th.0 Request processed in 392us (8709us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562853.951917:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1786562853.953393:0:42343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42343:1873345654986496:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786562853.953447:0:42343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1786562853.953883:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1786562853.953907:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786562853.953918:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.953933:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562853.953955:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786562853.953959:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1786562853.953962:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786562853.953997:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.954051:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.954062:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562853.954085:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.954335:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562853.954381:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd46f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.954437:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986624 00000100:00100000:0.0:1786562853.954443:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986624 00000100:00100000:0.0:1786562853.954476:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1786562853.954484:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654986624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562853.954496:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562853.954507:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1886 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.954527:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.954537:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.954550:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6c000, rc 0) 00000100:00100000:0.0:1786562853.954595:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654986624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.954601:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1786562853.954668:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562853.954693:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562853.954702:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562853.954750:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.954774:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562853.954795:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd46f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.954860:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986752 00000100:00100000:0.0:1786562853.954864:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986752 00000100:00100000:0.0:1786562853.954880:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1786562853.954884:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654986752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.955175:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654986752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.955182:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1786562853.955471:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.955502:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562853.955543:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562853.955558:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88bd46f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562853.955603:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654986880 00000100:00100000:0.0:1786562853.955607:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654986880 00000100:00100000:0.0:1786562853.955628:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1786562853.955635:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654986880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.955878:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654986880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562853.955885:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786562853.955999:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654986880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786562853.961430:0:42344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:0.0:1786562853.961831:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1786562853.961853:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786562853.961865:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.961876:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562853.961892:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786562853.961895:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90e9a99d4d40 from 1 10000000:01000000:0.0:1786562853.961898:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786562853.961935:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.961956:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.961968:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562853.961994:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654987008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.962084:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.962137:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99258fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562853.962987:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654987008 00000100:00100000:1.0:1786562853.962996:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654987008 00000100:00100000:1.0:1786562853.963070:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1786562853.963080:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654987008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562853.963094:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562853.963112:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1894 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.963312:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 19 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.963324:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 19 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562853.963332:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557400, rc 0) 00000100:00100000:1.0:1786562853.963391:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654987008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562853.963398:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1786562853.963490:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654987008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562853.963508:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.963517:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562853.963575:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654987136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562853.963607:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562853.963697:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99258fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1786562853.964713:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654987136 00000100:00100000:2.0:1786562853.964723:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654987136 00000100:00100000:3.0:1786562853.968342:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1786562853.968380:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654987136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562853.968928:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654987136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 569us (5317us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786562853.968949:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1786562853.969451:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654987136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786562853.969493:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786562853.969505:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562853.969515:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562854.646880:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562854.648278:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022080 00000100:00100000:3.0:1786562854.648297:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022080 00000100:00100000:3.0:1786562854.648454:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 482 00000100:00100000:3.0:1786562854.648469:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+8:41781:x1873345653022080:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562854.648491:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562854.648512:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd816 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562854.648543:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562854.648554:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562854.648563:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:3.0:1786562854.648650:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653022080:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562854.648657:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 482 00000100:00100000:2.0:1786562854.655422:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562854.655740:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022208 00000100:00100000:1.0:1786562854.655750:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022208 00000100:00100000:1.0:1786562854.655809:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 483 00000100:00100000:1.0:1786562854.655820:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653022208:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562854.656481:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653022208:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 659us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562854.656491:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 483 00000100:00100000:2.0:1786562854.668519:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562854.671783:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022336 00000100:00100000:3.0:1786562854.671799:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022336 00000100:00100000:3.0:1786562854.671861:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 484 00000100:00100000:3.0:1786562854.671870:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653022336:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562854.672719:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653022336:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 847us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562854.672730:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 484 00000100:00100000:0.0:1786562854.676607:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562854.676782:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022464 00000100:00100000:2.0:1786562854.676793:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022464 00000100:00100000:2.0:1786562854.676841:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 485 00000100:00100000:2.0:1786562854.676851:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:72398:x1873345653022464:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786562854.677166:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:72398:x1873345653022464:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 315us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562854.677175:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 485 00000100:00100000:2.0:1786562854.687082:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562854.687134:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022592 00000100:00100000:2.0:1786562854.687143:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022592 00000100:00100000:2.0:1786562854.687202:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 486 00000100:00100000:2.0:1786562854.687339:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:72398:x1873345653022592:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786562854.687580:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:72398:x1873345653022592:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 245us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562854.687592:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 486 00010000:00010000:3.0:1786562854.694545:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562854.696240:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562854.696369:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022720 00000100:00100000:3.0:1786562854.696379:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022720 00000100:00100000:3.0:1786562854.696549:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 487 00000100:00100000:3.0:1786562854.696561:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653022720:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562854.696580:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562854.696598:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd81d expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562854.696627:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 10 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562854.696639:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 10 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562854.696649:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1000, rc 0) 00000100:00100000:3.0:1786562854.696717:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653022720:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 158us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562854.696912:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 487 00000100:00100000:2.0:1786562854.702089:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562854.704183:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022848 00000100:00100000:1.0:1786562854.704331:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022848 00000100:00100000:1.0:1786562854.704395:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 488 00000100:00100000:1.0:1786562854.704405:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653022848:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562854.704760:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653022848:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 355us (2808us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786562854.704769:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 488 00000100:00100000:1.0:1786562855.225372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562855.225414:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562855.225450:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562855.225478:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562855.225506:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653022976 00000100:00100000:0.0:1786562855.225507:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023360 00000100:00100000:1.0:1786562855.225515:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653022976 00000100:00100000:0.0:1786562855.225515:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023360 00000100:00100000:0.0:1786562855.225631:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023232 00000100:00100000:1.0:1786562855.225635:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 489 00000100:00100000:0.0:1786562855.225635:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023232 00000100:00100000:1.0:1786562855.225644:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653022976:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562855.225655:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 618 00000100:00100000:0.0:1786562855.225661:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653023360:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562855.225726:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023104 00000100:00100000:3.0:1786562855.225731:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023104 00000100:00100000:3.0:1786562855.225766:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 517 00000100:00100000:3.0:1786562855.225773:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345653023104:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562855.225905:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653023360:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 244us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562855.225925:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 618 00000100:00100000:0.0:1786562855.225944:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 619 00000100:00100000:0.0:1786562855.225951:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653023232:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562855.229477:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653022976:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 3821us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.229492:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 489 00000100:00100000:3.0:1786562855.229956:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345653023104:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 4178us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562855.229967:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 517 00000100:00080000:3.0:1786562855.230243:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562855.230250:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562855.230253:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562855.230444:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653023232:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 4491us (4962us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562855.230455:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 619 00000020:00000080:3.0:1786562855.566559:0:42392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffedec0a370 20000000:00000080:3.0:1786562855.566579:0:42392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90e882128400 uarg=0000000000000000 00000040:00100000:3.0:1786562855.568386:0:42392:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 48 20000000:01000000:3.0:1786562855.568397:0:42392:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 50 cmd:0xce021 lustre.test_204f lustre-OST0001_UUID 20000000:01000000:3.0:1786562855.568415:0:42392:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_204f.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1786562855.569326:0:42393:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 29 1->4: lustre-clilov add lustre.test_204f.lustre-OST0001_UUID 20000000:01000000:1.0:1786562855.569432:0:42393:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 51 marker 29 2->4: lustre-clilov add lustre.test_204f.lustre-OST0001_UUID 00000040:00080000:1.0:1786562855.569482:0:42393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000040:00080000:3.0:1786562855.569975:0:42392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off18000 20000000:01000000:3.0:1786562855.569992:0:42392:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre test_204f lustre-OST0001_UUID (null) 00000040:00080000:3.0:1786562855.570289:0:42392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off18136 00000040:00080000:3.0:1786562855.570336:0:42392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18360 20000000:01000000:3.0:1786562855.570354:0:42392:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_204f.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1786562855.570861:0:42394:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 43 marker 30 1->4: lustre-MDT0000-mdtlov add lustre.test_204f.lustre-OST0001_UUID 20000000:01000000:1.0:1786562855.570934:0:42394:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 45 marker 30 2->4: lustre-MDT0000-mdtlov add lustre.test_204f.lustre-OST0001_UUID 00000040:00080000:1.0:1786562855.571313:0:42394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000040:00080000:3.0:1786562855.571784:0:42392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off17200 20000000:01000000:3.0:1786562855.571800:0:42392:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_204f lustre-OST0001_UUID (null) 00000040:00080000:3.0:1786562855.571837:0:42392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off17344 00000040:00080000:3.0:1786562855.571895:0:42392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17568 10000000:01000000:3.0:1786562855.571922:0:42392:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1786562855.571943:0:42392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.571970:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.571989:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a184e expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.571996:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a185c expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572386:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a186a expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572397:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572404:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572411:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572421:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572429:0:42392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572436:0:42392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572483:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572497:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 9 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.572512:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987264:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562855.572727:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572737:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.572746:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987392:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562855.572780:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572788:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.572797:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987520:0@lo:104: 00000100:00100000:3.0:1786562855.572836:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562855.572878:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.572887:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.572901:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987648:0@lo:104: 00000100:00100000:3.0:1786562855.572934:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562855.572997:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.573033:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.573042:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987776:0@lo:104: 00000100:00100000:3.0:1786562855.573063:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562855.573552:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a186a expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.573561:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a186a expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.573569:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987904:0@lo:104: 00000100:00100000:3.0:1786562855.573591:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.573654:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654987520 00000100:00100000:1.0:1786562855.573661:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654987520 00000100:00100000:1.0:1786562855.573697:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654987648 00000100:00100000:1.0:1786562855.573700:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654987648 00000100:00100000:1.0:1786562855.573710:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654987776 00000100:00100000:1.0:1786562855.573712:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654987776 00000100:00100000:1.0:1786562855.573725:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786562855.573733:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+5:42392:x1873345654987520:12345-0@lo:104: 00010000:00010000:1.0:1786562855.573746:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.573805:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786562855.573810:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+5:42392:x1873345654987520:12345-0@lo:104: Request processed in 78us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.573817:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786562855.573833:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786562855.573839:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+4:42392:x1873345654987648:12345-0@lo:104: 00010000:00010000:1.0:1786562855.573847:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.573878:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786562855.573882:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+4:42392:x1873345654987648:12345-0@lo:104: Request processed in 45us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.573888:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786562855.573900:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786562855.573918:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+3:42392:x1873345654987776:12345-0@lo:104: 00010000:00010000:1.0:1786562855.573926:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.573959:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1786562855.573964:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+3:42392:x1873345654987776:12345-0@lo:104: Request processed in 59us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.573971:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1786562855.573988:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786562855.573993:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574001:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6ce00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562855.574021:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574029:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562855.574036:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562855.574042:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562855.574071:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574077:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562855.574098:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574105:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ce00/0x5c655bf6668a1894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a189b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574121:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786562855.574124:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574142:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfd200 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562855.574145:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574152:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562855.574173:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562855.574177:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562855.574190:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574196:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562855.574201:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574208:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e982bfd200/0x5c655bf6668a1886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a188d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574217:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562855.574219:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574225:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0600 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562855.574227:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574233:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786562855.574238:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562855.574243:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562855.574257:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574263:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562855.574278:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574284:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e991eb0600/0x5c655bf6668a1878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a187f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574306:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562855.574308:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562855.574310:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562855.574316:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562855.574321:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562855.574332:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654988032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.574362:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.574386:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786562855.574392:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654988160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.574411:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.574438:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654988288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.574460:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.574491:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988032 00000100:00100000:1.0:1786562855.574496:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988032 00010000:00010000:1.0:1786562855.574516:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 19 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.574537:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988160 00000100:00100000:1.0:1786562855.574540:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988160 00010000:00010000:1.0:1786562855.574552:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 20 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.574570:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988288 00000100:00100000:1.0:1786562855.574573:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988288 00010000:00010000:1.0:1786562855.574582:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 21 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.574598:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8833 00000100:00100000:1.0:1786562855.574605:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+21:3291:x1873345654988032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.574616:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.574621:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 21 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574630:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 21 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574647:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.574675:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+21:3291:x1873345654988032:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.574681:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8833 00000100:00100000:1.0:1786562855.574695:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8834 00000100:00100000:1.0:1786562855.574701:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+20:3291:x1873345654988160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.574709:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.574713:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 20 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574721:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 20 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574731:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.574752:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+20:3291:x1873345654988160:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.574757:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8834 00000100:00100000:1.0:1786562855.574770:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8835 00000100:00100000:1.0:1786562855.574776:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654988288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.574784:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.574788:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 19 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574795:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 19 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.574804:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.574829:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3289:x1873345654988288:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.574835:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8835 00000100:00100000:1.0:1786562855.574874:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654988288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.574900:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654988160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.574921:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654988032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562855.575493:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a185c expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.575505:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a185c expref: 18 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.575516:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654988416:0@lo:104: 00000100:00100000:3.0:1786562855.575543:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562855.575776:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a184e expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.575788:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a184e expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.575796:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654988544:0@lo:104: 00000100:00100000:3.0:1786562855.575818:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562855.575835:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654987904 00000100:00100000:2.0:1786562855.575841:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654987904 00000100:00100000:2.0:1786562855.575868:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988416 00000100:00100000:2.0:1786562855.575871:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988416 00000100:00100000:2.0:1786562855.575886:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786562855.575892:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:42392:x1873345654987904:12345-0@lo:104: 00010000:00010000:2.0:1786562855.575915:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.575960:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786562855.575966:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:42392:x1873345654987904:12345-0@lo:104: Request processed in 74us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562855.575972:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786562855.576000:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786562855.576027:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:42392:x1873345654988416:12345-0@lo:104: 00010000:00010000:2.0:1786562855.576035:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576068:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786562855.576073:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:42392:x1873345654988416:12345-0@lo:104: Request processed in 48us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562855.576079:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1786562855.576095:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786562855.576100:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576108:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d600 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562855.576111:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576119:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562855.576137:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562855.576143:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562855.576176:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576183:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562855.576198:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576205:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e99ff6d600/0x5c655bf6668a186a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1871 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576215:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562855.576218:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576223:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0e00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562855.576225:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576235:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562855.576241:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562855.576246:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562855.576258:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576263:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562855.576274:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576281:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e991eb0e00/0x5c655bf6668a185c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1863 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.576301:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562855.576302:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562855.576304:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562855.576566:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562855.576579:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654988672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.576610:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.576682:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562855.576691:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654988800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.576715:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786562855.576794:0:42392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.576804:0:42392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 18 pid: 33109 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.576813:0:42392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654988928:0@lo:104: 00000100:00100000:3.0:1786562855.576838:0:42392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562855.576854:0:42392:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f900 going to sleep for 11 seconds 00010000:00010000:3.0:1786562855.576872:0:42392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990557400/0x5c655bf6668a189b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1894 expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.576882:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987520:0@lo:104: 00010000:00010000:3.0:1786562855.576893:0:42392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e99ff6c000/0x5c655bf6668a188d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1886 expref: 17 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.576901:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987648:0@lo:104: 00010000:00010000:3.0:1786562855.576925:0:42392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfdc00/0x5c655bf6668a187f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1878 expref: 16 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.576933:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98553ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987776:0@lo:104: 00000100:00100000:3.0:1786562855.576943:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987904:0@lo:104: 00000100:00100000:3.0:1786562855.576950:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654988416:0@lo:104: 00000100:00100000:2.0:1786562855.577050:0:5852:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786562855.577061:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988544 00000100:00100000:2.0:1786562855.577066:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988544 00000100:00100000:2.0:1786562855.577095:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988928 00000100:00100000:2.0:1786562855.577098:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988928 00000100:00100000:2.0:1786562855.577112:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786562855.577119:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:42392:x1873345654988544:12345-0@lo:104: 00010000:00010000:2.0:1786562855.577138:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.577194:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786562855.577200:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+4:42392:x1873345654988544:12345-0@lo:104: Request processed in 82us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562855.577207:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786562855.577222:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786562855.577228:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bafb3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:42392:x1873345654988928:12345-0@lo:104: 00010000:00010000:2.0:1786562855.577236:0:5852:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562855.577268:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786562855.577273:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bafb3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c95f678-1633-48c9-bbd9-793f47c06679+3:42392:x1873345654988928:12345-0@lo:104: Request processed in 46us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562855.577278:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786562855.577492:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654988544:0@lo:104: 00000100:00100000:3.0:1786562855.577500:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654988928:0@lo:104: 00010000:00010000:3.0:1786562855.577520:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786562855.577525:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577531:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562855.577534:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577542:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562855.577548:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562855.577553:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562855.577578:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577584:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562855.577596:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577603:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e991eb1e00/0x5c655bf6668a184e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1855 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577623:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562855.577628:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577634:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c200 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:3.0:1786562855.577637:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577644:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786562855.577651:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562855.577657:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786562855.577669:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577675:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786562855.577687:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577694:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c200/0x5c655bf6668a1840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1847 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.577706:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562855.577708:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562855.577710:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562855.577719:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654989184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562855.577747:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.577960:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654989056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786562855.578223:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562855.578445:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988672 00000100:00100000:1.0:1786562855.578452:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988672 00010000:00010000:1.0:1786562855.578476:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a186a expref: 16 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.578506:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654988800 00000100:00100000:1.0:1786562855.578509:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654988800 00010000:00010000:1.0:1786562855.578521:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a185c expref: 17 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.578538:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989184 00000100:00100000:1.0:1786562855.578540:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989184 00010000:00010000:1.0:1786562855.578550:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 18 pid: 33109 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.578567:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8836 00000100:00100000:1.0:1786562855.578574:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+18:3290:x1873345654988672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.578588:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.578594:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a186a expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578603:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a186a expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578618:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990557200/0x5c655bf6668a1871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a186a expref: 18 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578629:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.578663:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+17:3290:x1873345654988672:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.578672:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8836 00000100:00100000:1.0:1786562855.578688:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8837 00000100:00100000:1.0:1786562855.578694:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+16:3292:x1873345654988800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.578701:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.578705:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a185c expref: 16 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578713:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a185c expref: 16 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578722:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e99ff6c400/0x5c655bf6668a1863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a185c expref: 16 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578730:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.578751:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+15:3292:x1873345654988800:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.578757:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8837 00000100:00100000:1.0:1786562855.578797:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8838 00000100:00100000:1.0:1786562855.578803:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+14:3289:x1873345654989184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.578810:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.578814:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 14 pid: 33109 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578822:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 14 pid: 33109 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578831:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e991eb0a00/0x5c655bf6668a1847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a1840 expref: 14 pid: 33109 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.578855:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.578882:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+13:3289:x1873345654989184:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.578888:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8838 00000100:00100000:1.0:1786562855.578930:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345654988672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.578956:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654989184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.578973:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562855.578994:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654988800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.579032:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989056 00000100:00100000:1.0:1786562855.579036:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989056 00010000:00010000:1.0:1786562855.579049:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a184e expref: 13 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.579062:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8839 00000100:00100000:1.0:1786562855.579067:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+13:3292:x1873345654989056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.579074:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.579077:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a184e expref: 13 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.579086:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a184e expref: 13 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.579096:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfc000/0x5c655bf6668a1855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a184e expref: 13 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.579105:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.579142:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c95f678-1633-48c9-bbd9-793f47c06679+12:3292:x1873345654989056:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.579148:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8839 00000100:00100000:1.0:1786562855.579182:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654989056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562855.579575:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562855.579608:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023488 00000100:00100000:1.0:1786562855.579612:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023488 00010000:00010000:1.0:1786562855.579629:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 10 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.579649:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8840 00000100:00100000:1.0:1786562855.579655:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653023488:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.579663:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.579668:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 10 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.579678:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 10 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.579689:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.579727:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653023488:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.579734:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8840 00010000:00010000:3.0:1786562855.580486:0:42392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd81d expref: 9 pid: 33108 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562855.580514:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987264:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562855.580524:0:42392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42392:1873345654987392:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562855.580563:0:42392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562855.580931:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562855.580991:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023616 00000100:00100000:1.0:1786562855.580996:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023616 00010000:00010000:1.0:1786562855.581051:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562855.581076:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8841 00000100:00100000:1.0:1786562855.581086:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+9:2349:x1873345653023616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562855.581098:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562855.581406:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581421:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581436:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e991eb1c00/0x5c655bf6668a18a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd816 expref: 9 pid: 33107 timeout: 1388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581454:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581461:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581476:0:8413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581482:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581489:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581495:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581501:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562855.581505:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.581513:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.581656:0:42392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562855.581664:0:42392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.582369:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.582379:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e991eb1200/0x5c655bf6668a18b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562855.582399:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562855.582494:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0b4bd338-b43c-4989-b811-79054f6124e2+8:2349:x1873345653023616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1407us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562855.582504:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8841 00010000:00010000:1.0:1786562855.717382:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562856.229550:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786562856.229576:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562856.229660:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562856.230060:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989312 00000100:00100000:2.0:1786562856.230070:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989312 00000100:00100000:2.0:1786562856.230145:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1786562856.230156:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654989312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562856.230197:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:2.0:1786562856.230250:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345654989312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562856.230259:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00080000:3.0:1786562856.230884:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562856.230941:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345654989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562856.231196:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562856.231242:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562856.231289:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989440 00000100:00100000:1.0:1786562856.231294:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989440 00000100:00100000:1.0:1786562856.231327:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1786562856.231334:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654989440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562856.231367:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54722560 pending 0 free 3844079616 avail 3841982464 00000100:00100000:1.0:1786562856.231542:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873345654989440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562856.231549:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1786562856.231586:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345654989440:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786562856.231830:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562856.231916:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654989824:0@lo:400:kworker.0 00000100:00100000:3.0:1786562856.231950:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562856.231982:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562856.231988:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654989696:0@lo:400:kworker.0 00000100:00100000:3.0:1786562856.232038:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562856.232068:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989824 00000100:00100000:3.0:1786562856.232072:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989824 00000100:00100000:3.0:1786562856.232099:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989696 00000100:00100000:3.0:1786562856.232102:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989696 00000100:00100000:0.0:1786562856.232264:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786562856.232275:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654989824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562856.232320:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1873345654989824:12345-0@lo:400:kworker.0 Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562856.232329:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786562856.232352:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562856.232359:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654989568:0@lo:400:kworker.0 00000100:00100000:0.0:1786562856.232384:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562856.232422:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989568 00000100:00100000:0.0:1786562856.232426:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989568 00000100:00100000:3.0:1786562856.233949:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1786562856.233961:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654989696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562856.234050:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786562856.234058:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654989568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562856.234287:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1873345654989824:0@lo:400:kworker.0 00000100:00100000:3.0:1786562856.234464:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654989696:12345-0@lo:400:kworker.0 Request processed in 506us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562856.234472:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00080000:3.0:1786562856.234493:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562856.235096:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654989696:0@lo:400:kworker.0 00000100:00100000:0.0:1786562856.235609:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345654989568:12345-0@lo:400:kworker.0 Request processed in 1549us (3220us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562856.235619:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1786562856.235750:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345654989568:0@lo:400:kworker.0 00010000:00010000:2.0:1786562856.741323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786562856.997144:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786562856.997153:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e8812d5800 from 55 10000000:01000000:0.0:1786562856.997159:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786562856.997215:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562856.997228:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562856.997240:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562856.997283:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654989952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562856.997367:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562856.997440:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562856.998464:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654989952 00000100:00100000:2.0:1786562856.998478:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654989952 00000100:00100000:2.0:1786562856.998546:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1786562856.998556:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+12:5818:x1873345654989952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562856.998571:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562856.998590:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a18b7 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562856.998632:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 13 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562856.998643:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 13 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562856.998653:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562856.998730:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654989952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562856.998738:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1786562856.999123:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654989952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562856.999141:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562856.999153:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562856.999225:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562856.999257:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562856.999293:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562856.999349:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990080 00000100:00100000:1.0:1786562856.999355:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990080 00000100:00100000:1.0:1786562856.999391:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1786562856.999397:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654990080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562856.999670:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654990080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562856.999678:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1786562857.000187:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562857.000223:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562857.000271:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562857.000312:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.000529:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990208 00000100:00100000:2.0:1786562857.000536:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990208 00000100:00100000:2.0:1786562857.000588:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1786562857.000597:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654990208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562857.000796:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654990208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.000804:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786562857.001042:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.001771:0:42396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42396:1873345654990336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562857.001821:0:42396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.001858:0:42396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.001971:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990336 00000100:00100000:2.0:1786562857.001976:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990336 00000100:00100000:2.0:1786562857.002042:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1786562857.002052:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:42396:x1873345654990336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562857.002972:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:42396:x1873345654990336:12345-0@lo:502:llog_process_th.0 Request processed in 918us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.002984:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1786562857.003964:0:42396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42396:1873345654990336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562857.004061:0:42396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42396:1873345654990464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562857.004116:0:42396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.004162:0:42396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.004232:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990464 00000100:00100000:3.0:1786562857.004238:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990464 00000100:00100000:3.0:1786562857.004284:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1786562857.004294:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:42396:x1873345654990464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562857.004494:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:42396:x1873345654990464:12345-0@lo:502:llog_process_th.0 Request processed in 201us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.004502:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1786562857.005440:0:42396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42396:1873345654990464:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786562857.005473:0:42396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1786562857.005727:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1786562857.005747:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786562857.005758:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.005770:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786562857.005779:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786562857.005782:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:0.0:1786562857.005785:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786562857.005816:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.005824:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.005834:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562857.005851:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786562857.005906:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562857.005942:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.006094:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990592 00000100:00100000:2.0:1786562857.006101:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990592 00000100:00100000:2.0:1786562857.006149:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1786562857.006159:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654990592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562857.006172:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562857.006198:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a18c5 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.006223:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.006234:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 14 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.006242:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562857.006344:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654990592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.006351:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1786562857.015635:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562857.015665:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.015677:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.015771:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.015831:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.016204:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.026070:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990720 00000100:00100000:3.0:1786562857.026087:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990720 00000100:00100000:3.0:1786562857.026152:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1786562857.026164:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654990720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.026526:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654990720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (10693us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.026534:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1786562857.027896:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.027967:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.028071:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.028113:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.031596:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990848 00000100:00100000:3.0:1786562857.031630:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990848 00000100:00100000:3.0:1786562857.031704:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1786562857.031725:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654990848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.031998:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654990848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (3926us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562857.032139:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654990848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.032453:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1786562857.033192:0:42397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42397:1873345654990976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562857.033257:0:42397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562857.033299:0:42397:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.033687:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654990976 00000100:00100000:2.0:1786562857.033695:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654990976 00000100:00100000:2.0:1786562857.033756:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1786562857.033768:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:42397:x1873345654990976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562857.034104:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:42397:x1873345654990976:12345-0@lo:502:llog_process_th.0 Request processed in 339us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.034118:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1786562857.034694:0:42397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42397:1873345654990976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786562857.034746:0:42397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786562857.034760:0:42397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786562857.034763:0:42397:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre-MDT0000-m rem lustre.test_204f.lustre-OST0001_UUID 00000020:00000080:0.0:1786562857.034768:0:42397:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1786562857.034785:0:42397:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from test_204f 00000100:00100000:2.0:1786562857.036330:0:42397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42397:1873345654991104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562857.036403:0:42397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1786562857.036518:0:42398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e8812d5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1786562857.036523:0:42398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e8812d5800 4 00000100:00100000:2.0:1786562857.036686:0:42397:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227540 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.041368:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991104 00000100:00100000:3.0:1786562857.041386:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991104 00000100:00100000:3.0:1786562857.041512:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1786562857.041523:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:42397:x1873345654991104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562857.041838:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:42397:x1873345654991104:12345-0@lo:502:llog_process_th.0 Request processed in 316us (5434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.041848:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1786562857.041957:0:42397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42397:1873345654991104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786562857.041991:0:42397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786562857.041999:0:42397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786562857.042001:0:42397:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre-MDT0000-m rem lustre.test_204f.lustre-OST0001_UUID 00000040:00080000:0.0:1786562857.042035:0:42397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1786562857.042214:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:1.0:1786562857.042244:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786562857.042257:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.042269:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562857.042280:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786562857.042283:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e988fe0000 from 55 10000000:01000000:1.0:1786562857.042286:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786562857.042318:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.042328:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.042337:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.042360:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.042405:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.043424:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.043484:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991232 00000100:00100000:2.0:1786562857.043492:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991232 00000100:00100000:2.0:1786562857.043530:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1786562857.043539:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654991232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562857.043552:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562857.043568:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a18d3 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.043594:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 15 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.043605:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 15 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.043629:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfce00, rc 0) 00000100:00100000:2.0:1786562857.043678:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654991232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.043684:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1786562857.043909:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562857.043925:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.043935:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.043994:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.044049:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.044065:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.044102:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991360 00000100:00100000:3.0:1786562857.044106:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991360 00000100:00100000:3.0:1786562857.044127:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1786562857.044133:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654991360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.048052:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654991360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3910us (3993us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.048068:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1786562857.048227:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.048285:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.048351:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.048382:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.048552:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991488 00000100:00100000:3.0:1786562857.048560:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991488 00000100:00100000:3.0:1786562857.048590:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1786562857.048599:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654991488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.050115:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654991488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1511us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.050128:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1786562857.053131:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.053658:0:42399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42399:1873345654991616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562857.053753:0:42399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562857.053803:0:42399:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e88202a540 going to sleep for 11 seconds 00000100:00100000:0.0:1786562857.053920:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991616 00000100:00100000:0.0:1786562857.053927:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991616 00000100:00100000:0.0:1786562857.053975:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1786562857.053985:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:42399:x1873345654991616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562857.054296:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:42399:x1873345654991616:12345-0@lo:502:llog_process_th.0 Request processed in 311us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562857.054305:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1786562857.054558:0:42399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42399:1873345654991616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562857.054606:0:42399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42399:1873345654991744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562857.054645:0:42399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562857.054681:0:42399:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e983227000 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.054749:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991744 00000100:00100000:3.0:1786562857.054755:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991744 00000100:00100000:3.0:1786562857.054792:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1786562857.054800:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:42399:x1873345654991744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562857.054959:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:42399:x1873345654991744:12345-0@lo:502:llog_process_th.0 Request processed in 159us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.054966:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1786562857.057061:0:42399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42399:1873345654991744:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786562857.057109:0:42399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1786562857.057718:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1786562857.057865:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786562857.057891:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.057905:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562857.057917:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1786562857.057919:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1786562857.057923:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786562857.057969:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.057978:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.057988:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.058038:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.058106:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562857.058159:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654991872 00000100:00100000:1.0:1786562857.058160:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.058170:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654991872 00000100:00100000:3.0:1786562857.058435:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1786562857.058445:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654991872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562857.058458:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562857.058471:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a18e1 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562857.058495:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 16 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562857.058505:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 16 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562857.058515:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1000, rc 0) 00000100:00100000:3.0:1786562857.058566:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e8872fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654991872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.058574:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1786562857.058646:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654991872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562857.058662:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.058671:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.058738:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.058765:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.059047:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.059752:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992000 00000100:00100000:2.0:1786562857.059760:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992000 00000100:00100000:2.0:1786562857.059797:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786562857.059806:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654992000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562857.061920:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654992000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2108us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.061932:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1786562857.062077:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.062127:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.062169:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.062209:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.064648:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992128 00000100:00100000:3.0:1786562857.064664:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992128 00000100:00100000:3.0:1786562857.064805:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1786562857.064817:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654992128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.065125:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654992128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 310us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.065133:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1786562857.065246:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786562857.067940:0:42400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:1.0:1786562857.068031:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1786562857.068049:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786562857.068063:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.068075:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562857.068085:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786562857.068088:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e98318c000 from 55 10000000:01000000:1.0:1786562857.068091:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786562857.068131:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.068140:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.068152:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.068180:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.068250:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.070021:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.070303:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992256 00000100:00100000:2.0:1786562857.070313:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992256 00000100:00100000:2.0:1786562857.071982:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786562857.071996:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654992256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562857.072027:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562857.072045:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a18ef expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.072075:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 17 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.072086:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 17 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.072095:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562857.072166:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654992256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.072172:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1786562857.072840:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562857.072863:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.072888:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.072991:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.073063:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.073103:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.073844:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992384 00000100:00100000:2.0:1786562857.073852:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992384 00000100:00100000:2.0:1786562857.073908:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1786562857.073918:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654992384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562857.074222:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654992384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.074230:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1786562857.074271:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.074317:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.074361:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.074384:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.074900:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992512 00000100:00100000:3.0:1786562857.074908:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992512 00000100:00100000:3.0:1786562857.074956:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1786562857.074964:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654992512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.075201:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654992512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.075209:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1786562857.075229:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562857.078805:0:42401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42401:1873345654992640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562857.078915:0:42401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562857.079196:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992640 00000100:00100000:2.0:1786562857.079203:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992640 00000100:00100000:2.0:1786562857.079244:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1786562857.079253:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:42401:x1873345654992640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562857.079522:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:42401:x1873345654992640:12345-0@lo:502:llog_process_th.0 Request processed in 269us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.079530:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1786562857.079640:0:42401:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9baeb6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562857.079663:0:42401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42401:1873345654992640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562857.079718:0:42401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42401:1873345654992768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562857.079752:0:42401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562857.079782:0:42401:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e98f611240 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.080189:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992768 00000100:00100000:3.0:1786562857.080195:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992768 00000100:00100000:3.0:1786562857.080239:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1786562857.080247:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:42401:x1873345654992768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562857.080409:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:42401:x1873345654992768:12345-0@lo:502:llog_process_th.0 Request processed in 161us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.080416:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1786562857.081163:0:42401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42401:1873345654992768:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786562857.081199:0:42401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1786562857.082426:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1786562857.082464:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786562857.082476:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.082488:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562857.082498:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786562857.082500:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1786562857.082503:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786562857.082542:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.082550:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.082561:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.082586:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.082658:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.082698:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:0.0:1786562857.083547:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654992896 00000100:00100000:0.0:1786562857.083556:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654992896 00000100:00100000:0.0:1786562857.083607:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1786562857.083617:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654992896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562857.083632:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562857.083648:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a18fd expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.083675:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.083687:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.083700:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6ce00, rc 0) 00000100:00100000:0.0:1786562857.083755:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654992896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562857.083762:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1786562857.083928:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654992896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562857.083954:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.083963:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562857.084055:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.084085:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.084107:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1786562857.084122:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654993024 00000100:00100000:1.0:1786562857.084127:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654993024 00000100:00100000:1.0:1786562857.084152:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1786562857.084158:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654993024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.084436:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654993024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562857.084443:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1786562857.084475:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.084501:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.084539:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562857.084559:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd2600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562857.085711:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654993152 00000100:00100000:2.0:1786562857.085720:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654993152 00000100:00100000:2.0:1786562857.085766:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1786562857.085775:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654993152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562857.085991:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654993152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562857.085998:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1786562857.088084:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786562857.092755:0:42402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1786562857.093039:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1786562857.093067:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786562857.093080:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.093091:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562857.093107:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786562857.093109:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90e9a99d4d40 from 1 10000000:01000000:2.0:1786562857.093112:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786562857.093151:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.093159:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.093171:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562857.093196:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562857.093267:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562857.093308:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e981254600 going to sleep for 11 seconds 00000100:00100000:0.0:1786562857.095991:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654993280 00000100:00100000:0.0:1786562857.096031:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654993280 00000100:00100000:0.0:1786562857.096114:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1786562857.096125:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654993280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562857.096142:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562857.096174:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a190b expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.096204:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a190b expref: 19 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.096215:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a190b expref: 19 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.096224:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6c200, rc 0) 00000100:00100000:0.0:1786562857.096305:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654993280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562857.096312:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1786562857.096413:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562857.096436:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562857.096445:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562857.096516:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562857.096563:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562857.096643:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e981254600 going to sleep for 11 seconds 00000100:00100000:3.0:1786562857.100020:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654993408 00000100:00100000:3.0:1786562857.100036:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654993408 00000100:00100000:3.0:1786562857.100098:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1786562857.100109:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654993408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.100408:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654993408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (3843us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786562857.100417:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1786562857.100526:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654993408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786562857.100566:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786562857.100577:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562857.100592:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562857.532153:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562857.532500:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023744 00000100:00100000:3.0:1786562857.532510:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023744 00000100:00100000:3.0:1786562857.532570:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 518 00000100:00100000:3.0:1786562857.532581:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+8:41781:x1873345653023744:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562857.532598:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562857.532615:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd824 expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562857.532643:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562857.532654:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562857.532662:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1e00, rc 0) 00000100:00100000:3.0:1786562857.532724:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653023744:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 145us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.532731:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 518 00000100:00100000:2.0:1786562857.537447:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562857.538061:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653023872 00000100:00100000:3.0:1786562857.538209:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653023872 00000100:00100000:3.0:1786562857.538415:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 519 00000100:00100000:3.0:1786562857.538430:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653023872:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.539813:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653023872:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 1378us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.539830:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 519 00000100:00100000:2.0:1786562857.543460:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562857.543820:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024000 00000100:00100000:1.0:1786562857.543835:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024000 00000100:00100000:1.0:1786562857.543970:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 520 00000100:00100000:1.0:1786562857.543982:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653024000:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562857.544349:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653024000:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 369us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562857.544367:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 520 00000100:00100000:0.0:1786562857.550863:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562857.551954:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024128 00000100:00100000:3.0:1786562857.551971:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024128 00000100:00100000:3.0:1786562857.552141:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 521 00000100:00100000:3.0:1786562857.552166:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:72407:x1873345653024128:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786562857.553107:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:72407:x1873345653024128:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 937us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.553121:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 521 00000100:00100000:2.0:1786562857.555814:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562857.555989:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024256 00000100:00100000:3.0:1786562857.556026:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024256 00000100:00100000:3.0:1786562857.556399:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 522 00000100:00100000:3.0:1786562857.556413:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:72407:x1873345653024256:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786562857.557336:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:72407:x1873345653024256:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 921us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562857.557349:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 522 00000100:00100000:2.0:1786562857.563438:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562857.563567:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024384 00000100:00100000:1.0:1786562857.563589:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024384 00000100:00100000:1.0:1786562857.563672:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 523 00000100:00100000:1.0:1786562857.563685:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653024384:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562857.563710:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562857.563735:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd82b expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.563776:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 10 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.563790:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 10 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562857.563802:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556800, rc 0) 00000100:00100000:1.0:1786562857.563890:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9aef4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653024384:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 208us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562857.563898:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 523 00000100:00100000:0.0:1786562857.567703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562857.567943:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024512 00000100:00100000:3.0:1786562857.567958:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024512 00000100:00100000:3.0:1786562857.568076:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 524 00000100:00100000:3.0:1786562857.568088:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653024512:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562857.568496:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653024512:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 409us (808us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786562857.568506:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 524 00010000:00010000:2.0:1786562857.765670:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562858.807726:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786562859.708699:0:42504:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcbd1a4070 20000000:00000080:3.0:1786562859.708724:0:42504:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90e9b35d7800 uarg=0000000000000000 00000040:00100000:3.0:1786562859.710602:0:42504:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 48 20000000:01000000:3.0:1786562859.710618:0:42504:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce022 lustre.test_204f lustre-OST0001_UUID 20000000:01000000:3.0:1786562859.710639:0:42504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_204f fl=4 20000000:01000000:3.0:1786562859.714913:0:42505:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 25 1->4: lustre-clilov new lustre.test_204f 20000000:01000000:3.0:1786562859.715126:0:42505:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 44 marker 25 2->4: lustre-clilov new lustre.test_204f 00000040:00080000:3.0:1786562859.715280:0:42505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:1.0:1786562859.718554:0:42504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18584 20000000:01000000:1.0:1786562859.718601:0:42504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre test_204f (null) (null) 00000040:00080000:1.0:1786562859.718657:0:42504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 112 off18696 00000040:00080000:1.0:1786562859.718854:0:42504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18920 20000000:01000000:1.0:1786562859.718883:0:42504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_204f fl=4 20000000:01000000:2.0:1786562859.721265:0:42506:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 26 1->4: lustre-MDT0000-mdtlov new lustre.test_204f 20000000:01000000:2.0:1786562859.721610:0:42506:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 39 marker 26 2->4: lustre-MDT0000-mdtlov new lustre.test_204f 00000040:00080000:2.0:1786562859.721909:0:42506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:1.0:1786562859.723653:0:42504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17792 20000000:01000000:1.0:1786562859.723706:0:42504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_204f (null) (null) 00000040:00080000:1.0:1786562859.723750:0:42504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 120 off17912 00000040:00080000:1.0:1786562859.723818:0:42504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off18136 10000000:01000000:1.0:1786562859.723850:0:42504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786562859.723880:0:42504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723905:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723913:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723920:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723926:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723933:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723940:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723946:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a190b expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723960:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723968:0:42504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.723977:0:42504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.724082:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 9 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.724101:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 9 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.724120:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993536:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562859.725348:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 9 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.725377:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 9 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.725392:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993664:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562859.725487:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a190b expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.725496:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a190b expref: 18 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.725511:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993792:0@lo:104: 00000100:00100000:1.0:1786562859.725565:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562859.725622:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.725631:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 18 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.725638:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993920:0@lo:104: 00000100:00100000:1.0:1786562859.725660:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562859.725704:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.725712:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 18 pid: 33109 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.725720:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994048:0@lo:104: 00000100:00100000:0.0:1786562859.725739:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654993792 00000100:00100000:1.0:1786562859.725740:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562859.725748:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654993792 00000100:00100000:1.0:1786562859.725770:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654993920 00000100:00100000:1.0:1786562859.725774:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654993920 00000100:00100000:1.0:1786562859.725798:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994048 00000100:00100000:1.0:1786562859.725800:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994048 00000100:00100000:0.0:1786562859.725805:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786562859.725814:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+5:42504:x1873345654993920:12345-0@lo:104: 00010000:00010000:0.0:1786562859.725838:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562859.725904:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786562859.725911:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c95f678-1633-48c9-bbd9-793f47c06679+5:42504:x1873345654993920:12345-0@lo:104: Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562859.726329:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786562859.726339:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+5:42504:x1873345654993792:12345-0@lo:104: 00010000:00010000:1.0:1786562859.726350:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.726406:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786562859.726411:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+5:42504:x1873345654993792:12345-0@lo:104: Request processed in 75us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562859.726425:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786562859.726446:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786562859.726452:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994048:12345-0@lo:104: 00010000:00010000:1.0:1786562859.726459:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.726492:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1786562859.726498:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994048:12345-0@lo:104: Request processed in 46us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562859.726504:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1786562859.726550:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 18 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.726560:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 18 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.726571:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b11d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994176:0@lo:104: 00000100:00100000:1.0:1786562859.726604:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562859.726623:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994176 00000100:00100000:1.0:1786562859.726629:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994176 00000100:00100000:1.0:1786562859.726649:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786562859.726653:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994176:12345-0@lo:104: 00010000:00010000:1.0:1786562859.726661:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.726904:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786562859.726913:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.726922:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557a00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562859.726927:0:8414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.726936:0:8414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562859.726943:0:8414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562859.726950:0:8414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562859.726990:0:8414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.726997:0:8414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562859.727041:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727049:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990557a00/0x5c655bf6668a18fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1904 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727075:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786562859.727079:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727086:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc600 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562859.727089:0:8414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727096:0:8414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562859.727102:0:8414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562859.727107:0:8414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562859.727121:0:8414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727128:0:8414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562859.727128:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1786562859.727134:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727134:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994176:12345-0@lo:104: Request processed in 480us (530us total) trans 0 rc 0/0 00010000:00010000:2.0:1786562859.727141:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e982bfc600/0x5c655bf6668a190b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a1912 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727142:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1786562859.727151:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786562859.727153:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727164:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556600 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562859.727166:0:8414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727172:0:8414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727178:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562859.727179:0:8414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562859.727185:0:8414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562859.727188:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 18 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727197:0:8414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727197:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994560:0@lo:104: 00010000:00010000:2.0:1786562859.727203:0:8414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562859.727219:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727222:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786562859.727226:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990556600/0x5c655bf6668a18ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18f6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727234:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562859.727237:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727241:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994560 00010000:00010000:2.0:1786562859.727244:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557600 already unused, calling callback (ffffffffc1b69c20) 00000100:00100000:1.0:1786562859.727246:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994560 10000000:00010000:2.0:1786562859.727247:0:8414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727258:0:8414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727263:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 10000000:00010000:2.0:1786562859.727265:0:8414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727269:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994560:12345-0@lo:104: 10000000:01000000:2.0:1786562859.727271:0:8414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786562859.727276:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727282:0:8414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727288:0:8414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562859.727293:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727300:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990557600/0x5c655bf6668a18e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727307:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1786562859.727309:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562859.727312:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727312:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994560:12345-0@lo:104: Request processed in 44us (90us total) trans 0 rc 0/0 00010000:00010000:2.0:1786562859.727318:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557200 already unused, calling callback (ffffffffc1b69c20) 00000100:00100000:1.0:1786562859.727319:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 10000000:00010000:2.0:1786562859.727321:0:8414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727327:0:8414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727332:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1786562859.727334:0:8414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562859.727339:0:8414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562859.727350:0:8414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727350:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727359:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 18 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727368:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994944:0@lo:104: 00000100:00100000:1.0:1786562859.727393:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562859.727410:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994944 00000100:00100000:1.0:1786562859.727414:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994944 00000100:00100000:1.0:1786562859.727442:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786562859.727448:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994944:12345-0@lo:104: 00010000:00010000:1.0:1786562859.727456:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727487:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786562859.727492:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654994944:12345-0@lo:104: Request processed in 45us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562859.727498:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1786562859.727512:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562859.727516:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727524:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c400 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:1.0:1786562859.727527:0:7599:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727533:0:7599:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727534:0:8414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1786562859.727540:0:7599:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727541:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562859.727547:0:7599:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786562859.727549:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e990557200/0x5c655bf6668a18d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18da expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727558:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562859.727560:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562859.727561:0:7599:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727562:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562859.727571:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562859.727571:0:7599:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786562859.727576:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727582:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e99ff6c400/0x5c655bf6668a18c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18cc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.727584:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654994304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562859.727591:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562859.727592:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562859.727594:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562859.727611:0:42504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 18 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.727619:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562859.727619:0:42504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 18 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727627:0:42504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654995328:0@lo:104: 00000100:00100000:2.0:1786562859.727642:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654995072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562859.727652:0:42504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562859.727660:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562859.727681:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786562859.727693:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995328 00000100:00100000:1.0:1786562859.727696:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995328 00000100:00100000:1.0:1786562859.727713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786562859.727718:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881debc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654995328:12345-0@lo:104: 00010000:00010000:1.0:1786562859.727725:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.727756:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:1.0:1786562859.727757:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786562859.727761:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881debc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c95f678-1633-48c9-bbd9-793f47c06679+4:42504:x1873345654995328:12345-0@lo:104: Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562859.727762:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654994432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562859.727769:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786562859.727787:0:42504:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988b130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562859.727788:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562859.727803:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654995200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562859.727811:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993792:0@lo:104: 00000100:00100000:1.0:1786562859.727834:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aebbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993920:0@lo:104: 00000100:00100000:2.0:1786562859.727837:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562859.727845:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88bf5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994048:0@lo:104: 00000100:00100000:1.0:1786562859.727853:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b11d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994176:0@lo:104: 00000100:00100000:1.0:1786562859.727859:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994560:0@lo:104: 00010000:00010000:2.0:1786562859.727865:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1786562859.727867:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654994944:0@lo:104: 00010000:00010000:2.0:1786562859.727870:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727873:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654995328:0@lo:104: 00010000:00010000:2.0:1786562859.727883:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6ca00 already unused, calling callback (ffffffffc1b69c20) 10000000:00010000:2.0:1786562859.727885:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727891:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786562859.727898:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562859.727903:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1786562859.727914:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994304 00000100:00100000:1.0:1786562859.727917:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994304 00010000:00010000:2.0:1786562859.727919:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727925:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786562859.727930:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.727935:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 19 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727936:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff90e99ff6ca00/0x5c655bf6668a18b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c655bf6668a18be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.727952:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562859.727953:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562859.727955:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562859.727957:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995072 00000100:00100000:1.0:1786562859.727960:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995072 00000100:00100000:2.0:1786562859.727967:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654994688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562859.727970:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 20 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.727985:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994432 00000100:00100000:1.0:1786562859.727987:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994432 00000100:00100000:2.0:1786562859.727992:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562859.727998:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a190b expref: 21 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.728003:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654995456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562859.728038:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995200 00000100:00100000:1.0:1786562859.728041:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995200 00000100:00100000:2.0:1786562859.728047:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786562859.728052:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 22 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.728059:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562859.728063:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654994816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562859.728067:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994688 00000100:00100000:1.0:1786562859.728069:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994688 00010000:00010000:1.0:1786562859.728079:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 23 pid: 33109 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.728082:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562859.728090:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995456 00000100:00100000:1.0:1786562859.728092:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995456 00010000:00010000:1.0:1786562859.728101:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 24 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.728105:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654994816 00000100:00100000:2.0:1786562859.728108:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654994816 00000100:00100000:1.0:1786562859.728112:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8842 00000100:00100000:1.0:1786562859.728117:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+25:3291:x1873345654994304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562859.728122:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 25 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.728128:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562859.728135:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 25 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562859.728136:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8843 00000100:00100000:2.0:1786562859.728141:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+25:3291:x1873345654995072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562859.728145:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 25 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728148:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562859.728151:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 25 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728160:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 25 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.728160:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e99ff6ce00/0x5c655bf6668a1904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a18fd expref: 25 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728170:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfce00/0x5c655bf6668a18da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a18d3 expref: 24 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.728174:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562859.728177:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562859.728202:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+23:3291:x1873345654994304:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562859.728209:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8842 00000100:00100000:1.0:1786562859.728222:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8844 00000100:00100000:1.0:1786562859.728227:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e99204d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+22:3291:x1873345654994432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786562859.728239:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562859.728243:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a190b expref: 22 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.728252:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a190b expref: 22 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.728262:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e99ff6c200/0x5c655bf6668a1912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a190b expref: 22 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.728271:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562859.728356:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562859.728569:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+21:3291:x1873345654995072:12345-0@lo:103:ldlm_bl.0 Request processed in 427us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562859.728577:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8843 00000100:00100000:2.0:1786562859.728592:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8845 00000100:00100000:2.0:1786562859.728599:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+20:3291:x1873345654995200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562859.728608:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562859.728614:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 20 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728627:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 20 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728637:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a18cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a18c5 expref: 20 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728646:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562859.728683:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345654995200:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562859.728690:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8845 00000100:00100000:2.0:1786562859.728705:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8846 00000100:00100000:2.0:1786562859.728711:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+18:3289:x1873345654994688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562859.728719:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562859.728724:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 18 pid: 33109 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728732:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 18 pid: 33109 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728742:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a18f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a18ef expref: 18 pid: 33109 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728751:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562859.728780:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+17:3289:x1873345654994688:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562859.728787:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8846 00000100:00100000:2.0:1786562859.728799:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8847 00000100:00100000:2.0:1786562859.728806:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+16:3289:x1873345654995456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562859.728814:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562859.728818:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 16 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728837:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 16 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728848:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e982bfde00/0x5c655bf6668a18be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a18b7 expref: 16 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728856:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562859.728878:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+15:3289:x1873345654995456:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562859.728883:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8847 00000100:00100000:2.0:1786562859.728896:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8848 00000100:00100000:2.0:1786562859.728902:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+14:3289:x1873345654994816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562859.728909:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562859.728914:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 14 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728921:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 14 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728930:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e991eb1000/0x5c655bf6668a18e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c655bf6668a18e1 expref: 14 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.728956:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562859.728979:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c95f678-1633-48c9-bbd9-793f47c06679+13:3289:x1873345654994816:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562859.728988:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8848 00000100:00100000:2.0:1786562859.729050:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654994816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562859.729059:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654994688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562859.729066:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c95f678-1633-48c9-bbd9-793f47c06679:3289:1873345654995456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786562859.730137:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562859.731342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e99204d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c95f678-1633-48c9-bbd9-793f47c06679+12:3291:x1873345654994432:12345-0@lo:103:ldlm_bl.0 Request processed in 3101us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562859.731349:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654994432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786562859.731360:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8844 00000100:00100000:3.0:1786562859.731640:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654995200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562859.731653:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654994304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786562859.731743:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345654995072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786562859.732184:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562859.732257:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562859.732328:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882962300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993536:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562859.732347:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024768 00000100:00100000:3.0:1786562859.732355:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024768 00000100:00100000:0.0:1786562859.732396:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1786562859.732409:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 10 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562859.732453:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024640 00000100:00100000:3.0:1786562859.732456:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024640 00010000:00010000:3.0:1786562859.732470:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 11 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562859.732490:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8849 00000100:00100000:3.0:1786562859.732500:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b4bd338-b43c-4989-b811-79054f6124e2+11:2349:x1873345653024768:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562859.732516:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562859.732523:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 11 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732534:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 11 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732561:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562859.732620:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b4bd338-b43c-4989-b811-79054f6124e2+11:2349:x1873345653024768:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 121us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562859.732632:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8849 00000100:00100000:3.0:1786562859.732647:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8850 00000100:00100000:3.0:1786562859.732653:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653024640:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562859.732660:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562859.732674:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 10 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732686:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 10 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732696:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990556800/0x5c655bf6668a1920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd82b expref: 10 pid: 33107 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732712:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732721:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732738:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732746:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732754:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732761:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732768:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556a00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562859.732773:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732782:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732792:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562859.732803:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562859.732833:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b4bd338-b43c-4989-b811-79054f6124e2+9:2348:x1873345653024640:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 171us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562859.732840:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8850 00010000:00010000:1.0:1786562859.732844:0:42504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e991eb1e00/0x5c655bf6668a1919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd824 expref: 9 pid: 33108 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562859.732872:0:42504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88aeb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:42504:1873345654993664:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562859.732919:0:42504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.732946:0:42504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.732953:0:42504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562859.732959:0:42504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e990556a00/0x5c655bf6668a1927 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562859.814255:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562860.344821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562860.345998:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025024 00000100:00100000:3.0:1786562860.346185:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025024 00000100:00100000:3.0:1786562860.346343:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 521 00000100:00100000:3.0:1786562860.346355:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345653025024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562860.347761:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:2349:x1873345653025024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1399us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562860.347776:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 521 00000100:00100000:2.0:1786562860.348489:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562860.348629:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562860.348686:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562860.348714:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025280 00000100:00100000:2.0:1786562860.348723:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025280 00000100:00100000:3.0:1786562860.348832:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025152 00000100:00100000:3.0:1786562860.348837:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025152 00000100:00100000:1.0:1786562860.348969:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653024896 00000100:00100000:1.0:1786562860.348996:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653024896 00000100:00100000:1.0:1786562860.350651:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 525 00000100:00100000:1.0:1786562860.350687:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+8:2349:x1873345653024896:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562860.350824:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+8:2349:x1873345653024896:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 142us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562860.350834:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 525 00000100:00080000:0.0:1786562860.351074:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562860.351086:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562860.351090:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786562860.353588:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 620 00000100:00100000:2.0:1786562860.353606:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653025280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562860.353700:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653025280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562860.353709:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 620 00000100:00100000:2.0:1786562860.357282:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 621 00000100:00100000:2.0:1786562860.357305:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653025152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562860.357763:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653025152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 462us (9074us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562860.357772:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 621 00010000:00010000:1.0:1786562860.837450:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562861.349287:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654995584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562861.349380:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.349540:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995584 00000100:00100000:1.0:1786562861.349548:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995584 00000100:00100000:1.0:1786562861.349622:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1786562861.349632:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654995584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786562861.349669:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54722560 pending 0 free 3844079616 avail 3841982464 00000100:00100000:1.0:1786562861.349725:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654995584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.349732:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1786562861.349782:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654995584:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786562861.350090:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562861.352888:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654996096:0@lo:400:kworker.0 00000100:00100000:1.0:1786562861.352958:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.353042:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786562861.353048:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654995968:0@lo:400:kworker.0 00000100:00100000:1.0:1786562861.353074:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.353126:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996096 00000100:00100000:1.0:1786562861.353134:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996096 00000100:00100000:1.0:1786562861.353186:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1786562861.353197:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654996096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562861.353249:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345654996096:12345-0@lo:400:kworker.0 Request processed in 54us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.353256:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1786562861.353298:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345654996096:0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353472:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995968 00000100:00100000:0.0:1786562861.353476:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995968 00000100:00100000:0.0:1786562861.353518:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1786562861.353526:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654995968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353567:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1873345654995968:12345-0@lo:400:kworker.0 Request processed in 43us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.353577:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1786562861.353612:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654995840:0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353639:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.353660:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786562861.353666:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654995712:0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353690:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.353709:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654996224:0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353728:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.353750:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995840 00000100:00100000:0.0:1786562861.353753:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995840 00000100:00100000:0.0:1786562861.353777:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996224 00000100:00100000:0.0:1786562861.353780:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996224 00000100:00100000:0.0:1786562861.353811:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1786562861.353818:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654995840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353854:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1873345654995840:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.353860:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1786562861.353872:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1786562861.353877:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353904:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345654996224:12345-0@lo:400:kworker.0 Request processed in 26us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.353909:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1786562861.353939:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345654996224:0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353948:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3292:1873345654995840:0@lo:400:kworker.0 00000100:00100000:0.0:1786562861.353976:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1873345654995968:0@lo:400:kworker.0 00000100:00080000:0.0:1786562861.353989:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786562861.353994:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786562861.355515:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654995712 00000100:00100000:1.0:1786562861.355528:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654995712 00000100:00100000:1.0:1786562861.355579:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1786562861.355601:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+12:3292:x1873345654995712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562861.355690:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+12:3292:x1873345654995712:12345-0@lo:400:kworker.0 Request processed in 102us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.355697:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1786562861.355892:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c95f678-1633-48c9-bbd9-793f47c06679:3292:1873345654995712:0@lo:400:kworker.0 00000100:00100000:3.0:1786562861.358399:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654996352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562861.358485:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.358775:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996352 00000100:00100000:2.0:1786562861.358783:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996352 00000100:00100000:2.0:1786562861.358850:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1786562861.358860:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654996352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786562861.358894:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:2.0:1786562861.358947:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873345654996352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.358954:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1786562861.361001:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345654996352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786562861.436945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562861.437220:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025408 00000100:00100000:2.0:1786562861.437230:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025408 00000100:00100000:2.0:1786562861.437289:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 527 00000100:00100000:2.0:1786562861.437298:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+8:41781:x1873345653025408:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562861.437316:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562861.437336:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a192e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd832 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.437366:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a192e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd832 expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.437376:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfd000/0x5c655bf6668a192e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd832 expref: 9 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.437385:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfd000, rc 0) 00000100:00100000:2.0:1786562861.437902:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653025408:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 602us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.437912:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 527 00000100:00100000:1.0:1786562861.447777:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562861.460832:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025536 00000100:00100000:0.0:1786562861.460848:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025536 00000100:00100000:0.0:1786562861.461426:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 528 00000100:00100000:0.0:1786562861.462408:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653025536:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.465112:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653025536:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 2707us (17333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.465126:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 528 00000100:00100000:3.0:1786562861.468391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562861.468589:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025664 00000100:00100000:1.0:1786562861.468599:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025664 00000100:00100000:1.0:1786562861.468665:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 529 00000100:00100000:1.0:1786562861.468677:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653025664:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.470320:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653025664:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 1633us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.470337:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 529 00000100:00100000:3.0:1786562861.482335:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562861.484343:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025792 00000100:00100000:0.0:1786562861.484358:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025792 00000100:00100000:0.0:1786562861.484428:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 530 00000100:00100000:0.0:1786562861.484439:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:72426:x1873345653025792:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786562861.484897:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+9:72426:x1873345653025792:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 459us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.484906:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 530 00000100:00100000:3.0:1786562861.492975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562861.493096:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653025920 00000100:00100000:2.0:1786562861.493106:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653025920 00000100:00100000:2.0:1786562861.493168:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 531 00000100:00100000:2.0:1786562861.493178:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:72426:x1873345653025920:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786562861.504721:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+9:72426:x1873345653025920:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 11528us (11741us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.504742:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 531 00000100:00100000:3.0:1786562861.512356:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562861.512473:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653026048 00000100:00100000:2.0:1786562861.512485:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653026048 00000100:00100000:2.0:1786562861.512552:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 532 00000100:00100000:2.0:1786562861.512564:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+9:41781:x1873345653026048:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562861.512586:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562861.512606:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a1935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd839 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.512643:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a1935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd839 expref: 10 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.512656:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfc400/0x5c655bf6668a1935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd839 expref: 10 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.512679:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc400, rc 0) 00000100:00100000:2.0:1786562861.512750:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653026048:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 188us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.512758:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 532 00000100:00100000:1.0:1786562861.515855:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562861.515945:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653026176 00000100:00100000:2.0:1786562861.515954:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653026176 00000100:00100000:2.0:1786562861.516046:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 533 00000100:00100000:2.0:1786562861.516063:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653026176:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.516349:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:41781:x1873345653026176:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 294us (505us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786562861.516357:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 533 10000000:01000000:2.0:1786562861.606039:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786562861.606049:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e8812d5800 from 58 10000000:01000000:2.0:1786562861.606056:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786562861.606117:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.606130:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.606142:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.606173:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654996480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.606254:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.606331:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e984de9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562861.606421:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996480 00000100:00100000:3.0:1786562861.606430:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996480 00000100:00100000:3.0:1786562861.606481:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1786562861.606491:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+12:5818:x1873345654996480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562861.606510:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562861.606524:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb0400/0x5c655bf6668a1943 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a193c expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.606548:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb0400/0x5c655bf6668a1943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a193c expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.606558:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb0400/0x5c655bf6668a1943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a193c expref: 13 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.606568:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0400, rc 0) 00000100:00100000:3.0:1786562861.606619:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654996480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562861.606627:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1786562861.606729:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654996480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562861.606746:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1943 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.606755:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1943 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562861.606825:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654996608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.606854:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.606878:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99073d900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.606981:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996608 00000100:00100000:2.0:1786562861.606985:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996608 00000100:00100000:2.0:1786562861.607032:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1786562861.607039:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654996608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.607405:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654996608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.607413:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1786562861.611449:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654996608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.611545:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654996736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.611643:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.611777:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99073d900 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.612709:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996736 00000100:00100000:1.0:1786562861.612724:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996736 00000100:00100000:1.0:1786562861.613206:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1786562861.613220:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654996736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.613499:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654996736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.613508:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1786562861.613610:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654996736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.614162:0:42507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42507:1873345654996864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562861.614211:0:42507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.614504:0:42507:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e99073d900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.614587:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996864 00000100:00100000:2.0:1786562861.614593:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996864 00000100:00100000:2.0:1786562861.614625:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1786562861.614632:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:42507:x1873345654996864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562861.614905:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+13:42507:x1873345654996864:12345-0@lo:502:llog_process_th.0 Request processed in 273us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.614913:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1786562861.615197:0:42507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42507:1873345654996864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562861.615251:0:42507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42507:1873345654996992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562861.615288:0:42507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562861.615317:0:42507:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9882dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.615368:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654996992 00000100:00100000:1.0:1786562861.615373:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654996992 00000100:00100000:1.0:1786562861.615407:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1786562861.615415:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:42507:x1873345654996992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.615558:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:42507:x1873345654996992:12345-0@lo:502:llog_process_th.0 Request processed in 143us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.615565:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1786562861.615778:0:42507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bf8dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42507:1873345654996992:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786562861.615823:0:42507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1786562861.616234:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1786562861.616255:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786562861.616266:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1943 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.616276:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfce00/0x5c655bf6668a193c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1943 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562861.616285:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786562861.616288:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:1.0:1786562861.616290:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786562861.616317:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.616325:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.616335:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562861.616354:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.616451:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.616485:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562861.616532:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997120 00000100:00100000:0.0:1786562861.616537:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997120 00000100:00100000:0.0:1786562861.616561:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1786562861.616569:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+13:5818:x1873345654997120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786562861.616580:0:33108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562861.616592:0:33108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e99ff6d000/0x5c655bf6668a1951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a194a expref: -99 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.616613:0:33108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e99ff6d000/0x5c655bf6668a1951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a194a expref: 14 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.616628:0:33108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e99ff6d000/0x5c655bf6668a1951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a194a expref: 14 pid: 33108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.616635:0:33108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d000, rc 0) 00000100:00100000:0.0:1786562861.616673:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e986101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654997120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.616680:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1786562861.617442:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562861.617462:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1951 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.617472:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1951 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562861.617533:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.617570:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.617605:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562861.617704:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997248 00000100:00100000:0.0:1786562861.617709:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997248 00000100:00100000:0.0:1786562861.617737:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1786562861.617745:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654997248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.618043:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654997248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.618052:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1786562861.618191:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.618222:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.618265:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.618294:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562861.618339:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997376 00000100:00100000:0.0:1786562861.618343:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997376 00000100:00100000:0.0:1786562861.618363:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1786562861.618368:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654997376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.618525:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654997376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.618532:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1786562861.618645:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.619268:0:42508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42508:1873345654997504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.619309:0:42508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.619340:0:42508:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562861.619393:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997504 00000100:00100000:0.0:1786562861.619398:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997504 00000100:00100000:0.0:1786562861.619430:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1786562861.619438:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:42508:x1873345654997504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562861.619650:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+14:42508:x1873345654997504:12345-0@lo:502:llog_process_th.0 Request processed in 212us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.619657:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1786562861.619835:0:42508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42508:1873345654997504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786562861.619858:0:42508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786562861.619869:0:42508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786562861.619871:0:42508:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre-MDT0000-m del lustre.test_204f 00000020:00000080:1.0:1786562861.619877:0:42508:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1786562861.622751:0:42508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42508:1873345654997632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.623142:0:42508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.623263:0:42508:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf89ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562861.623416:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997632 00000100:00100000:3.0:1786562861.623424:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997632 00000100:00100000:3.0:1786562861.623479:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1786562861.623489:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:42508:x1873345654997632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562861.623720:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:42508:x1873345654997632:12345-0@lo:502:llog_process_th.0 Request processed in 232us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562861.623729:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1786562861.623995:0:42508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42508:1873345654997632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786562861.624049:0:42508:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786562861.624057:0:42508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786562861.624059:0:42508:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre-MDT0000-m del lustre.test_204f 00000040:00080000:1.0:1786562861.624063:0:42508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:3.0:1786562861.624606:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:3.0:1786562861.624630:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786562861.624639:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1951 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.624651:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990556000/0x5c655bf6668a194a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1951 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786562861.624661:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786562861.624663:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e988fe0000 from 58 10000000:01000000:3.0:1786562861.624666:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786562861.624691:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.624699:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.624708:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562861.624726:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786562861.624772:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562861.624827:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.624919:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997760 00000100:00100000:2.0:1786562861.624924:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997760 00000100:00100000:2.0:1786562861.624962:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1786562861.624971:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+14:5818:x1873345654997760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562861.624981:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562861.624994:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e982bfc600/0x5c655bf6668a195f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1958 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.625052:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e982bfc600/0x5c655bf6668a195f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1958 expref: 15 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.625063:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e982bfc600/0x5c655bf6668a195f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1958 expref: 15 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.625072:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc600, rc 0) 00000100:00100000:2.0:1786562861.625106:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654997760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.625113:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1786562861.625359:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562861.625373:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a195f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.625398:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a195f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562861.625447:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562861.625475:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562861.625504:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.625601:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654997888 00000100:00100000:2.0:1786562861.625605:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654997888 00000100:00100000:2.0:1786562861.625635:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1786562861.625641:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654997888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.625905:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc1d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654997888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.625912:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1786562861.626120:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654997888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562861.626151:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562861.626492:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562861.626521:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.626572:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998016 00000100:00100000:2.0:1786562861.626577:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998016 00000100:00100000:2.0:1786562861.626611:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1786562861.626619:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654998016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.626782:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654998016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.626799:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1786562861.626975:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786562861.627514:0:42509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42509:1873345654998144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562861.627560:0:42509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562861.627591:0:42509:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b780 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.627635:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998144 00000100:00100000:1.0:1786562861.627640:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998144 00000100:00100000:1.0:1786562861.627674:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1786562861.627683:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:42509:x1873345654998144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.628168:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9baf4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+15:42509:x1873345654998144:12345-0@lo:502:llog_process_th.0 Request processed in 485us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.628175:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1786562861.628350:0:42509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42509:1873345654998144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562861.628469:0:42509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42509:1873345654998272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786562861.628506:0:42509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562861.628535:0:42509:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b780 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.628580:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998272 00000100:00100000:2.0:1786562861.628585:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998272 00000100:00100000:2.0:1786562861.628618:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1786562861.628625:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:42509:x1873345654998272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562861.628765:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:42509:x1873345654998272:12345-0@lo:502:llog_process_th.0 Request processed in 140us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.628773:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1786562861.628978:0:42509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988723480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42509:1873345654998272:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786562861.629363:0:42509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1786562861.629663:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1786562861.629688:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786562861.629699:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a195f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.629712:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e991eb1a00/0x5c655bf6668a1958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a195f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562861.629723:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1786562861.629726:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1786562861.629730:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1786562861.629766:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.629776:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.629797:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.629818:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.629861:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.629900:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2900 going to sleep for 11 seconds 00000100:00100000:3.0:1786562861.629951:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998400 00000100:00100000:3.0:1786562861.629957:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998400 00000100:00100000:3.0:1786562861.629997:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1786562861.630037:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+15:5818:x1873345654998400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562861.630049:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562861.630066:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb1600/0x5c655bf6668a196d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1966 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.630089:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1600/0x5c655bf6668a196d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1966 expref: 16 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.630099:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb1600/0x5c655bf6668a196d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1966 expref: 16 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.630108:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1600, rc 0) 00000100:00100000:3.0:1786562861.630145:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654998400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562861.630152:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1786562861.630505:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562861.630519:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a196d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.630528:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a196d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.630584:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.630613:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.630637:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.630648:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998528 00000100:00100000:2.0:1786562861.630652:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998528 00000100:00100000:2.0:1786562861.630676:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1786562861.630682:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654998528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.630940:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9910e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654998528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.630948:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1786562861.630982:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.631035:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.631073:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.631087:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace2900 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.631098:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998656 00000100:00100000:2.0:1786562861.631101:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998656 00000100:00100000:2.0:1786562861.631116:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1786562861.631122:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654998656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.631858:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654998656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 732us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.631867:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1786562861.631929:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a994ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786562861.632982:0:42510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:1.0:1786562861.633308:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1786562861.633339:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786562861.633350:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a196d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.633361:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfdc00/0x5c655bf6668a1966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a196d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786562861.633372:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786562861.633374:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90e98318c000 from 58 10000000:01000000:1.0:1786562861.633377:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786562861.633474:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.633482:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.633493:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562861.633518:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.633572:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.633643:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf89ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562861.633677:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998784 00000100:00100000:3.0:1786562861.633684:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998784 00000100:00100000:3.0:1786562861.633756:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1786562861.633765:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+16:5818:x1873345654998784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786562861.633779:0:33107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562861.633801:0:33107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e991eb1800/0x5c655bf6668a197b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1974 expref: -99 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.633823:0:33107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e991eb1800/0x5c655bf6668a197b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1974 expref: 17 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.633833:0:33107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e991eb1800/0x5c655bf6668a197b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1974 expref: 17 pid: 33107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.633845:0:33107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1800, rc 0) 00000100:00100000:3.0:1786562861.633924:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654998784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562861.633931:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1786562861.634064:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562861.634077:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a197b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.634087:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a197b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562861.634135:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.634159:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.634230:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf89ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786562861.634308:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654998912 00000100:00100000:3.0:1786562861.634312:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654998912 00000100:00100000:3.0:1786562861.634370:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1786562861.634377:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654998912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786562861.634632:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654998912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562861.634641:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1786562861.634695:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654998912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.634723:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.634760:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.634938:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf89ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1786562861.634980:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999040 00000100:00100000:0.0:1786562861.634985:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999040 00000100:00100000:0.0:1786562861.635039:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1786562861.635046:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654999040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786562861.635192:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654999040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.635201:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1786562861.635332:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.635770:0:42511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42511:1873345654999168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.635820:0:42511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.635875:0:42511:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562861.635904:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999168 00000100:00100000:0.0:1786562861.635908:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999168 00000100:00100000:0.0:1786562861.635973:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1786562861.635980:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:42511:x1873345654999168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786562861.636217:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+17:42511:x1873345654999168:12345-0@lo:502:llog_process_th.0 Request processed in 236us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562861.636224:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1786562861.636296:0:42511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42511:1873345654999168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.636333:0:42511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42511:1873345654999296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786562861.636365:0:42511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562861.636591:0:42511:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bf89ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786562861.636657:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999296 00000100:00100000:2.0:1786562861.636663:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999296 00000100:00100000:2.0:1786562861.636689:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1786562861.636696:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:42511:x1873345654999296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786562861.636851:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:42511:x1873345654999296:12345-0@lo:502:llog_process_th.0 Request processed in 155us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562861.636858:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1786562861.636930:0:42511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e882960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c95f678-1633-48c9-bbd9-793f47c06679:42511:1873345654999296:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1786562861.636951:0:42511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1786562861.637149:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1786562861.637172:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786562861.637182:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a197b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.637193:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e990557c00/0x5c655bf6668a1974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a197b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562861.637202:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786562861.637205:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1786562861.637208:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786562861.637233:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.637241:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.637249:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.637264:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.637291:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.637321:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.637365:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999424 00000100:00100000:1.0:1786562861.637370:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999424 00000100:00100000:1.0:1786562861.637456:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1786562861.637464:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+17:5818:x1873345654999424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562861.637473:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562861.637485:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990557e00/0x5c655bf6668a1989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1982 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.637505:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557e00/0x5c655bf6668a1989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1982 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.637515:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990557e00/0x5c655bf6668a1989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1982 expref: 18 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.637523:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557e00, rc 0) 00000100:00100000:1.0:1786562861.637562:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654999424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.637572:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1786562861.637641:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562861.637653:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1989 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.637663:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1989 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.637704:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.637727:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.637749:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.637800:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999552 00000100:00100000:1.0:1786562861.637805:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999552 00000100:00100000:1.0:1786562861.637823:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1786562861.637827:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654999552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.638089:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654999552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.638097:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1786562861.638159:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.638182:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.638215:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.638240:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.638282:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999680 00000100:00100000:1.0:1786562861.638286:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999680 00000100:00100000:1.0:1786562861.638302:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1786562861.638308:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654999680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.638629:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9920d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654999680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 319us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.638636:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1786562861.638772:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786562861.639700:0:42512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1786562861.639881:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1786562861.639913:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786562861.639924:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1989 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.639935:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfd400/0x5c655bf6668a1982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1989 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786562861.639943:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786562861.639946:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90e9a99d4d40 from 1 10000000:01000000:2.0:1786562861.639949:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786562861.639982:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.639990:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.640000:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.640236:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.640294:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.640336:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.640449:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999808 00000100:00100000:1.0:1786562861.640456:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999808 00000100:00100000:1.0:1786562861.640503:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1786562861.640512:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+18:5818:x1873345654999808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786562861.640526:0:33109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562861.640539:0:33109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e990557000/0x5c655bf6668a1997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c655bf6668a1990 expref: -99 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.640563:0:33109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e990557000/0x5c655bf6668a1997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c655bf6668a1990 expref: 19 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.640578:0:33109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e990557000/0x5c655bf6668a1997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c655bf6668a1990 expref: 19 pid: 33109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.640586:0:33109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557000, rc 0) 00000100:00100000:1.0:1786562861.640632:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654999808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562861.640639:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786562861.640744:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786562861.640758:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1997 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.640768:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c655bf6668a1997 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562861.640826:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786562861.640871:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562861.640895:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bace29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562861.640940:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345654999936 00000100:00100000:1.0:1786562861.640945:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345654999936 00000100:00100000:1.0:1786562861.640973:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1786562861.640980:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654999936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786562861.641235:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c95f678-1633-48c9-bbd9-793f47c06679+19:5818:x1873345654999936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786562861.641243:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1786562861.641323:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c95f678-1633-48c9-bbd9-793f47c06679:5818:1873345654999936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786562861.641354:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786562861.641361:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1997 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.641368:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff90e982bfda00/0x5c655bf6668a1990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c655bf6668a1997 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.862235:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562861.970927:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562861.971049:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653026304 00000100:00100000:3.0:1786562861.971059:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653026304 00000100:00100000:3.0:1786562861.971115:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17515 00000100:00100000:3.0:1786562861.971125:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+22:72443:x1873345653026304:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:3.0:1786562861.971146:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562861.971167:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a199e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd840 expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971236:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971250:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971262:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971283:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971290:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971297:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971628:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971638:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971645:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562861.971684:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f0:0x0]: returning size 2097152 00000004:00200000:3.0:1786562861.971689:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562861.971709:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971722:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971731:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971737:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971748:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971755:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562861.971759:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971766:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971790:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:3.0:1786562861.971794:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562861.971799:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971806:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a19a5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971832:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971838:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971844:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971849:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562861.971852:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971863:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971870:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e999bb1400) 00010000:00010000:3.0:1786562861.971872:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562861.971875:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971880:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a19ac lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971909:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a199e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd840 expref: 24 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971922:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd840 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562861.971930:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:3.0:1786562861.971932:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786562861.971934:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1c00, rc 0) 00000100:00100000:3.0:1786562861.972000:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+23:72443:x1873345653026304:12345-192.168.204.29@tcp:101:rm.0 Request processed in 876us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562861.972056:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17515 00000100:00100000:3.0:1786562861.980347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562861.980454:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653026560 00000100:00100000:0.0:1786562861.980463:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653026560 00000100:00100000:0.0:1786562861.980529:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17516 00000100:00100000:0.0:1786562861.980539:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:72443:x1873345653026560:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1786562861.980597:0:35929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786562861.980628:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1c00/0x5c655bf6668a19b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd840 expref: 23 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980670:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1760 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7ec expref: 22 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980682:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9bc2a2900) 00010000:00010000:0.0:1786562861.980693:0:35929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562861.980716:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980729:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980738:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980752:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980759:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.980770:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.981213:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.981223:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.981230:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786562861.982353:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4426, 64 off359104 00000004:00080000:0.0:1786562861.982366:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1294424360426ns, next at 1295424357491ns, rc = 0 00000040:00080000:0.0:1786562861.982411:0:35929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4456, 64 off361824 00000004:00080000:0.0:1786562861.982417:0:35929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1294424411448ns, next at 1295424410340ns, rc = 0 00010000:00010000:0.0:1786562861.982504:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982517:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982527:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982535:0:35929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982543:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982554:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982574:0:35929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786562861.982598:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982604:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982609:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982615:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562861.982620:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982627:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982638:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9924c5d00) 00010000:00010000:0.0:1786562861.982641:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786562861.982646:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982653:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a19c8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982672:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982681:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982687:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982692:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562861.982694:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982700:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982708:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x0 (ffff90e9b46ab300) 00010000:00010000:0.0:1786562861.982710:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562861.982714:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 2/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562861.982720:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c800/0x5c655bf6668a19ba lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786562861.982729:0:35929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001da57486 reply state 0000000068508ca4 transno 8589950888 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562861.982738:0:35929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786562861.982845:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:72443:x1873345653026560:12345-192.168.204.29@tcp:36:rm.0 Request processed in 2303us (2503us total) trans 8589950888 rc 0/0 00000100:00100000:0.0:1786562861.982854:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17516 00010000:00010000:1.0:1786562861.983203:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562861.983211:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.983218:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562861.983222:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.983228:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.983237:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f0:0x0].0x0 (ffff90e9924c5d00) 00010000:00010000:1.0:1786562861.983240:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786562861.983244:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.983249:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c000/0x5c655bf6668a19cf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562861.983270:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562861.983272:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562861.983273:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562861.985763:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.985795:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.985803:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.985809:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562861.985814:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.985823:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.985839:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4ef:0x0].0x81417613 (ffff90e9924c5600) 00010000:00010000:2.0:1786562861.985842:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562861.985846:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562861.985852:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d400/0x5c655bf6668a19c1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4ef:0x0].0x81417613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562862.885244:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562863.491591:0:42437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950888 is committed 00000004:00080000:3.0:1786562863.491605:0:42437:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2961 committed 00000004:00080000:3.0:1786562863.491622:0:42437:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2931 committed 00000100:00100000:3.0:1786562863.491860:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655000064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786562863.491969:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562863.492090:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655000064 00000100:00100000:3.0:1786562863.492100:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655000064 00000100:00100000:3.0:1786562863.492168:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18030 00000100:00100000:3.0:1786562863.492179:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345655000064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786562863.492216:0:29965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1859 count 1 00010000:00010000:3.0:1786562863.492251:0:29965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.492280:0:29965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.492291:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x743:0x0].0x0 since=20s v=(0 0) 00010000:00010000:3.0:1786562863.492296:0:29965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562863.492301:0:29965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.492333:0:29965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 8 pid: 12119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.492349:0:29965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 8 pid: 12119 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562863.492362:0:29965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345655000192:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562863.492425:0:29965:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470b900 going to sleep for 11 seconds 00000100:00080000:3.0:1786562863.492436:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786562863.492717:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786562863.492728:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655000320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786562863.492773:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562863.492804:0:28861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655000320 00000100:00100000:2.0:1786562863.492808:0:28861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655000320 00000100:00100000:2.0:1786562863.492846:0:28861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18031 00000100:00100000:2.0:1786562863.492853:0:28861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345655000320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786562863.492867:0:28861:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1831 count 1 00010000:00010000:2.0:1786562863.492886:0:28861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.492901:0:28861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.492909:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x727:0x0].0x0 since=20s v=(0 0) 00010000:00010000:2.0:1786562863.492912:0:28861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786562863.492916:0:28861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.492935:0:28861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x50000000010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.492944:0:28861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x70000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 7 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.492961:0:28861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a9949180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345655000448:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562863.492996:0:28861:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8840f0f00 going to sleep for 11 seconds 00000100:00080000:2.0:1786562863.493070:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786562863.496554:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562863.496649:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653026688 00000100:00100000:0.0:1786562863.496659:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653026688 00000100:00100000:3.0:1786562863.496679:0:29965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29965:1873345655000192:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562863.496715:0:29965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.496743:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562863.496794:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8851 00000100:00100000:0.0:1786562863.496804:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988e03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2351:x1873345653026688:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562863.496824:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562863.496831:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.496851:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.496882:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92b7084/0x5c655bf6668a1752 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400030020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7e5 expref: 9 pid: 12119 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.496904:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562863.496909:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x743:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786562863.496916:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.496927:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.496961:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562863.497055:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988e03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+8:2351:x1873345653026688:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 251us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562863.497067:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8851 00010000:00010000:3.0:1786562863.497182:0:29965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.497194:0:29965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.497204:0:29965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.497213:0:29965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.497232:0:29965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562863.497357:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562863.497367:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.497377:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1000 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562863.497383:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.497394:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.497410:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.497418:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da51e504/0x5c655bf6668a19d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.497463:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562863.497465:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562863.497467:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786562863.497476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786562863.498590:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345655000064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6405us (6613us total) trans 21474843686 rc 0/0 00000100:00100000:3.0:1786562863.498605:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18030 00000100:00100000:3.0:1786562863.499875:0:28861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28861:1873345655000448:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562863.499927:0:28861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786562863.500067:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e988720380/2, rc 0, transno 21474843686 00000100:00100000:2.0:1786562863.500077:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655000064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786562863.505634:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.509448:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653026816 00000100:00100000:3.0:1786562863.509470:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653026816 00010000:00010000:3.0:1786562863.509570:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 8 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562863.509627:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8852 00000100:00100000:3.0:1786562863.509640:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653026816:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562863.509661:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562863.509668:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x60000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 8 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786562863.509676:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786562863.509687:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x50000400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 8 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.509718:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->134217727) gid 0 flags: 0x44801400010020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd7de expref: 8 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.509774:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562863.509780:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x727:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786562863.509788:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.509801:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.509846:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562863.509902:0:28861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.509914:0:28861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.509925:0:28861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.509934:0:28861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562863.509941:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653026816:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 302us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562863.509965:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8852 00010000:00010000:2.0:1786562863.509965:0:28861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786562863.510531:0:7599:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786562863.510549:0:7599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.510565:0:7599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:3.0:1786562863.510570:0:7599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.510582:0:7599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.510606:0:7599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.510687:0:7599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045a61ee7/0x5c655bf6668a19dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.510727:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562863.510729:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786562863.510731:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562863.533936:0:28861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a994ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3289:x1873345655000320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41069us (41147us total) trans 17179876160 rc 0/0 00000100:00100000:2.0:1786562863.533955:0:28861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18031 00000004:00080000:0.0:1786562863.534481:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e9a9949500/2, rc 0, transno 17179876160 00000100:00100000:0.0:1786562863.534492:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a9949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655000320:0@lo:6:osp-syn-1-0.0 00000001:02000400:0.0:1786562863.717681:0:42563:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 205a: lfs mirror extend to set prefer flag ========================================================== 15:27:41 (1786562861) 00000100:00100000:0.0:1786562863.790339:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562863.790888:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653027072 00000100:00100000:1.0:1786562863.790900:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653027072 00000100:00100000:1.0:1786562863.790972:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17517 00000100:00100000:1.0:1786562863.790983:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+21:72592:x1873345653027072:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562863.791042:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562863.791046:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786562863.791075:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e9bb268a00/0x5c655bf6668a1522 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd744 expref: 21 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.791094:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b46abf00) 00010000:00010000:1.0:1786562863.791105:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786562863.791120:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557a00/0x5c655bf6668a19e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd847 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786562863.791659:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786562863.791727:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.791754:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.791770:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.791813:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.791827:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.791834:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794861:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794883:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794894:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562863.794906:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:1.0:1786562863.794934:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794942:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794949:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794955:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562863.794960:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794966:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794978:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:1.0:1786562863.794981:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562863.794985:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.794991:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a19eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562863.795001:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa867df1 reply state 000000009b409c0c transno 8589950889 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562863.795031:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786562863.795067:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557a00/0x5c655bf6668a19e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.795087:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 22 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.795095:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9bc2a2500) 00010000:00010000:1.0:1786562863.795097:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562863.795099:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557800, rc 0) 00000100:00100000:1.0:1786562863.795234:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+23:72592:x1873345653027072:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4251us (4899us total) trans 8589950889 rc 0/0 00000100:00100000:1.0:1786562863.795244:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17517 00000100:00100000:1.0:1786562863.801543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1786562863.801555:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.801570:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.801579:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562863.801581:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653027328 00010000:00010000:2.0:1786562863.801589:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556200 already unused, calling callback (ffffffffc1f8c4f0) 00000100:00100000:1.0:1786562863.801593:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653027328 00010000:00010000:2.0:1786562863.801595:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.801605:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.801622:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9bc2a2900) 00010000:00010000:2.0:1786562863.801626:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562863.801631:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.801637:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556200/0x5c655bf6668a19f2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562863.802532:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17518 00000100:00100000:1.0:1786562863.802545:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:72592:x1873345653027328:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562863.802568:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562863.802598:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557a00/0x5c655bf6668a1a07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd84e expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.802705:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.802719:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.802728:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.802769:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 23 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.802782:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 23 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562863.802795:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345655000576:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562863.802880:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e600 going to sleep for 11 seconds 00000100:00100000:2.0:1786562863.809819:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9a99f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345655000576:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562863.809851:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562863.810033:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.810125:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653027456 00000100:00100000:2.0:1786562863.810132:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653027456 00010000:00010000:2.0:1786562863.810175:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 24 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.810212:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8853 00000100:00100000:2.0:1786562863.810303:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345653027456:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562863.810382:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562863.810390:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 24 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.810410:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 24 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.810433:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557800/0x5c655bf6668a19f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd847 expref: 24 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.810447:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9bc2a2500) 00010000:00010000:2.0:1786562863.810452:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.810461:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.810469:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.810500:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562863.810553:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.810554:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:2349:x1873345653027456:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 254us (521us total) trans 0 rc 0/0 00010000:00010000:0.0:1786562863.810571:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.810572:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8853 00000004:00200000:0.0:1786562863.810597:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00000004:00080000:0.0:1786562863.811297:0:33115:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x728:0x0], index 1: 0 00010000:00010000:0.0:1786562863.811448:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812285:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812297:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812305:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562863.812310:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812318:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812333:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9bc2a2500) 00010000:00010000:0.0:1786562863.812336:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562863.812340:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812346:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556e00/0x5c655bf6668a1a0e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812415:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557a00/0x5c655bf6668a1a07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd84e expref: 23 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812426:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2700) 00010000:00010000:0.0:1786562863.812428:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786562863.812432:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557a00/0x5c655bf6668a1a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd84e expref: 23 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.812447:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557a00, rc 0) 00000100:00100000:0.0:1786562863.812867:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:72592:x1873345653027328:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 10322us (11331us total) trans 8589950890 rc 301/301 00000100:00100000:0.0:1786562863.812876:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17518 00000100:00100000:0.0:1786562863.816342:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562863.816425:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653027712 00000100:00100000:1.0:1786562863.816436:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653027712 00000100:00100000:1.0:1786562863.816492:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6360 00000100:00100000:1.0:1786562863.816504:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:72592:x1873345653027712:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562863.817864:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:72592:x1873345653027712:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1355us (1527us total) trans 8589950891 rc 0/0 00000100:00100000:1.0:1786562863.817876:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6360 00000100:00100000:2.0:1786562863.825399:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562863.825477:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653027840 00000100:00100000:0.0:1786562863.825487:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653027840 00000100:00100000:0.0:1786562863.825539:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17519 00000100:00100000:0.0:1786562863.825549:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+23:72592:x1873345653027840:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562863.825572:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562863.825592:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd855 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.825651:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.825666:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.825894:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:0.0:1786562863.825897:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786562863.825901:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6ce00, rc 0) 00000100:00100000:0.0:1786562863.825976:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:72592:x1873345653027840:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 427us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562863.825984:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17519 00000100:00100000:0.0:1786562863.829596:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562863.829792:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653028096 00000100:00100000:1.0:1786562863.829803:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653028096 00000100:00100000:1.0:1786562863.829858:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6361 00000100:00100000:1.0:1786562863.829868:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:72592:x1873345653028096:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562863.830375:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:72592:x1873345653028096:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 507us (787us total) trans 8589950892 rc 0/0 00000100:00100000:1.0:1786562863.830383:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6361 00000100:00100000:2.0:1786562863.856229:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.856412:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653028224 00000100:00100000:3.0:1786562863.856421:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653028224 00000100:00100000:3.0:1786562863.856478:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17520 00000100:00100000:3.0:1786562863.856489:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653028224:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562863.856515:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562863.856541:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a1a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd85c expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.856610:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1a2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.856623:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.856635:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562863.856712:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1786562863.856716:0:33113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 45 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562863.856752:0:33113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.856777:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0000/0x5c655bf6668a1a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd85c expref: 27 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.856808:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd85c expref: 26 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.856816:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562863.856819:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786562863.856823:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb1200, rc 0) 00000100:00100000:3.0:1786562863.856883:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a9949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:72595:x1873345653028224:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 396us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562863.856891:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17520 00000100:00100000:0.0:1786562863.860909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.861308:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653028480 00000100:00100000:2.0:1786562863.861320:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653028480 00000100:00100000:2.0:1786562863.861381:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17521 00000100:00100000:2.0:1786562863.861393:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+26:72595:x1873345653028480:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562863.861414:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562863.861435:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a1a31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd863 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861514:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861529:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861540:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861555:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861562:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861569:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861702:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861711:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861717:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562863.861726:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:2.0:1786562863.861833:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861845:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861852:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861858:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562863.861862:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861869:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861882:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562863.861884:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562863.861889:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861894:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1a38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861905:0:36756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861910:0:36756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861916:0:36756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861921:0:36756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562863.861924:0:36756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861930:0:36756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861937:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9b6332400) 00010000:00010000:2.0:1786562863.861953:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562863.861956:0:36756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.861961:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.862000:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a1a31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 29 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.863166:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 28 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.863177:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:2.0:1786562863.863180:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562863.863182:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfde00, rc 0) 00000100:00100000:2.0:1786562863.863254:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:72595:x1873345653028480:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1861us (2353us total) trans 8589950893 rc 0/0 00000100:00100000:2.0:1786562863.863263:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17521 00000100:00100000:0.0:1786562863.875372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.875493:0:37002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653028608 00000100:00100000:2.0:1786562863.875503:0:37002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653028608 00000100:00100000:3.0:1786562863.875668:0:37002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18032 00000100:00100000:3.0:1786562863.875680:0:37002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+7:2348:x1873345653028608:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562863.875700:0:37002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562863.875721:0:37002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1a54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd86a expref: -99 pid: 37002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562863.875761:0:37002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562863.875782:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=1296s v=(0 0) 00010000:00010000:3.0:1786562863.875788:0:37002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562863.875797:0:37002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1a54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd86a expref: 8 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.875818:0:37002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000366c02b8/0x5c655bf6668a1a54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd86a expref: 8 pid: 37002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.875831:0:37002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0000, rc 0) 00000100:00100000:3.0:1786562863.875896:0:37002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653028608:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 218us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562863.875903:0:37002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18032 00000100:00100000:3.0:1786562863.878466:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.878536:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653028864 00000100:00100000:2.0:1786562863.878547:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653028864 00000100:00100000:2.0:1786562863.878603:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6362 00000100:00100000:2.0:1786562863.878613:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:72595:x1873345653028864:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562863.879173:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+29:72595:x1873345653028864:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 559us (713us total) trans 8589950894 rc 0/0 00000100:00100000:2.0:1786562863.879182:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6362 00000100:00100000:0.0:1786562863.889182:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562863.889227:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653029120 00000100:00100000:0.0:1786562863.889238:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653029120 00000100:00100000:0.0:1786562863.889292:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17522 00000100:00100000:0.0:1786562863.889301:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:72595:x1873345653029120:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562863.889326:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562863.889347:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d200/0x5c655bf6668a1a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd871 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.889469:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.889486:0:33115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 30 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.889495:0:33115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.889531:0:33115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 30 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.889544:0:33115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 30 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562863.889559:0:33115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e889d49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345655000704:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562863.889635:0:33115:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9850b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562863.896055:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562863.896091:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653029248 00000100:00100000:0.0:1786562863.896100:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653029248 00010000:00010000:0.0:1786562863.896139:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 31 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562863.896176:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8854 00000100:00100000:0.0:1786562863.896186:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345653029248:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562863.896200:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562863.896207:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 31 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.896226:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 31 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.896249:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:0.0:1786562863.896254:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.896264:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.896271:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.896290:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562863.896336:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345653029248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 151us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562863.896343:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8854 00010000:00010000:3.0:1786562863.896845:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfde00/0x5c655bf6668a1a46 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd863 expref: 30 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562863.896860:0:33115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e889d49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:33115:1873345655000704:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562863.896878:0:33115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.896892:0:33115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.896898:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562863.896916:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:3.0:1786562863.902460:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d200/0x5c655bf6668a1a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 31 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.902491:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 30 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.902501:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:3.0:1786562863.902505:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562863.902508:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d800, rc 0) 00000100:00100000:3.0:1786562863.902577:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+30:72595:x1873345653029120:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 13276us (13402us total) trans 8589950895 rc 0/0 00000100:00100000:3.0:1786562863.902586:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17522 00000100:00100000:0.0:1786562863.909068:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.909157:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653029504 00000100:00100000:3.0:1786562863.909166:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653029504 00000100:00100000:3.0:1786562863.909360:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17523 00000100:00100000:3.0:1786562863.909378:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+30:72595:x1873345653029504:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562863.909405:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562863.909408:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562863.909435:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1a2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd85c expref: 30 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.909568:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562863.909582:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562863.909602:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1a70 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd878 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.910306:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562863.910886:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.910906:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.910918:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562863.910930:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f3:0x0]: returning size 0 00010000:00010000:1.0:1786562863.911155:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1a70 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 32 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.911189:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 31 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.911198:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e9bc2a2a00) 00010000:00010000:1.0:1786562863.911201:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786562863.911204:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556c00, rc 0) 00000100:00100000:1.0:1786562863.911274:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+31:72595:x1873345653029504:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1902us (2214us total) trans 8589950896 rc 0/0 00000100:00100000:1.0:1786562863.911284:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17523 00000100:00100000:2.0:1786562863.917440:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562863.917516:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653029760 00000100:00100000:0.0:1786562863.917526:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653029760 00000100:00100000:0.0:1786562863.917617:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17524 00000100:00100000:0.0:1786562863.917629:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:72595:x1873345653029760:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562863.917653:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562863.917677:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ca00/0x5c655bf6668a1a85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd87f expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.917795:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.917810:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 32 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.917820:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.917855:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 32 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562863.917868:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 32 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562863.917882:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88c79d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345655000832:192.168.204.29@tcp:104: 00000100:00100000:0.0:1786562863.917963:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bfe1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786562863.923157:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.923177:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88c79d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345655000832:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562863.923224:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562863.923691:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653029888 00000100:00100000:3.0:1786562863.923699:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653029888 00010000:00010000:3.0:1786562863.923736:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 33 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562863.923817:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8855 00000100:00100000:3.0:1786562863.923827:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+33:2348:x1873345653029888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786562863.923844:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562863.923851:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 33 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.923869:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 33 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.923904:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556c00/0x5c655bf6668a1a77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd878 expref: 33 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.923920:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e9bc2a2a00) 00010000:00010000:3.0:1786562863.923925:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.923948:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.923955:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.923984:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786562863.924072:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345653029888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 245us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562863.924081:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8855 00010000:00010000:2.0:1786562863.924132:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924142:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562863.924164:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f3:0x0]: returning size 0 00000004:00080000:2.0:1786562863.924388:0:33140:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x744:0x0], index 0: 0 00010000:00010000:2.0:1786562863.924554:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924563:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924570:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924577:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6c400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562863.924581:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924604:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924616:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e9bc2a2a00) 00010000:00010000:2.0:1786562863.924619:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562863.924623:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924630:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6c400/0x5c655bf6668a1a8c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924702:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ca00/0x5c655bf6668a1a85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd87f expref: 32 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924712:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9924c5800) 00010000:00010000:2.0:1786562863.924715:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562863.924719:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ca00/0x5c655bf6668a1a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd87f expref: 32 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.924731:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6ca00, rc 0) 00000100:00100000:2.0:1786562863.924792:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:72595:x1873345653029760:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 7167us (7362us total) trans 8589950897 rc 301/301 00000100:00100000:2.0:1786562863.925656:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17524 00000100:00100000:1.0:1786562863.928561:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.928651:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653030144 00000100:00100000:3.0:1786562863.928661:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653030144 00000100:00100000:3.0:1786562863.928775:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6363 00000100:00100000:3.0:1786562863.928787:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+31:72595:x1873345653030144:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562863.929236:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+32:72595:x1873345653030144:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 450us (684us total) trans 8589950898 rc 0/0 00000100:00100000:3.0:1786562863.930886:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6363 00000100:00100000:0.0:1786562863.932610:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.934145:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653030272 00000100:00100000:2.0:1786562863.934159:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653030272 00000100:00100000:2.0:1786562863.934297:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17525 00000100:00100000:2.0:1786562863.934307:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+32:72595:x1873345653030272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562863.934334:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562863.934398:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd886 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.934529:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.934608:0:36756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 33 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.934617:0:36756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.934649:0:36756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 33 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.934661:0:36756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 33 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.934675:0:36756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e884338e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345655000960:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562863.934764:0:36756:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8840f0840 going to sleep for 11 seconds 00000100:00100000:0.0:1786562863.938459:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562863.938608:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653030400 00000100:00100000:1.0:1786562863.938619:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653030400 00010000:00010000:1.0:1786562863.938663:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 34 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.938669:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e884338e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345655000960:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562863.938701:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562863.938714:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8856 00000100:00100000:1.0:1786562863.938726:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345653030400:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562863.938752:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562863.938761:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 34 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.938775:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 34 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.938801:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d800/0x5c655bf6668a1a62 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd871 expref: 34 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.938815:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:1.0:1786562863.938821:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.938834:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.938841:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562863.938869:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562863.938925:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+33:2348:x1873345653030400:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 198us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562863.938933:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8856 00010000:00010000:2.0:1786562863.938968:0:36756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.938977:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562863.939050:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00000004:00200000:2.0:1786562863.939056:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562863.939078:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.939113:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1a9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd886 expref: 33 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.939130:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd886 expref: 32 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.939139:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:2.0:1786562863.939142:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562863.939144:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfcc00, rc 0) 00000100:00100000:2.0:1786562863.939170:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+32:72595:x1873345653030272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4866us (6568us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562863.939178:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17525 00000100:00100000:1.0:1786562863.944773:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.945359:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653030528 00000100:00100000:3.0:1786562863.945369:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653030528 00000100:00100000:3.0:1786562863.945474:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17526 00000100:00100000:3.0:1786562863.945485:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:72595:x1873345653030528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562863.945507:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562863.945530:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1aa8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd88d expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.945622:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1aaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.945647:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1aaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.945659:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1aaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562863.945716:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f3:0x0]: returning size 0 00000004:00200000:3.0:1786562863.945722:0:33115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786562863.945752:0:33115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1aaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.945778:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1aa8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd88d expref: 34 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.945810:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1aaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd88d expref: 33 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.945819:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562863.945822:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786562863.945826:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:3.0:1786562863.945893:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+33:72595:x1873345653030528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 411us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562863.945901:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17526 00000100:00100000:0.0:1786562863.951871:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.953422:0:29662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653030656 00000100:00100000:3.0:1786562863.953434:0:29662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653030656 00000100:00100000:3.0:1786562863.953504:0:29662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18033 00000100:00100000:3.0:1786562863.953516:0:29662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653030656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562863.953720:0:29662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562863.953760:0:29662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1ab6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd894 expref: -99 pid: 29662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562863.953792:0:29662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562863.953814:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x744:0x0].0x0 since=1296s v=(0 0) 00010000:00010000:3.0:1786562863.953819:0:29662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562863.953830:0:29662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1ab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd894 expref: 9 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.953849:0:29662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff928486/0x5c655bf6668a1ab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd894 expref: 9 pid: 29662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.953863:0:29662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0600, rc 0) 00000100:00100000:0.0:1786562863.954616:0:29662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653030656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1020us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562863.954627:0:29662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18033 00000100:00100000:0.0:1786562863.976960:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562863.977043:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653030912 00000100:00100000:3.0:1786562863.977056:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653030912 00000100:00100000:3.0:1786562863.977123:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17527 00000100:00100000:3.0:1786562863.977134:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+33:72595:x1873345653030912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562863.977156:0:33113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562863.977180:0:33113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1abd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd89b expref: -99 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.977297:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1ac4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.977312:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.977325:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562863.977545:0:33113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:3.0:1786562863.977673:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1abd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd89b expref: 36 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.977722:0:33113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1ac4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd89b expref: 35 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562863.977731:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:3.0:1786562863.977746:0:33113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786562863.977750:0:33113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0e00, rc 0) 00000100:00100000:3.0:1786562863.977822:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+35:72595:x1873345653030912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 689us (871us total) trans 8589950899 rc 0/0 00000100:00100000:3.0:1786562863.977829:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17527 00000100:00100000:1.0:1786562863.984358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562863.984506:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031040 00000100:00100000:2.0:1786562863.984516:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031040 00000100:00100000:2.0:1786562863.984576:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18034 00000100:00100000:2.0:1786562863.984587:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653031040:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:2.0:1786562863.984631:0:8368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984659:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562863.984664:0:8368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562863.984671:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984786:0:8368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984817:0:8368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984831:0:8368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984839:0:8368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984847:0:8368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562863.984852:0:8368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984860:0:8368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984875:0:8368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562863.984883:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562863.985065:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cae43410-29f4-4da8-9608-d4626744ead5+8:2348:x1873345653031040:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 479us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562863.985074:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18034 00000100:00100000:0.0:1786562864.044529:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.044637:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031168 00000100:00100000:2.0:1786562864.044647:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031168 00000100:00100000:2.0:1786562864.044703:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17528 00000100:00100000:2.0:1786562864.044712:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:72595:x1873345653031168:12345-192.168.204.29@tcp:44:lfs.0 00000001:00080000:1.0:1786562864.105384:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950890 is committed 00000001:00080000:1.0:1786562864.105407:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950896 is committed 00000001:00080000:1.0:1786562864.105428:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950897 is committed 00000001:00080000:1.0:1786562864.105438:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950899 is committed 00000100:00100000:2.0:1786562864.105695:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:72595:x1873345653031168:12345-192.168.204.29@tcp:44:lfs.0 Request processed in 60976us (61167us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.105709:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17528 00000100:00100000:0.0:1786562864.108557:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.109147:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031296 00000100:00100000:1.0:1786562864.109160:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031296 00000100:00100000:1.0:1786562864.109286:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18035 00000100:00100000:1.0:1786562864.109297:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653031296:12345-192.168.204.29@tcp:16:lfs.0 00000100:00100000:1.0:1786562864.109513:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653031296:12345-192.168.204.29@tcp:16:lfs.0 Request processed in 217us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562864.109522:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18035 00000100:00100000:1.0:1786562864.126245:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.126379:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031424 00000100:00100000:2.0:1786562864.126393:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031424 00000100:00100000:2.0:1786562864.126470:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18036 00000100:00100000:2.0:1786562864.126484:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653031424:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:2.0:1786562864.126545:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126567:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562864.126571:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562864.126579:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126595:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126642:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126650:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126659:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126666:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc200 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562864.126672:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126682:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126701:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.126709:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92b7084/0x5c655bf6668a1ad9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.126834:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653031424:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 345us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.126843:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18036 00000100:00100000:0.0:1786562864.140441:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.140569:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031680 00000100:00100000:2.0:1786562864.140583:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031680 00000100:00100000:2.0:1786562864.140665:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17529 00000100:00100000:2.0:1786562864.140678:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:72595:x1873345653031680:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562864.140948:0:36756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562864.140985:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1aaf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd88d expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.141147:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:2.0:1786562864.141162:0:36756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562864.141625:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.141643:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.141655:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562864.142226:0:36756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038ae8b99 reply state 00000000befa8567 transno 8589950900 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562864.142238:0:36756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562864.142517:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88aeb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653031680:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1837us (2088us total) trans 8589950900 rc 0/0 00000100:00100000:3.0:1786562864.142533:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17529 00010000:00010000:2.0:1786562864.148499:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.148523:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.148533:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.148540:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.148545:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.148555:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.148650:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e999bb1900) 00010000:00010000:2.0:1786562864.148654:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.148661:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.148673:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1ae0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.155378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.155469:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031808 00000100:00100000:3.0:1786562864.155480:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031808 00000100:00100000:3.0:1786562864.155547:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17530 00000100:00100000:3.0:1786562864.155560:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:72595:x1873345653031808:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562864.155588:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562864.155612:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8a2 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.155686:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 25 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.155704:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 25 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.155724:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e999bb1700) 00010000:00010000:3.0:1786562864.155728:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562864.155731:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0c00, rc 0) 00000100:00100000:3.0:1786562864.155807:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653031808:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 250us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562864.155817:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17530 00000100:00100000:3.0:1786562864.159084:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562864.159222:0:29964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653031936 00000100:00100000:0.0:1786562864.159233:0:29964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653031936 00000100:00100000:0.0:1786562864.159290:0:29964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18037 00000100:00100000:0.0:1786562864.159302:0:29964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653031936:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:0.0:1786562864.159555:0:29964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x744:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786562864.159559:0:29964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x744:0x0] updating lvb mtime from disk: 0 -> 1786562863 00002000:00010000:0.0:1786562864.159562:0:29964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x744:0x0] updating lvb atime from disk: 0 -> 1786562863 00002000:00010000:0.0:1786562864.159564:0:29964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x744:0x0] updating lvb ctime from disk: 0 -> 1786562863 00002000:00010000:0.0:1786562864.159567:0:29964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x744:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786562864.159628:0:29964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653031936:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 329us (557us total) trans 21474843687 rc 0/0 00000100:00100000:0.0:1786562864.159637:0:29964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18037 00000100:00100000:0.0:1786562864.163959:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.164036:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653032192 00000100:00100000:3.0:1786562864.164045:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653032192 00000100:00100000:3.0:1786562864.164108:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17531 00000100:00100000:3.0:1786562864.164117:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653032192:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1786562864.164174:0:33113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786562864.164202:0:33113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1aa1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd886 expref: 25 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.164221:0:33113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:3.0:1786562864.164226:0:33113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562864.164270:0:33113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.164284:0:33113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.164294:0:33113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786562864.164434:0:33113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000533ff82 reply state 000000009645142b transno 8589950901 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562864.164444:0:33113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786562864.164551:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:72595:x1873345653032192:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 434us (601us total) trans 8589950901 rc 0/0 00000100:00100000:3.0:1786562864.164558:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17531 00010000:00010000:2.0:1786562864.166468:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.166484:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.166491:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.166496:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.166500:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.166507:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.166520:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:2.0:1786562864.166523:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.166527:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.166532:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1aee lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.168407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.168886:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653032320 00000100:00100000:3.0:1786562864.168897:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653032320 00000100:00100000:3.0:1786562864.168968:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18038 00000100:00100000:3.0:1786562864.168978:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+8:2349:x1873345653032320:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:3.0:1786562864.169267:0:29965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786562864.169271:0:29965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb mtime from disk: 0 -> 1786562863 00002000:00010000:3.0:1786562864.169273:0:29965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb atime from disk: 0 -> 1786562863 00002000:00010000:3.0:1786562864.169276:0:29965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb ctime from disk: 0 -> 1786562863 00002000:00010000:3.0:1786562864.169278:0:29965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786562864.169342:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+9:2349:x1873345653032320:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 365us (943us total) trans 17179876161 rc 0/0 00000100:00100000:3.0:1786562864.169350:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18038 00000100:00100000:3.0:1786562864.172147:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.172242:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653032576 00000100:00100000:1.0:1786562864.172251:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653032576 00000100:00100000:1.0:1786562864.172308:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6364 00000100:00100000:1.0:1786562864.172318:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98f615050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653032576:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:1.0:1786562864.172400:0:34647:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000404:0x4f2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1ac4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd89b expref: 25 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.172439:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.172452:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 25 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.172460:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.172498:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 25 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.172511:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 25 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.172526:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345655001088:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562864.172622:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e300 going to sleep for 11 seconds 00000100:00100000:3.0:1786562864.176063:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.176157:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345655001088:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562864.176185:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.176185:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653032704 00000100:00100000:0.0:1786562864.176191:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653032704 00010000:00010000:0.0:1786562864.176227:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 26 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.176277:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8857 00000100:00100000:0.0:1786562864.176287:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345653032704:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562864.176303:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562864.176312:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 26 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.176323:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 26 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.176517:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6ce00/0x5c655bf6668a1a1c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd855 expref: 26 pid: 34450 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.176535:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:0.0:1786562864.176539:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.176548:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.176555:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.176584:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562864.176646:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345653032704:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 360us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.176655:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8857 00010000:00010000:1.0:1786562864.176707:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.176718:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.176748:0:34647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.176760:0:34647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.176768:0:34647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.176797:0:34647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 24 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.176809:0:34647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 24 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.176823:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345655001216:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562864.176884:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e300 going to sleep for 11 seconds 00000100:00100000:3.0:1786562864.180331:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.180420:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653032832 00000100:00100000:2.0:1786562864.180430:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653032832 00010000:00010000:2.0:1786562864.180468:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 25 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.180513:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8858 00000100:00100000:2.0:1786562864.180524:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345653032832:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562864.180540:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562864.180547:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 25 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.180560:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 25 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.180582:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e999bb1700) 00010000:00010000:2.0:1786562864.180588:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.180597:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.180604:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.180621:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562864.180688:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345653032832:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.180697:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8858 00010000:00010000:1.0:1786562864.180872:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1ae7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a2 expref: 24 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.180907:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:34647:1873345655001216:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562864.180928:0:34647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.180952:0:34647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.180958:0:34647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.181587:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562864.181789:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.181824:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e882f7f000 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.181850:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655001344 00000100:00100000:0.0:1786562864.181856:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655001344 00000100:00100000:0.0:1786562864.181942:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1786562864.181953:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345655001344:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562864.182047:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345655001344:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.182055:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1786562864.182127:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562864.182184:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001472:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562864.182209:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562864.182462:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655001472 00000100:00100000:2.0:1786562864.182467:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655001472 00000100:00100000:1.0:1786562864.182473:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e881b100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.182515:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1786562864.182523:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345655001472:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562864.182585:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345655001472:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 62us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.182597:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:1.0:1786562864.182657:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bbfa3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001472:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:1.0:1786562864.183360:0:34647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].73, 280 off70944 00000001:00080000:1.0:1786562864.183372:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950902 00000100:00100000:1.0:1786562864.183437:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001600:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562864.183467:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.183497:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e600 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.183550:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655001600 00000100:00100000:0.0:1786562864.183556:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655001600 00000100:00100000:0.0:1786562864.183641:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1786562864.183649:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345655001600:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1786562864.183932:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98825c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:34647:x1873345655001600:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 283us (463us total) trans 21474843688 rc 0/0 00000100:00100000:0.0:1786562864.183940:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:1.0:1786562864.183996:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001600:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562864.184090:0:34647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1786562864.184117:0:34647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.184141:0:34647:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9af53e600 going to sleep for 11 seconds 00000100:00100000:3.0:1786562864.184220:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655001728 00000100:00100000:3.0:1786562864.184225:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655001728 00000100:00100000:3.0:1786562864.184295:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1786562864.184303:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:34647:x1873345655001728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1786562864.184435:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bbfa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:34647:x1873345655001728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 134us (317us total) trans 17179876162 rc 0/0 00000100:00100000:3.0:1786562864.184442:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1786562864.184494:0:34647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98825c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:34647:1873345655001728:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1786562864.184582:0:34647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950903 00010000:00010000:1.0:1786562864.184615:0:34647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184627:0:34647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184635:0:34647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184642:0:34647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.184647:0:34647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184656:0:34647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184680:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e999bb1700) 00010000:00010000:1.0:1786562864.184684:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786562864.184689:0:34647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184695:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1afc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184714:0:34647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184720:0:34647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184725:0:34647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184730:0:34647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.184743:0:34647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184750:0:34647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184757:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:1.0:1786562864.184759:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786562864.184762:0:34647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184768:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1af5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.184781:0:34647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9924c5400) 00010000:00010000:1.0:1786562864.184784:0:34647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562864.184790:0:34647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1ac4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd89b expref: 26 pid: 33113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.184929:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98f615050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653032576:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 12611us (12790us total) trans 8589950904 rc 0/0 00000100:00100000:1.0:1786562864.184937:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6364 00000020:00080000:1.0:1786562864.184941:0:34647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1786562864.188335:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.188466:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653032960 00000100:00100000:2.0:1786562864.188475:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653032960 00000100:00100000:2.0:1786562864.188569:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17532 00000100:00100000:2.0:1786562864.188579:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:72595:x1873345653032960:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.188615:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.188636:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8a9 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.188699:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 26 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.188714:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 26 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.188741:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562864.188745:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562864.188749:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e982bfc200, rc 0) 00000100:00100000:2.0:1786562864.188806:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+26:72595:x1873345653032960:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 229us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.188814:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17532 00000100:00100000:0.0:1786562864.193743:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.193846:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653033216 00000100:00100000:1.0:1786562864.193857:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653033216 00000100:00100000:1.0:1786562864.193921:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6365 00000100:00100000:1.0:1786562864.193932:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:72595:x1873345653033216:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562864.194229:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:72595:x1873345653033216:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 297us (504us total) trans 8589950905 rc 0/0 00000100:00100000:1.0:1786562864.194237:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6365 00000100:00100000:0.0:1786562864.198653:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.198811:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653033472 00000100:00100000:2.0:1786562864.198822:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653033472 00000100:00100000:2.0:1786562864.198887:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6366 00000100:00100000:2.0:1786562864.198899:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:72595:x1873345653033472:12345-192.168.204.29@tcp:35:lfs.0 00000004:00080000:2.0:1786562864.199815:0:35899:0:(mdd_object.c:4018:mdd_close()) Object [0x200000404:0x4f3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1786562864.200504:0:35899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.200522:0:35899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.200535:0:35899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.200544:0:35899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.200551:0:35899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.200558:0:35899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.200584:0:35899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786562864.201037:0:8414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786562864.201046:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.201054:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:1.0:1786562864.201058:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.201067:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.201081:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f3:0x0].0x0 (ffff90e9b6332400) 00010000:00010000:1.0:1786562864.201084:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786562864.201089:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.201095:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b0a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.201115:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562864.201117:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562864.201118:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786562864.201844:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:72595:x1873345653033472:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 2941us (3195us total) trans 8589950906 rc 0/0 00000100:00100000:2.0:1786562864.201855:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6366 00000100:00100000:3.0:1786562864.239755:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.240504:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653033600 00000100:00100000:1.0:1786562864.240517:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653033600 00000100:00100000:1.0:1786562864.240580:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17533 00000100:00100000:1.0:1786562864.240589:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+28:72597:x1873345653033600:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562864.240615:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562864.240639:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8b0 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.240707:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1b18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.240721:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.240744:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562864.240953:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1786562864.240958:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 45 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562864.242389:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.242431:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8b0 expref: 30 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.242450:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1b18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8b0 expref: 29 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.242459:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562864.242462:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786562864.242465:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557600, rc 0) 00000100:00100000:1.0:1786562864.242542:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+29:72597:x1873345653033600:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1952us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562864.242552:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17533 00000100:00100000:0.0:1786562864.246981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.247152:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653033856 00000100:00100000:3.0:1786562864.247168:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653033856 00000100:00100000:3.0:1786562864.247256:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17534 00000100:00100000:3.0:1786562864.247268:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:72597:x1873345653033856:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562864.247297:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562864.247325:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1b1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8b7 expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247446:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247469:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247482:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247501:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247508:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247514:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.247924:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249666:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249677:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249684:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562864.249689:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249699:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249721:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:3.0:1786562864.249726:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562864.249731:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249749:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249800:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249878:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249885:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249890:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562864.249893:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249898:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249907:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e999bb1d00) 00010000:00010000:3.0:1786562864.249910:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562864.249912:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249918:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1b2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.249993:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1b1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8b7 expref: 30 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.250036:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:3.0:1786562864.250039:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562864.250044:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0e00/0x5c655bf6668a1b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8b7 expref: 30 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.250057:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0e00, rc 0) 00000100:00100000:3.0:1786562864.250293:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:72597:x1873345653033856:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3025us (3321us total) trans 0 rc 301/301 00000100:00100000:3.0:1786562864.250305:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17534 00000100:00100000:0.0:1786562864.254418:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.254883:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653033984 00000100:00100000:1.0:1786562864.254897:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653033984 00000100:00100000:1.0:1786562864.256660:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17535 00000100:00100000:1.0:1786562864.256696:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:72597:x1873345653033984:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1786562864.256816:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.256837:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.256851:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.256871:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.256878:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.256884:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257293:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257304:0:35929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257312:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562864.257368:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00000004:00200000:1.0:1786562864.257374:0:35929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562864.257388:0:35929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257404:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257411:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257420:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257427:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.257433:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257441:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257456:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:1.0:1786562864.257460:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562864.257465:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257472:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257487:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257494:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257506:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257513:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990557200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.257515:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257521:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257528:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562864.257531:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562864.257533:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257541:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257557:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257564:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257569:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257573:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.257576:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257584:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257591:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562864.257593:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786562864.257596:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.257601:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.257743:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:72597:x1873345653033984:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1048us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562864.257755:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17535 00000100:00100000:0.0:1786562864.275354:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.275762:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653034240 00000100:00100000:2.0:1786562864.275777:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653034240 00000100:00100000:2.0:1786562864.275859:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17536 00000100:00100000:2.0:1786562864.275871:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+29:72600:x1873345653034240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.275899:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.276117:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a1b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8be expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.276222:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.276238:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.276255:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.276273:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.276279:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.276285:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277258:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277275:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277284:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562864.277298:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:2.0:1786562864.277430:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277439:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277446:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277453:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfc000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.277459:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277467:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277482:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:2.0:1786562864.277485:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.277490:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277496:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc000/0x5c655bf6668a1b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277513:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277520:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277526:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277531:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e982bfcc00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.277534:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277540:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277547:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9b6332600) 00010000:00010000:2.0:1786562864.277550:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.277553:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277560:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfcc00/0x5c655bf6668a1b57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277622:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfd200/0x5c655bf6668a1b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 32 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277637:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 31 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.277646:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562864.277649:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562864.277651:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980030800, rc 0) 00000100:00100000:2.0:1786562864.278605:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+31:72600:x1873345653034240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2726us (3260us total) trans 8589950907 rc 0/0 00000100:00100000:2.0:1786562864.278619:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17536 00000100:00100000:2.0:1786562864.287688:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.287764:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653034496 00000100:00100000:3.0:1786562864.287777:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653034496 00000100:00100000:3.0:1786562864.287855:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6367 00000100:00100000:3.0:1786562864.287868:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+31:72600:x1873345653034496:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562864.288515:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+32:72600:x1873345653034496:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 647us (840us total) trans 8589950908 rc 0/0 00000100:00100000:3.0:1786562864.288526:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6367 00000100:00100000:0.0:1786562864.295621:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.295773:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653034752 00000100:00100000:1.0:1786562864.295787:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653034752 00000100:00100000:1.0:1786562864.295873:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17537 00000100:00100000:1.0:1786562864.295885:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+32:72600:x1873345653034752:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562864.295921:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562864.295950:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8c5 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.296155:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.296174:0:36756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 33 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.296195:0:36756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.296248:0:36756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 33 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.296264:0:36756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 33 pid: 33140 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.296281:0:36756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e988721500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345655001856:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562864.296385:0:36756:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9badd20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.300870:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.300989:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653034880 00000100:00100000:2.0:1786562864.301001:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653034880 00010000:00010000:2.0:1786562864.301118:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 34 pid: 33140 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.301168:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8859 00000100:00100000:2.0:1786562864.301180:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345653034880:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562864.301199:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562864.301208:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 34 pid: 33140 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.301223:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 34 pid: 33140 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.301254:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562864.301260:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.301271:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.301278:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.301301:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562864.301365:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:2348:x1873345653034880:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 187us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.301373:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8859 00010000:00010000:1.0:1786562864.302399:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030800/0x5c655bf6668a1b5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8be expref: 33 pid: 33140 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.302658:0:36756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e988721500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:36756:1873345655001856:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562864.302689:0:36756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.302700:0:36756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.302706:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562864.302741:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:1.0:1786562864.303281:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 34 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.303309:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 33 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.303318:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562864.303321:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786562864.303324:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557200, rc 0) 00000100:00100000:1.0:1786562864.303471:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+33:72600:x1873345653034752:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 7588us (7864us total) trans 8589950909 rc 0/0 00000100:00100000:1.0:1786562864.303481:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17537 00000100:00100000:0.0:1786562864.310493:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.311933:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653035136 00000100:00100000:3.0:1786562864.311951:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653035136 00000100:00100000:2.0:1786562864.312156:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17538 00000100:00100000:2.0:1786562864.312169:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+33:72600:x1873345653035136:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.312204:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.312208:0:33115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786562864.312244:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557600/0x5c655bf6668a1b18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8b0 expref: 33 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.312268:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9bc2a2300) 00010000:00010000:2.0:1786562864.312281:0:33115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562864.312309:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031c00/0x5c655bf6668a1b81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8cc expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.316761:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.316788:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.316803:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562864.316819:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f4:0x0]: returning size 0 00010000:00010000:2.0:1786562864.316893:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031c00/0x5c655bf6668a1b81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 35 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.316923:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 34 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.316933:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.316937:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562864.316941:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031200, rc 0) 00000100:00100000:2.0:1786562864.317068:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:72600:x1873345653035136:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4900us (6587us total) trans 8589950910 rc 0/0 00000100:00100000:2.0:1786562864.317080:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17538 00000100:00100000:0.0:1786562864.323070:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.323182:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653035392 00000100:00100000:2.0:1786562864.323197:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653035392 00000100:00100000:2.0:1786562864.323271:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17539 00000100:00100000:2.0:1786562864.323284:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:72600:x1873345653035392:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.323319:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.323350:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1b96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8d3 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.323701:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.323720:0:34450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 35 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.323740:0:34450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.323788:0:34450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 35 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.323803:0:34450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 35 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.323820:0:34450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345655001984:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562864.326539:0:34450:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8840f09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.330454:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.330793:0:34450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:34450:1873345655001984:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562864.330831:0:34450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.336366:0:35896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653035520 00000100:00100000:1.0:1786562864.336388:0:35896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653035520 00010000:00010000:0.0:1786562864.336534:0:35896:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 36 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.336610:0:35896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8860 00000100:00100000:0.0:1786562864.336623:0:35896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+36:2348:x1873345653035520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562864.336647:0:35896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562864.336656:0:35896:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 36 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.336677:0:35896:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 36 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.336707:0:35896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1b88 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8cc expref: 36 pid: 33115 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.336729:0:35896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:0.0:1786562864.336745:0:35896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.336755:0:35896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.336763:0:35896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.336872:0:35896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562864.336976:0:35896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cae43410-29f4-4da8-9608-d4626744ead5+35:2348:x1873345653035520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 355us (6545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.336986:0:35896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8860 00010000:00010000:3.0:1786562864.338599:0:34450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.338617:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562864.338647:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f4:0x0]: returning size 0 00000004:00080000:2.0:1786562864.339545:0:34450:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x729:0x0], index 1: 0 00010000:00010000:2.0:1786562864.339745:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.339760:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.339772:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.339782:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.339788:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.339799:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.339820:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.339824:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562864.339829:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.339837:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1b9d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.340278:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1b96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8d3 expref: 35 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.340294:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562864.341650:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562864.341668:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1b96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8d3 expref: 35 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.341706:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031000, rc 0) 00000100:00100000:2.0:1786562864.341842:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+34:72600:x1873345653035392:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 18557us (18784us total) trans 8589950911 rc 301/301 00000100:00100000:2.0:1786562864.341858:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17539 00000100:00100000:0.0:1786562864.348347:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.348496:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653035776 00000100:00100000:1.0:1786562864.348511:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653035776 00000100:00100000:1.0:1786562864.348633:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6368 00000100:00100000:1.0:1786562864.348656:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+34:72600:x1873345653035776:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1786562864.349760:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+35:72600:x1873345653035776:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1110us (1422us total) trans 8589950912 rc 0/0 00000100:00100000:3.0:1786562864.349773:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6368 00000100:00100000:0.0:1786562864.360233:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.360341:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653035904 00000100:00100000:2.0:1786562864.360354:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653035904 00000100:00100000:2.0:1786562864.360459:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17540 00000100:00100000:2.0:1786562864.360473:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:72600:x1873345653035904:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.360506:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.360537:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1bab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8da expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.360690:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.360708:0:33140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 36 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.360718:0:33140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.360773:0:33140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 36 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.360788:0:33140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 36 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.360805:0:33140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345655002112:192.168.204.29@tcp:104: 00000100:00100000:2.0:1786562864.360924:0:33140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e8840f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.363096:0:33140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88433b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:33140:1873345655002112:192.168.204.29@tcp:104: 00010000:00010000:0.0:1786562864.363139:0:33140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.363952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.364095:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036032 00000100:00100000:2.0:1786562864.364105:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036032 00010000:00010000:2.0:1786562864.364156:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 37 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.364202:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8861 00000100:00100000:2.0:1786562864.364215:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+37:2349:x1873345653036032:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562864.364233:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562864.364240:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 37 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.364254:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 37 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.364283:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1b73 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x4f2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8c5 expref: 37 pid: 36756 timeout: 1396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.364305:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562864.364310:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.364322:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.364330:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.364365:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562864.364596:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+36:2349:x1873345653036032:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 381us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.364608:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8861 00010000:00010000:0.0:1786562864.364624:0:33140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.364868:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786562864.364924:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00000004:00200000:0.0:1786562864.364935:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786562864.364960:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.365039:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1bab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8da expref: 36 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.365060:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8da expref: 35 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.365069:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:0.0:1786562864.365073:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786562864.365075:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980030600, rc 0) 00000100:00100000:0.0:1786562864.365253:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+35:72600:x1873345653035904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4782us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.365261:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17540 00000100:00100000:0.0:1786562864.368094:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.368192:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036160 00000100:00100000:1.0:1786562864.368204:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036160 00000100:00100000:1.0:1786562864.368319:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17541 00000100:00100000:1.0:1786562864.368330:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98827bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+35:72600:x1873345653036160:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562864.368358:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562864.368389:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a1bb9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8e1 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.368489:0:36756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1bc0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.368510:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.368523:0:36756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786562864.368568:0:36756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f4:0x0]: returning size 0 00000004:00200000:1.0:1786562864.368574:0:36756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786562864.368594:0:36756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 36756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.368625:0:36756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556800/0x5c655bf6668a1bb9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8e1 expref: 37 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.368646:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8e1 expref: 36 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.368655:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:1.0:1786562864.368658:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786562864.368662:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556a00, rc 0) 00000100:00100000:1.0:1786562864.368899:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98827bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+36:72600:x1873345653036160:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 571us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562864.368908:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17541 00000100:00100000:0.0:1786562864.372363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.372443:0:28862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036288 00000100:00100000:3.0:1786562864.372457:0:28862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036288 00000100:00100000:3.0:1786562864.372520:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18039 00000100:00100000:3.0:1786562864.372531:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653036288:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562864.372555:0:28862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562864.372582:0:28862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c3b01d6/0x5c655bf6668a1bc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8e8 expref: -99 pid: 28862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786562864.372617:0:28862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786562864.372642:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x729:0x0].0x0 since=1296s v=(0 0) 00010000:00010000:3.0:1786562864.372647:0:28862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786562864.372657:0:28862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c3b01d6/0x5c655bf6668a1bc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8e8 expref: 10 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.372677:0:28862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c3b01d6/0x5c655bf6668a1bc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8e8 expref: 10 pid: 28862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.372693:0:28862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0e00, rc 0) 00000100:00100000:3.0:1786562864.372779:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653036288:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 250us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562864.372787:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18039 00000100:00100000:0.0:1786562864.375823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.376197:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036544 00000100:00100000:2.0:1786562864.376210:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036544 00000100:00100000:2.0:1786562864.376286:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17542 00000100:00100000:2.0:1786562864.376300:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+36:72600:x1873345653036544:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.376328:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.376357:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1bce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8ef expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.376499:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1bd5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.376519:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.376533:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562864.376549:0:33115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00010000:00010000:2.0:1786562864.376715:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1bce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8ef expref: 39 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.376746:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8ef expref: 38 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.376758:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562864.376761:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786562864.376765:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031e00, rc 0) 00000100:00100000:2.0:1786562864.376907:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+38:72600:x1873345653036544:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 609us (1098us total) trans 8589950913 rc 0/0 00000100:00100000:2.0:1786562864.376917:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17542 00000100:00100000:0.0:1786562864.385378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.385763:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036672 00000100:00100000:2.0:1786562864.385777:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036672 00000100:00100000:2.0:1786562864.385903:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18040 00000100:00100000:2.0:1786562864.385916:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653036672:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:2.0:1786562864.385995:0:29967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386053:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562864.386059:0:29967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786562864.386067:0:29967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386085:0:29967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386129:0:29967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386140:0:29967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386150:0:29967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386165:0:29967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030e00 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562864.386170:0:29967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386182:0:29967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386203:0:29967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.386212:0:29967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcac4bfa/0x5c655bf6668a1be3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.386334:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653036672:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 420us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.386344:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18040 00000100:00100000:0.0:1786562864.469742:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.470226:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036800 00000100:00100000:2.0:1786562864.470240:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036800 00000100:00100000:2.0:1786562864.470423:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17543 00000100:00100000:2.0:1786562864.470436:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+38:72600:x1873345653036800:12345-192.168.204.29@tcp:44:lfs.0 00000100:00100000:2.0:1786562864.599941:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+38:72600:x1873345653036800:12345-192.168.204.29@tcp:44:lfs.0 Request processed in 129476us (130191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.599958:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17543 00000001:00080000:1.0:1786562864.600461:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950912 is committed 00000020:00080000:1.0:1786562864.600496:0:33119:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e9bfe1e6c0 refcount 2 committed 0 result 0 batchid 4294969306 00000020:00080000:1.0:1786562864.600501:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9b42ad400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e881b100c0 00000020:00080000:1.0:1786562864.600505:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9b42ad100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e9bfe1e900 00000020:00080000:1.0:1786562864.600510:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9b42adb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e988e7fc00 00000020:00080000:1.0:1786562864.600514:0:33119:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].73 00000001:00080000:1.0:1786562864.600542:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950913 is committed 00000020:00080000:2.0:1786562864.601631:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969306 committed batchid 4294969305 00000020:00080000:2.0:1786562864.601889:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969305 00000100:00100000:1.0:1786562864.605334:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.605521:0:29963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653036928 00000100:00100000:2.0:1786562864.605534:0:29963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653036928 00000100:00100000:2.0:1786562864.605606:0:29963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18041 00000100:00100000:2.0:1786562864.605617:0:29963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653036928:12345-192.168.204.29@tcp:16:lfs.0 00000100:00100000:2.0:1786562864.605786:0:29963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653036928:12345-192.168.204.29@tcp:16:lfs.0 Request processed in 170us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.605794:0:29963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18041 00000100:00100000:2.0:1786562864.632984:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562864.633196:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653037056 00000100:00100000:0.0:1786562864.633210:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653037056 00000100:00100000:0.0:1786562864.633268:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18042 00000100:00100000:0.0:1786562864.633279:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653037056:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1786562864.633348:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633370:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786562864.633376:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562864.633382:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633400:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633438:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633446:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633454:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633463:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d800 already unused, calling callback (ffffffffc1585030) 00010000:00010000:0.0:1786562864.633468:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633484:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633501:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.633509:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155e8363/0x5c655bf6668a1bea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.633604:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653037056:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 326us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.633612:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18042 00000100:00100000:1.0:1786562864.636648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562864.636749:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653037312 00000100:00100000:0.0:1786562864.636762:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653037312 00000100:00100000:0.0:1786562864.636835:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17544 00000100:00100000:0.0:1786562864.636848:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+24:72600:x1873345653037312:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1786562864.636935:0:33140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562864.636973:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556a00/0x5c655bf6668a1bc0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8e1 expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.637038:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9bc2a2800) 00010000:00010000:0.0:1786562864.637054:0:33140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786562864.637099:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.637119:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.637131:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786562864.642882:0:33140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c78b7c00 reply state 000000005ad00b99 transno 8589950914 ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.642908:0:33140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786562864.643588:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+25:72600:x1873345653037312:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 6734us (6946us total) trans 8589950914 rc 0/0 00000100:00100000:1.0:1786562864.643599:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17544 00000100:00100000:2.0:1786562864.649330:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.649491:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653037440 00000100:00100000:1.0:1786562864.649506:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653037440 00000100:00100000:1.0:1786562864.649586:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17545 00000100:00100000:1.0:1786562864.649599:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+25:72600:x1873345653037440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562864.649633:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562864.649663:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8f6 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.649754:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 26 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.649771:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 26 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.649796:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9924c5a00) 00010000:00010000:1.0:1786562864.649801:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562864.649806:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990557200, rc 0) 00000100:00100000:1.0:1786562864.649891:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e882960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+26:72600:x1873345653037440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 294us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562864.649899:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17545 00010000:00010000:0.0:1786562864.653217:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.653247:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.653257:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.653265:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e99ff6d600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:0.0:1786562864.653271:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.653282:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.653317:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9924c5a00) 00010000:00010000:0.0:1786562864.653322:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786562864.653328:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562864.653335:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e99ff6d600/0x5c655bf6668a1bf1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.660220:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.660354:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653037568 00000100:00100000:1.0:1786562864.660367:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653037568 00000100:00100000:1.0:1786562864.660444:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18043 00000100:00100000:1.0:1786562864.660456:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653037568:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562864.660790:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x729:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562864.660795:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x729:0x0] updating lvb mtime from disk: 0 -> 1786562863 00002000:00010000:1.0:1786562864.660798:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x729:0x0] updating lvb atime from disk: 0 -> 1786562863 00002000:00010000:1.0:1786562864.660801:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x729:0x0] updating lvb ctime from disk: 0 -> 1786562863 00002000:00010000:1.0:1786562864.660803:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x729:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562864.660883:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cae43410-29f4-4da8-9608-d4626744ead5+11:2348:x1873345653037568:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 427us (677us total) trans 17179876163 rc 0/0 00000100:00100000:1.0:1786562864.660891:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18043 00000100:00100000:3.0:1786562864.664436:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.664637:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653037824 00000100:00100000:2.0:1786562864.664650:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653037824 00000100:00100000:2.0:1786562864.664742:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17546 00000100:00100000:2.0:1786562864.664756:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:72600:x1873345653037824:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1786562864.664834:0:33114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562864.664869:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1bb2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8da expref: 25 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.664896:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562864.664903:0:33114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786562864.664971:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.664988:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.665255:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562864.665508:0:33114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7cc1769 reply state 0000000001485f1d transno 8589950915 ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.665521:0:33114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786562864.665787:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:72600:x1873345653037824:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1032us (1364us total) trans 8589950915 rc 0/0 00000100:00100000:2.0:1786562864.665797:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17546 00000100:00100000:2.0:1786562864.670954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.671157:0:29966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653037952 00000100:00100000:1.0:1786562864.671172:0:29966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653037952 00000100:00100000:1.0:1786562864.671252:0:29966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18044 00000100:00100000:1.0:1786562864.671266:0:29966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+11:2351:x1873345653037952:12345-192.168.204.29@tcp:2:lfs.0 00002000:00010000:1.0:1786562864.671550:0:29966:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786562864.671555:0:29966:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb mtime from disk: 1786562863 -> 1786562863 00002000:00010000:1.0:1786562864.671557:0:29966:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb atime from disk: 1786562863 -> 1786562863 00002000:00010000:1.0:1786562864.671560:0:29966:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb ctime from disk: 1786562863 -> 1786562863 00002000:00010000:1.0:1786562864.671562:0:29966:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x728:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786562864.671654:0:29966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cae43410-29f4-4da8-9608-d4626744ead5+12:2351:x1873345653037952:12345-192.168.204.29@tcp:2:lfs.0 Request processed in 389us (713us total) trans 17179876164 rc 0/0 00000100:00100000:1.0:1786562864.671663:0:29966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18044 00010000:00010000:3.0:1786562864.675157:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675183:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675192:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675198:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980031400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562864.675204:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675212:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675234:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:3.0:1786562864.675237:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786562864.675241:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 2/0,0 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675249:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1bff lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562864.675488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.675589:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653038208 00000100:00100000:3.0:1786562864.675603:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653038208 00000100:00100000:3.0:1786562864.675722:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6369 00000100:00100000:3.0:1786562864.675744:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e98f616850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:72600:x1873345653038208:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:3.0:1786562864.675876:0:33117:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000404:0x4f2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8ef expref: 25 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675932:0:33117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675950:0:33117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 25 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.675960:0:33117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.676059:0:33117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 25 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562864.676076:0:33117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 25 pid: 33140 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562864.676094:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88b7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345655002240:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562864.676217:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9b470bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786562864.685080:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562864.685317:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88b7e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345655002240:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562864.685354:0:33117:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.685739:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653038336 00000100:00100000:1.0:1786562864.685750:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653038336 00010000:00010000:1.0:1786562864.685806:0:8413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 26 pid: 33140 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.685855:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8862 00000100:00100000:1.0:1786562864.685867:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:2349:x1873345653038336:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786562864.685887:0:8413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786562864.685896:0:8413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 26 pid: 33140 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.685911:0:8413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 26 pid: 33140 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.685949:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e982bfc200/0x5c655bf6668a1b03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8a9 expref: 26 pid: 33140 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.685968:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562864.685973:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.685984:0:8413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686035:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686063:0:8413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786562864.686133:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bf8de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345653038336:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 268us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562864.686142:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8862 00010000:00010000:1.0:1786562864.686175:0:33117:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686183:0:33117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686208:0:33117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686220:0:33117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686229:0:33117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686265:0:33117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 24 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.686279:0:33117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 24 pid: 36756 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.686309:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345655002368:192.168.204.29@tcp:104: 00000100:00100000:1.0:1786562864.686376:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc1726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.693458:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.693536:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:33117:1873345655002368:192.168.204.29@tcp:104: 00010000:00010000:1.0:1786562864.693573:0:33117:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.693651:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653038464 00000100:00100000:2.0:1786562864.693660:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653038464 00010000:00010000:2.0:1786562864.693706:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 25 pid: 36756 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.693768:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8863 00000100:00100000:2.0:1786562864.693779:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:2348:x1873345653038464:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562864.693799:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562864.693807:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 25 pid: 36756 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.693822:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 25 pid: 36756 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.693850:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990557200/0x5c655bf6668a1bf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8f6 expref: 25 pid: 36756 timeout: 1397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.693869:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9924c5a00) 00010000:00010000:2.0:1786562864.693875:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.693886:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.693894:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.693924:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562864.694027:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cae43410-29f4-4da8-9608-d4626744ead5+24:2348:x1873345653038464:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 226us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.694036:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8863 00010000:00010000:1.0:1786562864.694488:0:33117:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.694499:0:33117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.695140:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786562864.695214:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.695257:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9925549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.695463:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655002496 00000100:00100000:0.0:1786562864.695472:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655002496 00000100:00100000:0.0:1786562864.695528:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1786562864.695539:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786562864.695634:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562864.695642:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1786562864.698068:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786562864.698197:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786562864.698284:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.698338:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:3.0:1786562864.698386:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655002624 00000100:00100000:3.0:1786562864.698396:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655002624 00000100:00100000:3.0:1786562864.698454:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1786562864.698475:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786562864.698693:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 227us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.698703:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1786562864.698953:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786562864.699000:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786562864.699249:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.699278:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9aef92480 going to sleep for 11 seconds 00000100:00100000:2.0:1786562864.699383:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655002752 00000100:00100000:2.0:1786562864.699389:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655002752 00000100:00100000:2.0:1786562864.699437:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1786562864.699445:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786562864.699525:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.699532:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1786562864.699633:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786562864.700286:0:33117:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950916 00000100:00100000:1.0:1786562864.700527:0:33117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786562864.700575:0:33117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562864.700669:0:33117:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e9bc172a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786562864.709022:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655002880 00000100:00100000:0.0:1786562864.709045:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655002880 00000100:00100000:0.0:1786562864.709140:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1786562864.709154:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33117:x1873345655002880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786562864.709530:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9af24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:33117:x1873345655002880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 378us (8952us total) trans 17179876165 rc 0/0 00000100:00100000:0.0:1786562864.709540:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1786562864.709807:0:33117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9af24d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:33117:1873345655002880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786562864.709972:0:33117:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589950917 00010000:00010000:1.0:1786562864.710058:0:33117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710071:0:33117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710080:0:33117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710087:0:33117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556600 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.710092:0:33117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710101:0:33117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710121:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9924c5a00) 00010000:00010000:1.0:1786562864.710124:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786562864.710129:0:33117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710135:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c0d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710161:0:33117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710168:0:33117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710173:0:33117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710179:0:33117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb0800 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:1.0:1786562864.710181:0:33117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710187:0:33117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710195:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562864.710198:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786562864.710202:0:33117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710208:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0800/0x5c655bf6668a1c06 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.710243:0:33117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:1.0:1786562864.710246:0:33117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786562864.710254:0:33117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1bd5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8ef expref: 26 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562864.710390:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e98f616850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:72600:x1873345653038208:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 34649us (34910us total) trans 8589950918 rc 0/0 00000100:00100000:1.0:1786562864.710399:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6369 00000020:00080000:1.0:1786562864.710404:0:33117:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1786562864.714420:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.714791:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653038592 00000100:00100000:2.0:1786562864.714805:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653038592 00000100:00100000:2.0:1786562864.714886:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17547 00000100:00100000:2.0:1786562864.714900:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+25:72600:x1873345653038592:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.715106:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.715143:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1c14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd8fd expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.715227:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1c14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8fd expref: 26 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.715245:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030600/0x5c655bf6668a1c14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd8fd expref: 26 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.715270:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562864.715274:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786562864.715279:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980030600, rc 0) 00000100:00100000:2.0:1786562864.715496:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+26:72600:x1873345653038592:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 598us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.715505:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17547 00000100:00100000:0.0:1786562864.722955:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.723303:0:35899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653038848 00000100:00100000:2.0:1786562864.723317:0:35899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653038848 00000100:00100000:2.0:1786562864.723391:0:35899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6370 00000100:00100000:2.0:1786562864.723404:0:35899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+26:72600:x1873345653038848:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562864.723738:0:35899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cae43410-29f4-4da8-9608-d4626744ead5+27:72600:x1873345653038848:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 336us (797us total) trans 8589950919 rc 0/0 00000100:00100000:2.0:1786562864.723747:0:35899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6370 00000100:00100000:3.0:1786562864.726887:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.727058:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653039104 00000100:00100000:1.0:1786562864.727073:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653039104 00000100:00100000:1.0:1786562864.727153:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6371 00000100:00100000:1.0:1786562864.727165:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+27:72600:x1873345653039104:12345-192.168.204.29@tcp:35:lfs.0 00000004:00080000:1.0:1786562864.728299:0:33116:0:(mdd_object.c:4018:mdd_close()) Object [0x200000404:0x4f4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1786562864.729148:0:33116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.729174:0:33116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.729188:0:33116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.729198:0:33116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.729204:0:33116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.729212:0:33116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562864.729242:0:33116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786562864.729380:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786562864.729389:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.729397:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e990556600 already unused, calling callback (ffffffffc1585030) 00010000:00010000:2.0:1786562864.729402:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.729411:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.729427:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f4:0x0].0x0 (ffff90e9bc2a2b00) 00010000:00010000:2.0:1786562864.729430:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786562864.729435:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.729440:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556600/0x5c655bf6668a1c1b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.729462:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562864.729464:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786562864.729466:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562864.729837:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+28:72600:x1873345653039104:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 2667us (2957us total) trans 8589950920 rc 0/0 00000100:00100000:1.0:1786562864.729907:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6371 00000100:00100000:0.0:1786562864.779429:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562864.781422:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653039232 00000100:00100000:1.0:1786562864.781562:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653039232 00000100:00100000:2.0:1786562864.781877:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17548 00000100:00100000:2.0:1786562864.781893:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+28:72602:x1873345653039232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.781929:0:33140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.781963:0:33140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd904 expref: -99 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.782080:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1c29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.782097:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.782112:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562864.782387:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562864.782392:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 45 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562864.782493:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.782530:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd904 expref: 30 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.782552:0:33140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd904 expref: 29 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.782562:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.782566:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562864.782570:0:33140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031a00, rc 0) 00000100:00100000:2.0:1786562864.782672:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+29:72602:x1873345653039232:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 783us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.782811:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17548 00000100:00100000:0.0:1786562864.786850:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.786978:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653039488 00000100:00100000:2.0:1786562864.786992:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653039488 00000100:00100000:2.0:1786562864.787277:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17549 00000100:00100000:2.0:1786562864.787291:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:72602:x1873345653039488:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.787322:0:33115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.787349:0:33115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd90b expref: -99 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787449:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787466:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787484:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787502:0:33115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787510:0:33115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787517:0:33115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787958:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787969:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787976:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787983:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.787988:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.787997:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788059:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.788062:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.788068:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788075:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788088:0:33115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788095:0:33115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788101:0:33115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788106:0:33115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.788110:0:33115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788116:0:33115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788123:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9b6332600) 00010000:00010000:2.0:1786562864.788125:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.788129:0:33115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788134:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788181:0:33115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd90b expref: 30 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788198:0:33115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.788201:0:33115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562864.788205:0:33115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd90b expref: 30 pid: 33115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.788215:0:33115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980030e00, rc 0) 00000100:00100000:2.0:1786562864.788310:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+29:72602:x1873345653039488:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1022us (1479us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562864.788319:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17549 00000100:00100000:3.0:1786562864.791592:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.791955:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653039616 00000100:00100000:2.0:1786562864.791968:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653039616 00000100:00100000:2.0:1786562864.792186:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17550 00000100:00100000:2.0:1786562864.792198:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:72602:x1873345653039616:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562864.792292:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792312:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792326:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792345:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792353:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792364:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792816:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792827:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792836:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562864.792878:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00000004:00200000:2.0:1786562864.792883:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562864.792898:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792915:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792923:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792931:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792937:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.792942:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792949:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792965:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.792968:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.792974:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.792980:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793052:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793060:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793067:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793072:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980031000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.793075:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793081:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793089:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9b6332e00) 00010000:00010000:2.0:1786562864.793091:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.793094:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793100:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793121:0:33114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793128:0:33114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793134:0:33114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793139:0:33114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980031200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.793142:0:33114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793147:0:33114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793153:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562864.793155:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.793158:0:33114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.793163:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.793260:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:72602:x1873345653039616:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1061us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.793270:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17550 00000100:00100000:3.0:1786562864.827438:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.827547:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653039872 00000100:00100000:2.0:1786562864.827560:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653039872 00000100:00100000:2.0:1786562864.827633:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17551 00000100:00100000:2.0:1786562864.827647:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:72606:x1873345653039872:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562864.827674:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562864.827705:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd912 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.827833:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.827850:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.827864:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.827882:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.827889:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.827895:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828320:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828329:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828336:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828347:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980031000 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.828353:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828361:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828377:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.828381:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.828386:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828391:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031000/0x5c655bf6668a1c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828406:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828412:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828417:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828422:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030c00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.828424:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828430:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828441:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9b6332e00) 00010000:00010000:2.0:1786562864.828443:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.828446:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828451:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030c00/0x5c655bf6668a1c68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828491:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd912 expref: 30 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828501:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.828504:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786562864.828507:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031200/0x5c655bf6668a1c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd912 expref: 30 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.828516:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031200, rc 0) 00000100:00100000:2.0:1786562864.828605:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88b7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:72606:x1873345653039872:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 960us (1181us total) trans 0 rc 301/301 00000100:00100000:2.0:1786562864.828614:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17551 00000100:00100000:0.0:1786562864.840224:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562864.840345:0:33140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040000 00000100:00100000:2.0:1786562864.840360:0:33140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040000 00000100:00100000:2.0:1786562864.840463:0:33140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17552 00000100:00100000:2.0:1786562864.840476:0:33140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+29:72606:x1873345653040000:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1786562864.840580:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.840601:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.840616:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.840910:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.840920:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.840930:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841383:0:33140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841394:0:33140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841401:0:33140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562864.841441:0:33140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f2:0x0]: returning size 0 00000004:00200000:2.0:1786562864.841446:0:33140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562864.841461:0:33140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841476:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841483:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841495:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841501:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.841506:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841515:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841529:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:2.0:1786562864.841533:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.841538:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841545:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030e00/0x5c655bf6668a1c6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841561:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841568:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841574:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841579:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030a00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.841582:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841594:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841602:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc66b9d5b (ffff90e9b6332600) 00010000:00010000:2.0:1786562864.841604:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.841607:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841613:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030a00/0x5c655bf6668a1c76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc66b9d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841629:0:33140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841635:0:33140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841642:0:33140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841647:0:33140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562864.841649:0:33140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841655:0:33140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.841662:0:33140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f2:0x0].0x0 (ffff90e9b6332f00) 00010000:00010000:2.0:1786562864.842222:0:33140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562864.842230:0:33140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562864.842242:0:33140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c7d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562864.842362:0:33140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cae43410-29f4-4da8-9608-d4626744ead5+29:72606:x1873345653040000:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1883us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562864.842373:0:33140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17552 00010000:00010000:0.0:1786562864.933979:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786562865.466455:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562865.466516:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562865.466552:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040256 00000100:00100000:2.0:1786562865.466567:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040256 00000100:00100000:3.0:1786562865.466578:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562865.466686:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562865.466756:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 525 00000100:00100000:3.0:1786562865.466772:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345653040256:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:1.0:1786562865.466787:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562865.466806:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040128 00000100:00100000:0.0:1786562865.466806:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040512 00000100:00100000:1.0:1786562865.466810:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040128 00000100:00100000:0.0:1786562865.466810:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040512 00000100:00100000:0.0:1786562865.466848:0:29965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040384 00000100:00100000:1.0:1786562865.466849:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 562 00000100:00100000:0.0:1786562865.466851:0:29965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040384 00000100:00100000:1.0:1786562865.466858:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653040128:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1786562865.466875:0:29965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 623 00000100:00100000:3.0:1786562865.466882:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+29:2349:x1873345653040256:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 113us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562865.466884:0:29965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345653040512:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562865.466896:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b4bd338-b43c-4989-b811-79054f6124e2+10:2349:x1873345653040128:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562865.466901:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 525 00000100:00100000:1.0:1786562865.466909:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 562 00000100:00100000:0.0:1786562865.466924:0:29965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cae43410-29f4-4da8-9608-d4626744ead5+12:2349:x1873345653040512:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562865.466932:0:29965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 623 00000100:00100000:3.0:1786562865.466952:0:28862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 624 00000100:00100000:3.0:1786562865.466962:0:28862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653040384:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1786562865.466992:0:28862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cae43410-29f4-4da8-9608-d4626744ead5+10:2349:x1873345653040384:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00080000:1.0:1786562865.467102:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786562865.467106:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786562865.472812:0:28862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 624 00010000:00010000:3.0:1786562865.958403:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786562866.469683:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345655003008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786562866.469799:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562866.469990:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655003008 00000100:00100000:0.0:1786562866.470202:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655003008 00000100:00100000:0.0:1786562866.470282:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1786562866.470294:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3291:x1873345655003008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786562866.470343:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54722560 pending 0 free 3844079616 avail 3841982464 00000100:00100000:0.0:1786562866.470400:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3291:x1873345655003008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562866.470408:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1786562866.470588:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1873345655003008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562866.473770:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345655003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562866.473868:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562866.473970:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655003136 00000100:00100000:3.0:1786562866.473980:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655003136 00000100:00100000:3.0:1786562866.474071:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1786562866.474084:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345655003136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786562866.474133:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520290304 pending 0 free 3835691008 avail 3833593856 00000100:00100000:3.0:1786562866.474185:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1873345655003136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562866.474194:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1786562866.474249:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1873345655003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786562866.474341:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345655003392:0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474373:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562866.474402:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562866.474408:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345655003264:0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474435:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562866.474466:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655003392 00000100:00100000:3.0:1786562866.474470:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655003392 00000100:00100000:3.0:1786562866.474506:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1786562866.474517:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345655003392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474554:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1873345655003392:12345-0@lo:400:kworker.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562866.474560:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1786562866.474581:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345655003648:0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474605:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562866.474623:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786562866.474628:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e88ac84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345655003520:0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474648:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562866.474673:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655003648 00000100:00100000:3.0:1786562866.474677:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655003648 00000100:00100000:3.0:1786562866.474711:0:33113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655003520 00000100:00100000:3.0:1786562866.474714:0:33113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655003520 00000100:00100000:3.0:1786562866.474735:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1786562866.474741:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345655003648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474775:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345655003648:12345-0@lo:400:kworker.0 Request processed in 33us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562866.474781:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1786562866.474792:0:33113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1786562866.474798:0:33113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345655003520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474825:0:33113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88317b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1873345655003520:12345-0@lo:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562866.474832:0:33113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1786562866.474861:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1873345655003392:0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474882:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1873345655003520:0@lo:400:kworker.0 00000100:00100000:3.0:1786562866.474891:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345655003648:0@lo:400:kworker.0 00000100:00100000:2.0:1786562866.475136:0:33109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655003264 00000100:00100000:2.0:1786562866.475141:0:33109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655003264 00000100:00100000:2.0:1786562866.475176:0:33109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1786562866.475183:0:33109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345655003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786562866.475224:0:33109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c95f678-1633-48c9-bbd9-793f47c06679+19:3290:x1873345655003264:12345-0@lo:400:kworker.0 Request processed in 42us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562866.475231:0:33109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1786562866.475486:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e88ac86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c95f678-1633-48c9-bbd9-793f47c06679:3290:1873345655003264:0@lo:400:kworker.0 00000100:00080000:3.0:1786562866.475790:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786562866.475797:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786562866.475801:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786562866.982431:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562868.005368:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786562868.586065:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876165 is committed 00000001:00080000:3.0:1786562868.586086:0:27136:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179876164 is committed 00000001:00080000:0.0:1786562868.592284:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843688 is committed 00000001:00080000:0.0:1786562868.592300:0:25627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474843687 is committed 00010000:00010000:0.0:1786562869.038466:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562869.627921:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950914 is committed 00000001:00080000:1.0:1786562869.627936:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950920 is committed 00000020:00080000:1.0:1786562869.627957:0:33119:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e9aef92480 refcount 2 committed 0 result 0 batchid 4294969307 00000020:00080000:1.0:1786562869.627962:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9b42ad200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e9aef92d80 00000020:00080000:1.0:1786562869.627966:0:33119:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff90e9b42ad500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e9c1f92400 00000020:00080000:1.0:1786562869.627990:0:33119:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969306 batchid updated 00000020:00080000:2.0:1786562869.628077:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969307 committed batchid 4294969306 00000020:00080000:2.0:1786562869.628526:0:33151:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969306 cancel update log [0x200000bd0:0x1:0x0].73: rc = 0 00000020:00080000:2.0:1786562869.628537:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969306 00010000:00010000:0.0:1786562870.054350:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786562870.588410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562870.588452:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562870.588485:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562870.588523:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562870.588598:0:33115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040768 00000100:00100000:2.0:1786562870.588618:0:33115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040768 00000100:00100000:2.0:1786562870.588692:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 529 00000100:00100000:2.0:1786562870.588703:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345653040768:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562870.588779:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cae43410-29f4-4da8-9608-d4626744ead5+22:2348:x1873345653040768:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562870.588788:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 529 00000100:00100000:2.0:1786562870.588814:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040896 00000100:00100000:2.0:1786562870.588818:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040896 00000100:00100000:2.0:1786562870.588844:0:29967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653041024 00000100:00100000:2.0:1786562870.588846:0:29967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653041024 00000100:00100000:2.0:1786562870.588869:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 625 00000100:00100000:2.0:1786562870.588876:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653040896:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562870.588905:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653040896:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562870.588912:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 625 00000100:00100000:2.0:1786562870.588924:0:29967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 626 00000100:00100000:2.0:1786562870.588930:0:29967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653041024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1786562870.588955:0:29967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653041024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562870.588961:0:29967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 626 00000100:00080000:0.0:1786562870.589201:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786562870.589206:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786562870.589209:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786562870.589504:0:33107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653040640 00000100:00100000:1.0:1786562870.589510:0:33107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653040640 00000100:00100000:1.0:1786562870.589547:0:33107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 564 00000100:00100000:1.0:1786562870.589555:0:33107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653040640:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1786562870.589600:0:33107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b4bd338-b43c-4989-b811-79054f6124e2+10:2348:x1873345653040640:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 45us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562870.589615:0:33107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 564 00010000:00010000:3.0:1786562871.078505:0:7599:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786562871.124783:0:42762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 205b: lfs mirror extend to set nocompr flag ========================================================== 15:27:48 (1786562868) 00000100:00100000:0.0:1786562871.389890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562871.390037:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653041280 00000100:00100000:3.0:1786562871.390047:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653041280 00000100:00100000:3.0:1786562871.390106:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17553 00000100:00100000:3.0:1786562871.390117:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+22:73173:x1873345653041280:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562871.390140:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562871.390143:0:34450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786562871.390172:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1c29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd904 expref: 22 pid: 33140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.390193:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332d00) 00010000:00010000:3.0:1786562871.390205:0:34450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786562871.390222:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1c84 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd919 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.390995:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.391391:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.391404:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.391542:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.391552:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.391569:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.392974:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.392992:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393175:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562871.393190:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f5:0x0]: returning size 0 00010000:00010000:2.0:1786562871.393221:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393228:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393235:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393242:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562871.393247:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393254:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393726:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1500) 00010000:00010000:2.0:1786562871.393731:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562871.393736:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393743:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1200/0x5c655bf6668a1c8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786562871.393774:0:34450:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e44d3b5d reply state 000000004737c3ad transno 8589950921 ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562871.393788:0:34450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786562871.393832:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0c00/0x5c655bf6668a1c84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393865:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 23 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.393873:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562871.393876:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562871.393879:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031e00, rc 0) 00000100:00100000:2.0:1786562871.393966:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+24:73173:x1873345653041280:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3851us (4086us total) trans 8589950921 rc 0/0 00000100:00100000:2.0:1786562871.393976:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17553 00000100:00100000:0.0:1786562871.412651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562871.412712:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653041536 00000100:00100000:3.0:1786562871.412732:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653041536 00010000:00010000:2.0:1786562871.412776:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.412791:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.412798:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.412805:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562871.412810:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562871.412816:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17554 00010000:00010000:2.0:1786562871.412824:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562871.412831:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+24:73173:x1873345653041536:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562871.412854:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174ec800 (ffff90e9b6332e00) 00010000:00010000:3.0:1786562871.412857:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562871.412858:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562871.412864:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.412870:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1c92 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.412879:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd920 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.412986:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.413002:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.413027:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.413061:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 24 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.413075:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 24 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562871.413089:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883178e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345655003776:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562871.413167:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439240 going to sleep for 11 seconds 00000100:00100000:2.0:1786562871.416838:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883178e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345655003776:192.168.204.29@tcp:104: 00010000:00010000:2.0:1786562871.416870:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786562871.421984:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562871.422114:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653041664 00000100:00100000:2.0:1786562871.422126:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653041664 00010000:00010000:2.0:1786562871.422175:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 25 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562871.422217:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8864 00000100:00100000:2.0:1786562871.422227:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+25:2349:x1873345653041664:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786562871.422243:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786562871.422250:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 25 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.422264:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 25 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.422287:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1c99 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd919 expref: 25 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.422305:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:2.0:1786562871.422310:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.422320:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.422327:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.422356:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786562871.422422:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cae43410-29f4-4da8-9608-d4626744ead5+24:2349:x1873345653041664:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 196us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562871.422431:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8864 00010000:00010000:3.0:1786562871.424075:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.424094:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562871.424120:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f5:0x0]: returning size 0 00000004:00080000:3.0:1786562871.424923:0:35929:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x745:0x0], index 0: 0 00010000:00010000:3.0:1786562871.425134:0:35929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425145:0:35929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425152:0:35929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425158:0:35929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e991eb1e00 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:3.0:1786562871.425162:0:35929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425170:0:35929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425193:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9b6332500) 00010000:00010000:3.0:1786562871.425196:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786562871.425201:0:35929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425207:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1e00/0x5c655bf6668a1cae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425292:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1ca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd920 expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425304:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e999bb1e00) 00010000:00010000:3.0:1786562871.425306:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786562871.425310:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1ca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd920 expref: 24 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.425455:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:3.0:1786562871.426141:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+23:73173:x1873345653041536:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 13311us (13505us total) trans 8589950922 rc 301/301 00000100:00100000:3.0:1786562871.426152:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17554 00000100:00100000:1.0:1786562871.434555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562871.434664:0:34647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653041920 00000100:00100000:3.0:1786562871.434686:0:34647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653041920 00000100:00100000:3.0:1786562871.435349:0:34647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6372 00000100:00100000:3.0:1786562871.435365:0:34647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+23:73173:x1873345653041920:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1786562871.439132:0:34647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e884338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cae43410-29f4-4da8-9608-d4626744ead5+24:73173:x1873345653041920:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 3757us (4574us total) trans 8589950923 rc 0/0 00000100:00100000:2.0:1786562871.439150:0:34647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6372 00000100:00100000:0.0:1786562871.441548:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562871.441656:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653042048 00000100:00100000:1.0:1786562871.441679:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653042048 00000100:00100000:1.0:1786562871.441746:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17555 00000100:00100000:1.0:1786562871.441757:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+24:73173:x1873345653042048:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1786562871.441782:0:36756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786562871.441816:0:36756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1cbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd927 expref: -99 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562871.442203:0:36756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1cbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd927 expref: 25 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562871.442219:0:36756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e990556400/0x5c655bf6668a1cbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x4f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd927 expref: 25 pid: 36756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786562871.442240:0:36756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:1.0:1786562871.442243:0:36756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786562871.442246:0:36756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e990556400, rc 0) 00000100:00100000:1.0:1786562871.442310:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:cae43410-29f4-4da8-9608-d4626744ead5+25:73173:x1873345653042048:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 555us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562871.442318:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17555 00000100:00100000:0.0:1786562871.449088:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562871.449171:0:33116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653042304 00000100:00100000:1.0:1786562871.449181:0:33116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653042304 00000100:00100000:1.0:1786562871.449233:0:33116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6373 00000100:00100000:1.0:1786562871.449243:0:33116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+25:73173:x1873345653042304:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562871.449472:0:33116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cae43410-29f4-4da8-9608-d4626744ead5+26:73173:x1873345653042304:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 230us (394us total) trans 8589950924 rc 0/0 00000100:00100000:1.0:1786562871.449480:0:33116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6373 00000100:00100000:3.0:1786562871.465410:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562871.465604:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653042432 00000100:00100000:2.0:1786562871.465615:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653042432 00000100:00100000:2.0:1786562871.465736:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17556 00000100:00100000:2.0:1786562871.465749:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+26:73179:x1873345653042432:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562871.465781:0:33114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562871.465979:0:33114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1cc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd92e expref: -99 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.466112:0:33114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1cca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.466132:0:33114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.466144:0:33114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562871.466227:0:33114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786562871.466231:0:33114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 46 stripe count 1 MDT count 1 00000004:00010000:2.0:1786562871.466257:0:33114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.466286:0:33114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1cc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd92e expref: 28 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.466306:0:33114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030400/0x5c655bf6668a1cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd92e expref: 27 pid: 33114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.466316:0:33114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332e00) 00010000:00010000:2.0:1786562871.466319:0:33114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786562871.466322:0:33114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980030400, rc 0) 00000100:00100000:2.0:1786562871.466737:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cae43410-29f4-4da8-9608-d4626744ead5+27:73179:x1873345653042432:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 988us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786562871.466747:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17556 00000100:00100000:0.0:1786562871.478397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1786562871.478559:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653042688 00000100:00100000:2.0:1786562871.478569:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653042688 00000100:00100000:2.0:1786562871.478643:0:34450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17557 00000100:00100000:2.0:1786562871.478654:0:34450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+27:73179:x1873345653042688:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1786562871.478686:0:34450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786562871.478709:0:34450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd935 expref: -99 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.478811:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.478826:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.478836:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.478850:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479105:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479117:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479246:0:34450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479255:0:34450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479263:0:34450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786562871.479273:0:34450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f5:0x0]: returning size 0 00010000:00010000:2.0:1786562871.479359:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479371:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479379:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479386:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980030200 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562871.479390:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479398:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479412:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e9b6332e00) 00010000:00010000:2.0:1786562871.479415:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562871.479419:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479425:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980030200/0x5c655bf6668a1cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479440:0:34450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479445:0:34450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479451:0:34450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479457:0:34450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e980031400 already unused, calling callback (ffffffffc1f8c4f0) 00010000:00010000:2.0:1786562871.479461:0:34450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479466:0:34450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479474:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x174ec800 (ffff90e9b6332400) 00010000:00010000:2.0:1786562871.479476:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786562871.479480:0:34450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479485:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031400/0x5c655bf6668a1cdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x174ec800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479530:0:34450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031e00/0x5c655bf6668a1cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 30 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479719:0:34450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 29 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786562871.479729:0:34450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:2.0:1786562871.479731:0:34450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786562871.479734:0:34450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e980031a00, rc 0) 00000100:00100000:2.0:1786562871.480295:0:34450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cae43410-29f4-4da8-9608-d4626744ead5+29:73179:x1873345653042688:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1640us (1908us total) trans 8589950925 rc 0/0 00000100:00100000:2.0:1786562871.480306:0:34450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17557 00000100:00100000:1.0:1786562871.487110:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562871.487311:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653042816 00000100:00100000:0.0:1786562871.487321:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653042816 00000100:00100000:0.0:1786562871.487383:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18045 00000100:00100000:0.0:1786562871.487393:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+9:2348:x1873345653042816:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1786562871.487412:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786562871.487432:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf6668a1cf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd93c expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786562871.487460:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786562871.487481:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x745:0x0].0x0 since=1303s v=(0 0) 00010000:00010000:0.0:1786562871.487486:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786562871.487495:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf6668a1cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd93c expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.487513:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001211f00b/0x5c655bf6668a1cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd93c expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.487527:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e99ff6d400, rc 0) 00000100:00100000:0.0:1786562871.487732:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cae43410-29f4-4da8-9608-d4626744ead5+10:2348:x1873345653042816:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 330us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.487741:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18045 00000100:00100000:3.0:1786562871.502143:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1786562871.505270:0:33117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653043072 00000100:00100000:1.0:1786562871.505287:0:33117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653043072 00000100:00100000:1.0:1786562871.505363:0:33117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6374 00000100:00100000:1.0:1786562871.505375:0:33117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+29:73179:x1873345653043072:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1786562871.506674:0:33117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cae43410-29f4-4da8-9608-d4626744ead5+30:73179:x1873345653043072:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1293us (4535us total) trans 8589950926 rc 0/0 00000100:00100000:1.0:1786562871.506687:0:33117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6374 00000100:00100000:2.0:1786562871.517496:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1786562871.517808:0:35929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653043328 00000100:00100000:3.0:1786562871.517819:0:35929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653043328 00000100:00100000:3.0:1786562871.517889:0:35929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17558 00000100:00100000:3.0:1786562871.517901:0:35929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+30:73179:x1873345653043328:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1786562871.517926:0:35929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786562871.517948:0:35929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a1cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaeb12ff584cfd943 expref: -99 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.518102:0:35929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.518119:0:35929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 31 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.518127:0:35929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.518164:0:35929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 31 pid: 34450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.518178:0:35929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 31 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786562871.518194:0:35929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345655003904:192.168.204.29@tcp:104: 00000100:00100000:3.0:1786562871.518276:0:35929:0:(client.c:2702:ptlrpc_set_wait()) set ffff90e988439180 going to sleep for 11 seconds 00000100:00100000:3.0:1786562871.520265:0:35929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e883179f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:35929:1873345655003904:192.168.204.29@tcp:104: 00010000:00010000:3.0:1786562871.520291:0:35929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786562871.525801:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1786562871.529461:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345653043456 00000100:00100000:0.0:1786562871.529478:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345653043456 00010000:00010000:0.0:1786562871.529533:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 32 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786562871.529596:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8865 00000100:00100000:0.0:1786562871.529610:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e988ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+32:2348:x1873345653043456:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786562871.529628:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786562871.529635:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 32 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.529648:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 32 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.529671:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e980031a00/0x5c655bf6668a1ce6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd935 expref: 32 pid: 34450 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.529689:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:0.0:1786562871.529694:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.529703:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.529711:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786562871.529754:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786562871.529827:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e988ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cae43410-29f4-4da8-9608-d4626744ead5+31:2348:x1873345653043456:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 220us (4043us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.529836:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8865 00010000:00010000:3.0:1786562871.530054:0:35929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.530063:0:35929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786562871.530085:0:35929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x4f5:0x0]: returning size 0 00010000:00010000:3.0:1786562871.530256:0:35929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb1000/0x5c655bf6668a1cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd943 expref: 32 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.530288:0:35929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e991eb0a00/0x5c655bf6668a1d02 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x4f5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xaeb12ff584cfd943 expref: 31 pid: 35929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786562871.530296:0:35929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4f5:0x0].0x0 (ffff90e9bc2a2400) 00010000:00010000:3.0:1786562871.530300:0:35929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786562871.530303:0:35929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e991eb0a00, rc 0) 00000100:00100000:3.0:1786562871.530333:0:35929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e889d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cae43410-29f4-4da8-9608-d4626744ead5+31:73179:x1873345653043328:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 12434us (12846us total) trans 8589950927 rc 0/0 00000100:00100000:3.0:1786562871.530339:0:35929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17558 00000100:00100000:3.0:1786562871.589267:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786562871.589293:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345655004032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786562871.589370:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786562871.589420:0:24403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004032 00000100:00100000:3.0:1786562871.589427:0:24403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004032 00000100:00100000:3.0:1786562871.589485:0:24403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1786562871.589495:0:24403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345655004032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786562871.589537:0:24403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54722560 pending 0 free 3846176768 avail 3844079616 00000100:00100000:3.0:1786562871.589606:0:24403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e883179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1873345655004032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786562871.589614:0:24403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1786562871.589656:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876165 gen 2 00000004:00080000:3.0:1786562871.589662:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e9a9949500, transno 17179876160 00000004:00080000:3.0:1786562871.589687:0:3290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179876162 committed transno 17179876165 00000004:00080000:3.0:1786562871.589713:0:3290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179876165 committed transno 17179876165 00000100:00080000:0.0:1786562871.589842:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786562871.590068:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345655004288:0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.590108:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562871.590142:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786562871.590148:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345655004416:0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.590172:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562871.590203:0:33108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004288 00000100:00100000:0.0:1786562871.590208:0:33108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004288 00000100:00100000:0.0:1786562871.590239:0:33108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1786562871.590245:0:33108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345655004288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.590280:0:33108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e881b9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c95f678-1633-48c9-bbd9-793f47c06679+19:3291:x1873345655004288:12345-0@lo:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.590287:0:33108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1786562871.590321:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c95f678-1633-48c9-bbd9-793f47c06679:3291:1873345655004288:0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.590356:0:36756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004416 00000100:00100000:0.0:1786562871.590361:0:36756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004416 00000100:00100000:0.0:1786562871.590392:0:36756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1786562871.590399:0:36756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bc06df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345655004416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.590433:0:36756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bc06df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1873345655004416:12345-0@lo:400:kworker.0 Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.590439:0:36756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00080000:0.0:1786562871.590453:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562871.590469:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3291:1873345655004416:0@lo:400:kworker.0 00000100:00100000:3.0:1786562871.590703:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1873345655004032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786562871.590769:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e98827aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345655004544:0@lo:400:kworker.0 00000100:00100000:2.0:1786562871.590820:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562871.590863:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786562871.590869:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bc06dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655004160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786562871.590892:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786562871.590908:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655004672:0@lo:400:kworker.0 00000100:00100000:2.0:1786562871.590927:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786562871.591296:0:33114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004544 00000100:00100000:0.0:1786562871.591301:0:33114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004544 00000100:00100000:0.0:1786562871.591334:0:33114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1786562871.591340:0:33114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345655004544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.591380:0:33114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1873345655004544:12345-0@lo:400:kworker.0 Request processed in 40us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.591391:0:33114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00080000:0.0:1786562871.591405:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786562871.591426:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e98827aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1873345655004544:0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.591462:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004160 00000100:00100000:0.0:1786562871.591465:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004160 00000100:00100000:0.0:1786562871.591492:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1786562871.591497:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345655004160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786562871.591518:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 520290304 pending 0 free 3837788160 avail 3835691008 00000100:00100000:0.0:1786562871.591549:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9a99f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345655004160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.591555:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00080000:0.0:1786562871.591578:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786562871.591602:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843688 gen 2 00000004:00080000:0.0:1786562871.591607:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e988720380, transno 21474843686 00000004:00080000:0.0:1786562871.591618:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474843688 committed transno 21474843688 00000100:00100000:0.0:1786562871.591638:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bc06dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655004160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786562871.591822:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004672 00000100:00100000:0.0:1786562871.591826:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004672 00000100:00100000:0.0:1786562871.591848:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1786562871.591854:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345655004672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786562871.591886:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e88c79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1873345655004672:12345-0@lo:400:kworker.0 Request processed in 32us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1786562871.591891:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1786562871.591915:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1873345655004672:0@lo:400:kworker.0 00000100:00100000:1.0:1786562871.597151:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786562871.597177:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90e9bfe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345655004800:0@lo:400:kworker.0 00000100:00100000:1.0:1786562871.597245:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786562871.597301:0:34450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873345655004800 00000100:00100000:1.0:1786562871.597307:0:34450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873345655004800 00000100:00100000:1.0:1786562871.597355:0:33115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1786562871.597363:0:33115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345655004800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786562871.597410:0:33115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e9bfe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873345655004800:12345-0@lo:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1786562871.597417:0:33115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1786562871.597456:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90e9bfe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873345655004800:0@lo:400:kworker.0 00010000:00010000:2.0:1786562872.101676:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786562873.125203:0:8414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786562873.143929:0:42810:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_205b: @@@@@@ FAIL: /home/green/git/lustre-release/lustre/utils/lfs mirror extend -N --flags=nocompr /mnt/lustre/f205b.sanity-flr failed 00010000:00010000:0.0:1786562874.152069:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786562874.797591:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950926 is committed 00000020:00080000:1.0:1786562874.797624:0:33119:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969307 batchid updated 00000001:00080000:1.0:1786562874.797645:0:33119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950927 is committed 00000020:00080000:2.0:1786562874.797900:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969307 00000020:00080000:2.0:1786562874.797913:0:33151:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969307 Debug log: 67052 lines, 67052 kept, 0 dropped, 0 bad.